I want to load a large file line by line in Nim. I tried the following code snippet:
for line in lines "largefile.txt":
echo line
However, this loads the entire file largefile.txt
into memory which is not feasible when the file is very large > 30GB.
How can I iterate over a large file while holding only a single line in memory ?
Indeed, Reimer Behrends is right. The lines
function works as expected.
The issue was that my file had only escaped newline characters. As a result, Nim (correctly) reads the file as one large line.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With