I load a very large csv file in a <code>gz</code> format in Pandas 0.18 using <code>pd=pd.read_csv('myfile.gz')</code> Without surprise, once the csv is unzipped and loaded into the RAM, it takes a lot of space. However, I still need to save my file after I perform my computations. Can <code>to_csv</code> store my dataframe in a <code>gz</code> format? The only related question I found on StackOverflow is 3 year old...

You could use the parameter <code>compression='gzip'</code> source

how can I save a Pandas dataframe into a compressed csv file? [duplicate]

You could use the parameter compression='gzip'

source

answered Feb 05 '23 17:02

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!