Drop column using Dask dataframe

Question

This should work:

raw_data.drop('some_great_column', axis=1).compute()

But the column is not dropped. In pandas I use:

raw_data.drop(['some_great_column'], axis=1, inplace=True)

But inplace does not exist in Dask. Any ideas?

Answer 1

You can separate into two operations:

# dask operation
raw_data = raw_data.drop('some_great_column', axis=1)

# conversion to pandas
df = raw_data.compute()

Then export the Pandas dataframe to a CSV file:

df.to_csv(r'out.csv', index=False)