How to actually save a csv file to google drive from colab?

Question

so, this problem seems very simple but apparently is not. I need to transform a pandas dataframe to a csv file and save it in google drive.

My drive is mounted, I was able to save a zip file and other kinds of files to my drive. However, when I do:

df.to_csv("file_path\data.csv")

it seems to save it where I want, it's on the left panel in my colab, where you can see all your files from all your directories. I can also read this csv file as a dataframe with pandas in the same colab.

HOWEVER, when I actually go on my Google Drive, I can never find it! but I need a code to save it to my drive because I want the user to be able to just run all cells and find the csv file in the drive.

I have tried everything I could find online and I am running out of ideas! Can anyone help please?

I have also tried this which creates a visible file named data.csv but i only contains the file path

import csv
with open('file_path/data.csv', 'w', newline='') as csvfile:
  csvfile.write('file_path/data.csv')

HELP :'(

edit :

import csv

with open('/content/drive/MyDrive/Datatourisme/tests_automatisation/data_tmp.csv') as f:
    s = f.read()

with open('/content/drive/MyDrive/Datatourisme/tests_automatisation/data.csv', 'w', newline='') as csvfile:
  csvfile.write(s)

seems to do the trick.

1. First export as csv with pandas (named this one data_tmp.csv),
2. then read it and put that in a variable,
3. then write the result of this "reading" into another file that I named data.csv,

this data.csv file can be found in my drive :)

HOWEVER when the csv file I try to open is too big (mine has 100.000 raws), it does nothing. Has anyone got any idea?

Answer 1

1. First of all, mount your Google Drive with the Colab:

from google.colab import drive
    
drive.mount('/content/drive')

2. Allow Google Drive permission
3. Save your data frame as CSV using this function:

import pandas as pd

filename = 'filename.csv'

df.to_csv('/content/drive/' + filename)

In some cases, directory '/content/drive/' may not work, so try 'content/drive/MyDrive/'

Hope it helps!