Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Write out file with google colab

Was there a way to write out files with google colab? For example, if I use

import requests
r = requests.get(url)

Where will those files be stored? Can they be found? And similarly, can I get the file I outputted via say tensorflow save function

saver=tf.Saver(....)
...
path = saver.save(sess, "./my_model.ckpt")

Thanks!

like image 493
Dogemore Avatar asked Apr 05 '18 14:04

Dogemore


People also ask

How do I add a text file to Google Colab?

Uploading file using Colab files module Instead of clicking the GUI, you can also use Python code to upload files. You can import files module from google. colab . Then call upload() to launch a “File Upload” dialog and select the file(s) you wish to upload.


2 Answers

In your first example, the data is still in r.content. So you also need to save them first with open('data.dat', 'wb').write(r.content)

Then you can download them with files.download

from google.colab import files
files.download('data.dat')

Downloading your model is the same:

files.download('my_model.ckpt')
like image 122
korakot Avatar answered Oct 06 '22 02:10

korakot


I found it is easier to first mount your Google drive to the non-persistent VM and then use os.chdir() to change your current working folder.

After doing this, you can do the exactly same stuff as in local machine.

I have a gist listing several ways to save and transfer files between Colab VM and Google drive, but I think mounting Google drive is the easiest approach.

For more details, please refer to mount_your_google_drive.md in this gist https://gist.github.com/Joshua1989/dc7e60aa487430ea704a8cb3f2c5d6a6

like image 35
Joshua Lian Avatar answered Oct 06 '22 02:10

Joshua Lian