processing large cloud storage files in app engine

Question

I'm required to process large files, up to 2GB, in GAE (I'm using Python). of course I'll be running the code on a backend, however since a local storage isn't available the data will need to be in memory.

is there a file descriptor like wrapper for boto or other cloud storage supported protocol? or other recommended technique?

Thanks, Shay

Answer 1

You maybe interesting in "Google Cloud Storage Python API Overview". It works like a regular local file. I've used it on my project and didn't encountered any problems with it.