Parallel computing

Question

I have a two dimensional table (Matrix) I need to process each line in this matrix independently from the others. The process of each line is time consuming. I'd like to use parallel computing resources in our university (Canadian Grid something)

Can I have some advise on how to start ? I never used parallel computing before.

Thanks :)

Answer 1

Start here: http://docs.python.org/library/multiprocessing.html

Be sure to read this: http://docs.python.org/library/multiprocessing.html#examples

This may be helpful: http://www.slideshare.net/pvergain/multiprocessing-with-python-presentation.

While excellent, it includes threads and multiprocessing, even though multiprocessing is often far, far superior to attempting multi-threading.

For Grid computing, multi-threading is largely useless.

Also, you probably also want to read up on celery.