Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

mpi4py hangs when trying to send large data

i've recently encountered a problem trying to share large data among several processors using the command 'send' from the mpi4py-library. Even a 1000x3 numpy float array is too large to be sent. Any ideas how to overcome this problem?

thx in advance.

like image 282
OD IUM Avatar asked Feb 03 '14 13:02

OD IUM


2 Answers

I've found a simple solution. Divide data into small enough chunks...

like image 198
OD IUM Avatar answered Jan 02 '23 20:01

OD IUM


I encountered this same problem with Isend (not with Send). It appears that the problem was due to the sending process terminating before the receiver had received the data. I fixed this by including a comm.barrier() call at the end of each of the processes.

like image 27
KeithWM Avatar answered Jan 02 '23 20:01

KeithWM