Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How do I make multiple celery workers run the same tasks?

I have one task that is checking a url speed, but i want that to be executed by multiple celery workers in different servers. I want the same url to be checked by multiple workers.

How can I do that?

like image 280
gawry Avatar asked May 17 '12 12:05

gawry


1 Answers

If you could set ignore_result=True . Try Broadcast

If you couldn't, check Routing Tasks and send the task multiple times to different queues, for different IDC for example, and corresponding workers.

like image 61
okm Avatar answered Nov 12 '22 08:11

okm