Peek of multiprocessing.queue?

Question

I have multiple worker processes reading from the same multiprocessing.queue(). Each worker process only read contents belongs to itself, and must leave the other contents untouched. So basically the worker process must first check the queue contents then decides whether to pop one item.

Is there any way to do this with multiprocessing.queue?

Answer 1

you can always put back messages that you don't need (if order is not an issue)

def get_my_job():

    while True:
        job = q.get()
        if job == 'mine':
            return job
        q.put(job)
        time.sleep(random()/2) #preventing deadlocks...

If the order is important you may use multiple Queues for so each message type will be in its own Queue

queues = { 'queue4worker_type1': Queue(),
           'queue4worker_type2': Queue(),
          }
#each worker can now consume only messages for its wanted types ...