How to push job in specific queue and limit number workers with sidekiq?

Question

I know we can do:

sidekiq_options queue: "Foo"

But in this case it's the Worker which is assigned to only one queue: "Foo".

I need to assign a Job (and not a Worker) in specific queue. With Resque it's easy:

Resque.enqueue_to(queue_name, my_job)

Further, for concurrency problem, i need to limit the number of Worker on each queue at 1.

How can I do this?

Answer 1

You might use https://github.com/brainopia/sidekiq-limit_fetch

and then:

Sidekiq::Client.push({
    'class' => GuidePdfWorker,
    'queue' => queue_name,
    'args'  => [my_job]
})
Sidekiq::Queue[queue_name].limit = 1

But you have to declare your queue_name in the config/sidekiq.yml

Answer 2

I have achieved the above said functionality using the sidekiq limit fetch. You can set dynamic queue mode to true and specify the queues in the Sidekiq::Client.push

And set the process limit to the specific queue. We can either set the process limit or we can ignore and simply it process as per the sidekiq default limit