What happens to a Celery Worker's scheduled (eta) tasks when it shuts down?

Question

I've been learning about celery and haven't been able to find the answer to a conceptual question and have had odd results experimenting.

When there are scheduled tasks (by scheduled, I don't mean periodic but scheduled to run in the future using eta=x) submitted to Celery, they seem to be consumed from the queue by a worker right away (rather than staying in the Redis default celery key/queue). Presumably, the worker will actually execute the tasks at eta.

What happens if that worker were to be shut down or restarted (to update it's registered tasks for example)? Would those scheduled tasks be lost? They are not "running" so a warm terminate wouldn't wait for them to finish of course.

Is there a way to force those tasks to be return to the queue and consumed by the next available worker?

I suppose, manually, one could dump the tasks before shutting down a worker:

http://celery.readthedocs.org/en/latest/userguide/workers.html#inspecting-workers

and resubmit them when a new worker is back up... but is this supposed to happen automatically?

Would really appreciate any help with this

Thanks

Answer 1

Take a look at acks_late http://celery.readthedocs.org/en/latest/reference/celery.app.task.html#celery.app.task.Task.acks_late

If set to true Celery will keep the task in the queue until it has been successfully executed.