Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Does Airflow restart affect current running jobs?

Tags:

airflow

This seems like a mundane question but just to be on the safe side, what are the effects of restarting the airflow service on the jobs which are currently running?

like image 840
Madhavi Jouhari Avatar asked Aug 18 '16 15:08

Madhavi Jouhari


1 Answers

If you only restart the airflow webserver/scheduler processes then the running jobs are not affected. However restarting the worker process kills the job (killed as zombie - http://airflow.incubator.apache.org/concepts.html#zombies-undeads) and then it may or may not be retried accordingly to the dag/task rules.

like image 148
Vineet Goel Avatar answered Jan 04 '23 05:01

Vineet Goel