Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Airflow tasks get stuck at “Scheduled” status and never gets running during backfill

Trying to do some backfills, and all the dag runs start up fine, but for some reason they can't get by a specific task, instead they get stuck in a "Scheduled" state. Not sure what "Scheduled" means and why they don't move to "Running". It works fine in the daily run, but the backfill gets stuck for some reason.

This is super annoying since it means I have to start all the tasks for the backfill manually, which works.

Any idea why a task might be stuck in a "Scheduled" state?

like image 959
Tomas Jansson Avatar asked Oct 11 '25 13:10

Tomas Jansson


1 Answers

Tasks stuck in a “queued” state usually mean one of two things, no queue to execute on or no pool to execute in.

Which executor are you using? Local, sequential, celery?

like image 75
trejas Avatar answered Oct 15 '25 15:10

trejas



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!