WARNING - State of this instance has been externally set to success. Taking the poison pill

Question

I have recently upgraded my Airflow cluster from 1.7.1.3 to 1.10.2 with mysql as backend and rabbitmq for message passing. After upgrading i am seeing this issue in some of my tasks -

WARNING - State of this instance has been externally set to success. Taking the poison pill.

This randomly comes once in a while in any task. I have not marked this task success externally but still i am getting this error. Has anyone else faced this? How to fix this ?

Answer 1

This error typically occurs when a task has timed out. You could increase the timeout in case your task takes a long time to execute.

You could also look into visibility timeouts in case you are using Celery with Redis as the backend.