I have created sample DAG, where I had DAG config as below.
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'start_date': one_min_ago,
'email': ['[email protected]'],
'email_on_failure': True,
'email_on_retry': True,
'retries': 5,
'retry_delay': timedelta(hours=30))
With this when I run airflow webserver I'm getting below message.
/home/af_user/anaconda/lib/python3.5/site-packages/flask/exthook.py:71:
ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use
flask_cache instead.
.format(x=modname), ExtDeprecationWarning
[2017-12-18 12:41:27,967] [17328] {models.py:167} INFO - Filling up the
DagBag from /home/af_user/airflow/dags
[2017-12-18 12:41:28 +0000] [16648] [INFO] Handling signal: ttou
[2017-12-18 12:41:57 +0000] [16655] [INFO] Worker exiting (pid: 16655)
And also DAG will be there in running state only.
Let me know if any once came across this issue and fixed it already.
Those messages are expected. The ttou (and ttin) signals are used to refresh gunicorn workers of the webserver so that it picks up DAG changes. You can modify or disable this behavior with the worker_refresh_interval and worker_refresh_batch_size airflow config values.
I don't really want to change worker_refresh_interval or worker_refresh_batch_size without a good reason. An alternative is to set an environment variable:
GUNICORN_CMD_ARGS="--log-level WARNING"
If setting this in a docker-compose.yml file, the following is tested with apache-airflow==1.10.6 with gunicorn==19.9.0:
environment:
- 'GUNICORN_CMD_ARGS=--log-level WARNING'
If setting this in a Dockerfile, the following is tested with apache-airflow==1.10.6 with gunicorn==19.9.0:
ENV GUNICORN_CMD_ARGS --log-level WARNING
Credit: answer by amoskaliov
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With