How to restart webserver in Cloud Composer

Question

We recently met a known issue on airflow:

Airflow "This DAG isnt available in the webserver DagBag object "

Now we used a temporary solution to restart whole environment by changing configurations but this is not an efficient method. The best workaround now we think is to restart webservers on cloud composer, but we didn't find any command to restart webserver. Is it a possible action?

Thanks!

Answer 1

For those who wander and find this thread: currently the for versions >= 1.13.1 Composer has a preview for a web server restart

Answer 2

Only certain types of updates will cause the webserver container to be restarted, like adding, removing, or upgrading one of the PyPI packages or like changing an Airflow setting.

You can do for example:

# Set some arbitrary Airflow config value to force a webserver rebuild. 
gcloud composer environments update ${ENVIRONMENT_NAME} \
  --location=${ENV_LOCATION} \
  --update-airflow-configs=dummy=true

# Remove the previously set config value. 
gcloud composer environments update ${ENVIRONMENT_NAME} \ 
  --location=${ENV_LOCATION} \
  --remove-airflow-configs=dummy