Start and stop Airflow?

Question

I'm testing airflow google composer but right now I don't use it all the time and it cost money to maintains the 3 VM. Is there a way to stop/start google composer/airflow ?

Is it possible to do it programmatically ? (I want to start it every morning at 9am and stop it every night at 9pm and the week-end)

Right now to stop most of the costs I change the number of VM in Kubernetes Engine (I switch from 3 to 0 to stop it and then to 0 to 3 to start it) but maybe there is a better way.

Answer 1

There is no officially-supported mechanism for pausing a Composer environment. Even though you are able to reduce your VM costs by reducing the cluster size, you continue to be billed for the App Engine and Cloud SQL costs.