Migrate existing Airflow DB to Cloud Composer

Question

Is there any way to migrate an existing Airflow instance onto Google Cloud Composer?

We're currently running our own instance of Airflow using postgres for the db. Ideally we'd be able to preserve the existing history of the DAGs, which I believe would require copying the entire database over. Is this possible?

Answer 1

All of the Airflow metadata is kept in the database instance. For PostgreSQL, you could do a pg_dump on your current database followed by a pg_restore into your Composer database in core-sql_alchemy_conn. In the Composer docs, I don't see it specifically mentioned anywhere which database they use, but I'm assuming they're on PostgreSQL as well.

You want to be careful to make sure that your existing database is running the same Airflow version as Composer. Composer is currently on Airflow 1.9.0.