Menu
I'm using Airflow version 1.9.0, and I'm gonna have hundreds of Dags. is there a way to arrange the Airflow UI with folders, sub folders, and only then to put the Dags in it?
597
Change the Dag folder by using the following commands. Run the . bashrc file by using the below command. Now if you run airflow webserver, it will pick the dags from the AIRFLOW_HOME/dags directory.
cfg . The default location for your DAGs is ~/airflow/dags .
Step 1, define you biz model with user inputs Step 2, write in as dag file in python, the user input could be read by airflow variable model. (key/value mode) step 3. exchange tasks info by airflow xcom model. then it done.
The graph view is perhaps the most comprehensive. Visualize your DAG's dependencies and their current status for a specific run.
The UI doesn't ship with that, but you can use the search bar to filter out what DAGs you're seeing. For instance you can type in your Owner name if you just want to see your own DAGs.
173
My approach is make a consistent naming convention for dag_id, such as:
project1_workflow1_startdate1
project1_workflow2_startdate1
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
