Triggering an Airflow DAG from terminal not working

Question

I'm trying to use airflow to define a specific workflow that I want to manually trigger from the command line.

I create the DAG and add a bunch of tasks.

dag = airflow.DAG(     "DAG_NAME",     start_date=datetime(2015, 1, 1),     schedule_interval=None,     default_args=args) 

I then run in the terminal

airflow trigger_dag DAG_NAME 

and nothing happens. The scheduler is running in another thread. Any direction is much appreciated. Thank You

Answer 1

I just encountered the same issue.

Assuming you are able to see your dag in airflow list_dags or via the web server then:

Not only did I have to turn on the dag in the web UI, but I also had to ensure that airflow scheduler was running as a separate process.

Once I had the scheduler running I was able to successfully execute my dag using airflow trigger_dag <dag_id>

My dag configuration is not significantly different from yours. I also have schedule_interval=None

Answer 2

You may have disabled the workflow. To enable the workflow manually. Open up the airflow web server by

$ airflow webserver -p 8080 

Go to http://localhost:8080 . You should see the list of all available dags with a toggle button on/off. By default everything is set to off. Search for your dag and toggle your workflow. Now try triggering the workflow from terminal. It should work now.