Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Aws glue triggers are not working

I have tried to run AWS glue trigger with proper values but it is not going to run job, On which we have setup the trigger.

For instance I have Job1 and Job2. On complition of Job1 i want to run Job2. Job1 is getting passed but it is unable to trigger Job2.

Can you please help me to know what am i missing?

like image 731
pavan yadav Avatar asked Nov 06 '17 11:11

pavan yadav


3 Answers

Old ticket but my problem was the trigger was not "enabled". In the AWS console select the trigger, and in actions click enable. At the time of writing this was not possible to do via cloudformation :(

like image 103
Owen Ben Davies Avatar answered Sep 21 '22 12:09

Owen Ben Davies


From AWS documentation:

Dependent jobs are only started if the job which completes was started by a trigger (not run ad-hoc). All jobs in a dependency chain must be descendants of a single schedule or on-demand trigger.

https://docs.aws.amazon.com/glue/latest/dg/trigger-job.html

like image 25
stepandel Avatar answered Sep 21 '22 12:09

stepandel


You can create another on-demand job and trigger your job by the new job. That would work.

like image 23
Vivek Avatar answered Sep 22 '22 12:09

Vivek