Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Error Handling on Azure Data Factory V2

Team.

I have a situation to handle errors in ADF2 using Web Activity. Within a pipeline, any activity fails, it should trigger web activity. I attached the web activity after each activity's failed status. Therefore the web activity's dependsOn property looks like:

"dependsOn": {
  "activity1": [
    "Failed"
  ],
  "activity2": [
    "Failed"
  ]
}

However, the web activity only gets fired when all activity1 and activity2 are failed. What I wanted was to get that fired either activity1 or activity2 is failed. Instead, I used the IfCondition activity but it doesn't seem to be the right (correct or proper) way. What would be the best practice?

I tried to get all activities from filtering pipeline().activities, but it's not supported, either.

like image 762
justinyoo Avatar asked Aug 01 '18 04:08

justinyoo


1 Answers

You may try ExecutePipeline with waitOnCompletionchecked. Any inner pipeline failure within ExecutePipeline will make the outside ExecutePipeline fail.

like image 93
Bo Xiao Avatar answered Sep 17 '22 08:09

Bo Xiao