The length of execution ouput is over limit (around 1M currently) in azure adf webactivity rest api

Question

Calling azure rest api (/consumption/usagedetails) in webactivity using azure data factory .It throws error The length of execution output is over limit (around 1M currently).Any suggestion

Answer 1

Please reference this blog: Web activity throws overlimit error when calling rest api, Jay Gong has given the answer.

Web activity has times out limitation for 1 minute. Also, based on the above error The length of execution ouput is over limit (around 1M currently)., web activity also has output size limitation for 1 MB.

You could find the limitation rules from Data Factory limits and some of the them could be adjusted if you ask for Contact Support.

According the Data Factory limits and your data size, choose the right Azure Data Factory component. Such as Yuvarajan said: You can create a HTTP link service and HTTP data set and pull the data from REST API.

Hope this helps.