Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Using Azure Data Factory to get data from a REST API

Is it possible to use Azure Data Factory to get data from a REST API and insert it to a Azure database table?

like image 334
dagrun Avatar asked Feb 22 '16 10:02

dagrun


People also ask

Does Azure support REST API?

The Azure Support REST API enables you to create and manage Azure support tickets programmatically. Using the API, you can: Open a technical, billing, subscription management, or subscription and service limits (quota) support ticket. Get a list of support tickets and detailed information about each ticket.


2 Answers

Data factory offers a generic HTTP connector and a specific REST connector, allowing you to do retrieve data from HTTP endpoints by using GET or POST methods.

Example: HTTP Linked Service

{
    "name": "HttpLinkedService",
    "properties":
    {
        "type": "Http",
        "typeProperties":
        {
            "authenticationType": "Anonymous",
            "url" : "https://en.wikipedia.org/wiki/"
        }
    }
}
like image 107
Alex KeySmith Avatar answered Oct 20 '22 12:10

Alex KeySmith


I have done this using Custom .Net Activities. I had a need to pull data from Salesforce API. I have a write up on how to do this here: http://eatcodelive.com/2016/02/06/accessing-azure-data-lake-store-from-an-azure-data-factory-custom-net-activity/ it is utilizing the data lake store but you can store the data anywhere.

Also have a look here for an example from microsoft: https://azure.microsoft.com/en-us/documentation/articles/data-factory-use-custom-activities/

Hope that helps.

like image 36
JustLogic Avatar answered Oct 20 '22 14:10

JustLogic