Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Azure Data Factory(ADF) vs Azure Functions: How to choose?

Currently we are using Blob trigger Azure Functions to move json data into Cosmos DB. We are planning to replace Azure Functions with Azure Data Factory(ADF) pipeline. I am new to Azure Data Factory(ADF), so not sure, Could Azure Data Factory(ADF) pipeline be better option or not?

like image 864
Rakesh Kumar Avatar asked Feb 08 '20 15:02

Rakesh Kumar


2 Answers

Though my answer is a bit late, I would like to add that I would not recommend replacing your current setup with ADF. Reasons:

  1. It is too expensive. ADF costs way more than azure functions.
  2. Custom Logic: ADF is not built to perform cleansing logics or any custom code. Its primary goal is for data integration from external systems using its vast connector pool
  3. Latency: ADF has much higer latency due to the large overhead of its job frameweork
like image 129
Tarek Salha Avatar answered Oct 20 '22 19:10

Tarek Salha


Based on you requirements, Azure Data Factory is your perfect option. You could follow this tutorial to configure Cosmos DB Output and Azure Blob Storage Input.

Advantage over azure function is being that you don't need to write any custom code unless there is a data cleaning involved and azure data factory is the recommended option, even if you want azure function for other purposes you can add it within the pipeline.

like image 36
Sajeetharan Avatar answered Oct 20 '22 19:10

Sajeetharan