Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Export Azure application Insight log files to Azure Data Lake storage

Tags:

I am beginner of the azure portal , I configured the Azure Application insight in front-end side (Angular 2) and Back-end side (Asp.net core)

I can track my application log file through azure application insight,and export the xls sheet also http://dailydotnettips.com/2015/12/04/exporting-application-insights-data-to-excel-its-just-a-single-click/ ,But i need to store all my log file into azure data lake storage for the Backup tracking purpose

I need to debug the issue on my application while facing issues.but i got the link https://docs.microsoft.com/en-us/azure/application-insights/app-insights-code-sample-export-sql-stream-analytics and Can I download data collected by Azure Application Insights (events list)? continues export for sql,blob storage,i dont want unwanted storage for storing my data in azure resources.

So If there is any way for connect application insight to Azure Data lake through connector or plugins.IF its could you please share me the link.

Thank you..

like image 756
richard a Avatar asked May 30 '17 11:05

richard a


People also ask

How do I Export logs from application insights?

In the Application Insights resource for your app under Configure on the left, open Continuous export and select Add. Choose the telemetry data types you want to export. Create or select an Azure Storage account where you want to store the data. For more information on storage pricing options, see the Pricing page.

Where are application insight logs stored?

Application Insights is an Azure service. Security policies are described in the Azure Security, Privacy, and Compliance white paper. The data is stored in Microsoft Azure servers.

How do I Export data from Azure log analytics?

In the Log Analytics workspace menu in the Azure portal, select Data Export from the Settings section and click New export rule from the top of the middle pane. Follow the steps, then click Create.


1 Answers

Automatic

If you export the events to azure blob storage you can do multiple things:

  • Use Azure Data Factory to copy the data from blob storage to Azure Data Lake
  • Use AdlCopy to copy the data from blob storage to Azure Data Lake
  • Write an U-Sql job to copy the data to Azure Data Lake

Manual

To manually place exported Application Insights data (in .xls format) you can use the portal to upload the file to Azure Data Lake.

If you need to have more control about the exported data you can use Application Insights Analytics to create a query based on the available data and export it to an .xls file.

If course you can also create a small app to export the .xls file to Azure Data Lake if you do not want to upload it using the portal. You can use the api for that.

like image 179
Peter Bons Avatar answered Sep 23 '22 11:09

Peter Bons