Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to query Azure Data Lake? [closed]

Coming from the database world, when we have something related to Data we use a ui tool to query data. Be it big or small.

Is there anything like SSMS, SQL WorkBench (For Big Data Redshift), Athena (Query Big Data S3) for Azure Data Lake?

I see Data Lake Analytics just queries the data and store it in file. Is there is anyway to query the data on Azure Data Lake via a UI Tool or WebBased Tool?

like image 612
Kannaiyan Avatar asked Nov 17 '17 18:11

Kannaiyan


2 Answers

No there is not (yet). Sure, you can run a query using the portal or using Visual Studio (docs) or Visual Studio Code (docs) but all those tools will provide access to the generated file (which can be easily obtained or previewed)

Main reason is that u-sql / data lake analytics is geared toward long running jobs (that can take up from a few minutes to hours) to process the vast amount of data. Keeping that in mind you can hopefully better understand why these kind of direct query tooling is not (yet?) available.

EDIT: try upvoting this on the feedback site. What you are asking is a highly requested feature.

like image 70
Peter Bons Avatar answered Nov 19 '22 23:11

Peter Bons


You can download the Azure Data Explorer form here https://azure.microsoft.com/en-us/features/storage-explorer/ Upload, download, and manage Azure blobs, files, queues, and tables, as well as Azure Cosmos DB and Azure Data Lake Storage entities. Easily access virtual machine disks, and work with either Azure Resource Manager or classic storage accounts. Manage and configure cross-origin resource sharing rules

like image 28
Muhammad Abubaker Avatar answered Nov 20 '22 00:11

Muhammad Abubaker