I see that there are different kinds of URLS to access a blob storage like shown below:
wasb://[email protected]
https://[email protected]
What is the difference? what could be the reason for difference?
By default, the URL for accessing the Blob service in a storage account is https://<your account name>. blob.core.windows.net.
Windows Azure Storage Blob (WASB) is an object store service available on Azure. WASB is not supported as a default file system, but access to data in WASB is possible via the wasb connector. These steps assume that you are using an HDP version that supports the wasb cloud storage connector (HDP 2.6. 1 or newer).
Users or client applications can access objects in Blob storage via HTTP/HTTPS, from anywhere in the world.
About. Windows Azure Storage Blob (WASB) is an file system implemented as an extension built on top of the HDFS APIs and is in many ways HDFS. The WASB variation uses: SSL certificates for improved security. the storage accounts in WASB to load data instead of from local disks in HDFS.
From what I understand, wasb://[email protected]
is used to access blob storage through HDInsight
(ref: http://www.windowsazure.com/en-us/documentation/articles/hdinsight-use-blob-storage/
) where as https://[email protected]
is used to access blobs through clients supporting HTTP
protocol (web browsers etc.).
Just to refine the previous answer a bit: wasb is the hdfs compatible API on top of Azure blob storage. So, using it you can access blobs from any hdfs client, be it part of HDInsight, a self installed IaaS hadoop cluster etc.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With