While trying to connect the local hadoop with the AZURE BLOB storage (ie using the blob storage as HDFS)with Hadoop Version - 2.7.1, It throws exception
Here i have successfully formed the local cluster by setting the property
<property>
<name>fs.default.name</name>
<value>wasb://[email protected]</value>
</property>
and followed by its key value for blob storage in core-site.xml.
while listing the file or making HDFS operations to the blob storage,getting the follwing Exception as
ls: No FileSystem for scheme: wasb
Anyone please guide me to resolve the above issue.
Under the search box, select Built-in. In the search box, enter Azure blob. From the Triggers list, select the built-in trigger named When a blob is Added or Modified in Azure Storage. If you're prompted for connection details, create a connection to your Azure Storage account.
The Azure Blob Storage interface for Hadoop supports two kinds of blobs, block blobs and page blobs.
About. Windows Azure Storage Blob (WASB) is an file system implemented as an extension built on top of the HDFS APIs and is in many ways HDFS. The WASB variation uses: SSL certificates for improved security. the storage accounts in WASB to load data instead of from local disks in HDFS.
By default, the URL for accessing the Blob service in a storage account is https://<your account name>. blob.core.windows.net. You can map your own domain or subdomain to the Blob service for your storage account so that users can reach it using the custom domain or subdomain.
Now you can do all the operations. Refer Azure Blob Storage documentation for more information.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With