Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

how to read a file from HDFS through browser

Tags:

hadoop

How to provide a link a HDFS file, so that clicking on that url it will downlaod the HDFS file..

Please provide me the inputs..

Thanks MRK

like image 973
MRK Avatar asked Nov 21 '11 09:11

MRK


2 Answers

Check the HDFS Proxy Guide.

There is also Hoop which is being contributed to Hadoop by Cloudera. Currently it's targeted for the 0.24 release. But, it can be build, installed and configured manually using the instructions at the Hoop Site.

While HDFS Proxy supports only W, HOOP supports R/W to HDFS. Plan is to replace HDFS Proxy with Hoop.

While the above options are proxy based, another option is to to directly access the NameNode without a proxy. Browse the file system (http://namenode:50070/nn_browsedfscontent.jsp) and go to the file for which the URL has to be shared.

Edit: Also check WebHDFS.

like image 155
Praveen Sripati Avatar answered Oct 04 '22 11:10

Praveen Sripati


If you have hue installed in your cluster you could try

http://www.namenode:8888/filebrowser

or they also have standard chrome extension at this link that will basically covert the hdfs link for you

http://wiki.pentaho.com/display/BAD/Simple+Chrome+Extension+to+browse+HDFS+volumes

like image 44
Animesh Raj Jha Avatar answered Oct 04 '22 12:10

Animesh Raj Jha