Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Hadoop 2.2 Installation `.' no such file or directory

Tags:

hadoop

hdfs

I have installed Hadoop and HDFS using this tutorial

http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html 

Everything is fine.

I am also able to create directories and use them using

hadoop fs -mkdir /tmp hadoop fs -mkdir /small 

I can also say

hadoop fs -ls / 

However I am following a tutorial in which the trainer does

hadoop fs -mkdir temp hadoop fs -ls 

now on my machine when I issue the above command it says

ls: `.': No such file or directory 

In my training video the command hadoop fs -ls works perfectly. Why should I specify the "/"?

Also I am getting this warning in all my commands

13/12/28 20:23:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 

But in my trainers video there is no such warning.

My configuration file is exactly as the tutorial above and I can also see all management UIs at

http://abhishek-pc:8042/ http://abhishek-pc:50070/ http://abhishek-pc:8088/ 

So my question is what is wrong with my configuration and why is my system behaving differently than the training video?

like image 892
Knows Not Much Avatar asked Dec 29 '13 02:12

Knows Not Much


2 Answers

Well, your problem regarding ls: '.': No such file or directory' is because, there is no home dir on HDFS for your current user. Try

hadoop fs -mkdir -p /user/[current login user] 

Then you will be able to hadoop fs -ls

As per this warning WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable, please see my answer at this question

like image 84
zhutoulala Avatar answered Sep 22 '22 03:09

zhutoulala


First:

hdfs dfs -mkdir /user 

then perform

hdfs dfs -mkdir /user/hduser 
like image 36
user3364393 Avatar answered Sep 25 '22 03:09

user3364393