Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Failed to start namenode in hadoop?

Tags:

I config Hadoop in windows 7 from tutorial It setting up a Single Node Cluster. When run hdfs namenode -format to format namenode it throw exception like: And when start-all.cmd the windows namenode auto forced then I can open namenode GUI in address – http://localhost:50070.

16/01/19 15:18:58 WARN namenode.FSEditLog: No class configured for C, dfs.namenode.edits.journal-plugin.C is empty
16/01/19 15:18:58 ERROR namenode.NameNode: Failed to start namenode. java.lang.IllegalArgumentException: No class configured for C at org.apache.hadoop.hdfs.server.namenode.FSEditLog.getJournalClass(FSEditLog.java:1615) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1629) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:282) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournalsForWrite(FSEditLog.java:247) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:985) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1429) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554) 16/01/19 15:18:58 INFO util.ExitUtil: Exiting with status 1 16/01/19 15:18:58 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************

Core-site.xml

<configuration>     <property>         <name>fs.defaultFS</name>         <value>hdfs://localhost:9000</value>     </property> </configuration>    

hdfs-site.xml

<configuration>    <property>        <name>dfs.replication</name>        <value>1</value>    </property>    <property>        <name>dfs.namenode.name.dir</name>        <value>C:/hadoop/data/namenode</value>    </property>    <property>        <name>dfs.datanode.data.dir</name>        <value>C:/hadoop/data/datanode</value>    </property> </configuration> 

mapred-site.xml

<configuration>     <property>        <name>mapreduce.framework.name</name>        <value>yarn</value>     </property> </configuration> 

yarn-site.xml

<configuration>    <property>        <name>yarn.nodemanager.aux-services</name>        <value>mapreduce_shuffle</value>    </property>    <property>        <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>        <value>org.apache.hadoop.mapred.ShuffleHandler</value>    </property> </configuration> 
like image 563
Van Loc Avatar asked Jan 19 '16 08:01

Van Loc


People also ask

What if NameNode fails in Hadoop?

If NameNode fails, the entire Hadoop cluster will fail. Actually, there will be no data loss, only the cluster job will be shut down because NameNode is just the point of contact for all DataNodes and if the NameNode fails then all communication will stop.

How do I start the NameNode in Hadoop?

By following methods we can restart the NameNode: You can stop the NameNode individually using /sbin/hadoop-daemon.sh stop namenode command. Then start the NameNode using /sbin/hadoop-daemon.sh start namenode. Use /sbin/stop-all.sh and the use /sbin/start-all.sh, command which will stop all the demons first.

What happens when NameNode starts?

When a NameNode starts up, it merges the fsimage and edits journal to provide an up-to-date view of the file system metadata. The NameNode then overwrites fsimage with the new HDFS state and begins a new edits journal. The Checkpoint node periodically creates checkpoints of the namespace.


1 Answers

Change your following properties from:

<property>    <name>dfs.namenode.name.dir</name>    <value>C:/hadoop/data/namenode</value> </property> <property>    <name>dfs.datanode.data.dir</name>    <value>C:/hadoop/data/datanode</value> </property> 

To:

<property>    <name>dfs.namenode.name.dir</name>    <value>/hadoop/data/namenode</value> </property> <property>    <name>dfs.datanode.data.dir</name>    <value>/hadoop/data/datanode</value> </property> 
like image 170
SMA Avatar answered Sep 18 '22 11:09

SMA