Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Error in starting hadoop Job Tracker

Tags:

hadoop

I tried to run a simple program in hadoop using Windows-Cygwin.

I am able to start the namenode .

The jobtracker start however fails with exception :

FATAL mapred.JobTracker: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: local
        at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162)
        at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:128)
        at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2560)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2200)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)

I tried all possible methods to resolve this ,but in vain. Any pointers will greatly help me.

Hdfs-site.xml configurations :

 <configuration><br>
   <property>
     <name>fs.default.name< /name>
     <value>hdfs://localhost:9100</value>
   </property>
   <property>
     <name>mapred.job.tracker< /name>
     <value>localhost:9101< /value>
   </property>
   <property>
     <name>dfs.replication< /name>
     <value>1</value>
   </property> 
 </configuration>
like image 829
stackuser Avatar asked Apr 08 '12 00:04

stackuser


1 Answers

The problem is the following lines should on into mapred-site.xml and NOT hdfs-site.xml,

<property> 
<name>mapred.job.tracker</name> 
<value>localhost:9101</value> 
</property>

By the way why are you trying to run Hadoop in Windows? For development? You don't have a linux machine or reluctant to install one?

One more thing, you usually put this property in core-site.xml not hdfs-site.xml,

<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9100</value>
</property>
like image 127
SSaikia_JtheRocker Avatar answered Sep 21 '22 23:09

SSaikia_JtheRocker