Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

what difference between execute a map-reduce job using hadoop and java command

Find many option for run a map-reduce program. Can any one explain difference between theses below commands. And what impact on Map-reduce job if any.

     java -jar MyMapReduce.jar [args] 

     hadoop jar MyMapReduce.jar [args] 

     yarn jar MyMapReduce.jar [args] 

In these command which one best or other in any?

Can make configuration like display all information about job using Yarn and Job History (like as display Hadoop and yarn command) on Web service normal using port for web service 8088(YARN) on below command?

     java -jar MyMapReduce.jar [args] 
like image 307
Tinku Avatar asked Aug 07 '14 10:08

Tinku


2 Answers

None of them is better than the other. When you execute the java -jar command, it is just the same as executing a non Hadoop application. If you use hadoop jar or yarn jar, it will use the /usr/bin/hadoop and /usr/bin/yarn scripts to set up the environment.

Unless you have modified any of the scripts to set up additional variables, the three of them should work the same.

like image 72
Balduz Avatar answered Oct 22 '22 21:10

Balduz


The options have its own specifications :

   java -jar MyMapReduce.jar [args] 

The above expects that all the hadoop jars are defined in class path of the jar .

in case of

   hadoop jar MyMapReduce.jar [args]  and 
   yarn jar MyMapReduce.jar [args] 

The above jars will run by fetching those jars predefined in $HADOOP_CLASSPATH.

like image 21
K S Nidhin Avatar answered Oct 22 '22 21:10

K S Nidhin