Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

how to execute hadoop jar from HDFS FileSystem?

Tags:

hadoop

I'm always executing job from local File system as following

hadoop jar /home/usr/jar/myjar.jar com.test.TestMain 

How can I execute same command but myjar.jar will be in hdfs ?

Something like

hadoop jar hdfs:///home/usr/jar/myjar.jar com.test.TestMain 

But of course this doesn't work...

like image 617
Julias Avatar asked Dec 01 '25 05:12

Julias


1 Answers

hadoop fs -copyToLocal hdfs:///home/usr/jar/myjar.jar /tmp/myjar.jar && hadoop jar /tmp/myjar.jar com.test.TestMain 
like image 111
Ion Cojocaru Avatar answered Dec 04 '25 04:12

Ion Cojocaru



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!