Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Is it possible to run MapReduce locally, without HDFS and Hadoop cluster?

Given I develop MapReduce tasks in my Windows system and before moving them to HDFS cluster I would like to run MapReduce locally. I just want to check how do work my mapper logic, inputSplits, Input/Output formats etc. Is it possible?

like image 672
MiamiBeach Avatar asked Oct 18 '25 17:10

MiamiBeach


1 Answers

Hadoop runs in 3 modes.

1.local mode  
2.psuedo mode  
3.distributed mode. 

The one you are looking for is the local mode. You can debug your mapreduce code from eclipse before run it in 2 or 3 modes.
This step by step guide to run application in local mode helps you a lot to debug your application.
Hope it helps!

like image 137
Mr.Chowdary Avatar answered Oct 20 '25 12:10

Mr.Chowdary



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!