Given I develop MapReduce tasks in my Windows system and before moving them to HDFS cluster I would like to run MapReduce locally. I just want to check how do work my mapper logic, inputSplits, Input/Output formats etc. Is it possible?
Hadoop runs in 3 modes.
1.local mode
2.psuedo mode
3.distributed mode.
The one you are looking for is the local mode. You can debug your mapreduce code from eclipse before run it in 2 or 3 modes.
This step by step guide to run application in local mode helps you a lot to debug your application.
Hope it helps!
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With