Menu
Have any of you tried Hadoop? Can it be used without the distributed filesystem that goes with it, in a Share-nothing architecture? Would that make sense?
I'm also interested into any performance results you have...
421
Hadoop User Experience (HUE) is an open source interface which makes Apache Hadoop's use easier. It is a web-based application. It has a job designer for MapReduce, a file browser for HDFS, an Oozie application for making workflows and coordinators, an Impala, a shell, a Hive UI, and a group of Hadoop APIs.
Here are the skills required for Hadoop developer job: Familiarity with Hadoop ecosystem and its components: obviously, a must! Ability to write reliable, manageable, and high-performance code. Expertise knowledge of Hadoop HDFS, Hive, Pig, Flume and Sqoop.
How to get practical experience in Hadoop - Quora. Install Cloudera in your system or create aws account . Practise the MapReduce Jobs in python or java(like wordcount, max length word, max temp so on). create tables in hive and run the hivequery or pig scripting.
Yes, you can use Hadoop on a local filesystem by using file URIs instead of hdfs URIs in various places. I think a lot of the examples that come with Hadoop do this.
This is probably fine if you just want to learn how Hadoop works and the basic map-reduce paradigm, but you will need multiple machines and a distributed filesystem to get the real benefits of the scalability inherent in the architecture.
117
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
