Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How do you use MapReduce/Hadoop? [closed]

I'm looking for some general information about how other people are using Hadoop or other MapReduce-like technologies. In general, I am curious to whether you are writing MR applications to process existing data sets (like web server log files), or are you writing applications that generate and process new data sets?

Edit: Follow-up Questions

(1) Do you ever execute a MR program against data generated by other MR programs?

(2) Do you ever need to modify existing data sets using MR?

(3) Do you ever share your data sets with other developers?

like image 738
apavlo Avatar asked Dec 01 '08 16:12

apavlo


2 Answers

Checkout the PowerdBy Hadoop wiki for examples of everything from Facebook to FOX News and how they are using it.

like image 75
Ryan Cox Avatar answered Oct 07 '22 01:10

Ryan Cox


I am analyzing existing data sets, in my case traces of programmer activity.

like image 30
Kent Beck Avatar answered Oct 07 '22 00:10

Kent Beck