Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Hadoop Map Reduce: Algorithms

Can someone point me to a good web site with good collection of Hadoop algorithms. For example, the most complex thing that I can do with Hadoop right now is Page Rank. Other than that, I can do trivial things like word counting and stuff.

I want to see a web site that show me other usage of hadoop.

like image 424
denniss Avatar asked Jul 27 '10 03:07

denniss


People also ask

Which algorithm is used in MapReduce?

Sorting. Sorting is one of the basic MapReduce algorithms to process and analyze data. MapReduce implements sorting algorithm to automatically sort the output key-value pairs from the mapper by their keys. Sorting methods are implemented in the mapper class itself.

How do Hadoop MapReduce works?

MapReduce facilitates concurrent processing by splitting petabytes of data into smaller chunks, and processing them in parallel on Hadoop commodity servers. In the end, it aggregates all the data from multiple servers to return a consolidated output back to the application.

Is Hadoop MapReduce?

MapReduce is a Hadoop framework used for writing applications that can process vast amounts of data on large clusters. It can also be called a programming model in which we can process large datasets across computer clusters. This application allows data to be stored in a distributed form.

What are the steps of MapReduce algorithm?

MapReduce program executes in three stages, namely map stage, shuffle stage, and reduce stage.


2 Answers

Here's quite a few machine learning algorithms. Here's academic papers that might be interesting. Finally here's a book on map reduce that looks interesting.

like image 194
Jay Askren Avatar answered Oct 25 '22 19:10

Jay Askren


Have a look at this overview: http://atbrox.com/2010/05/08/mapreduce-hadoop-algorithms-in-academic-papers-may-2010-update/

like image 39
Niels Basjes Avatar answered Oct 25 '22 17:10

Niels Basjes