Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Hadoop and Amazon Web Services [closed]

I want to self-learn Hadoop and Amazon Web Services online. Are there any good university courses or tutorials on the web? I could find books on Amazon on Hadoop or AWS but I want something hands on to try out and learn.

P.S. I went through the Yahoo Hadoop tutorial which was very useful.

like image 339
Sairam Sankaran Avatar asked Feb 25 '13 20:02

Sairam Sankaran


People also ask

Is Hadoop available on AWS?

Running Hadoop on AWS Amazon EMR is a managed service that lets you process and analyze large datasets using the latest versions of big data processing frameworks such as Apache Hadoop, Spark, HBase, and Presto on fully customizable clusters. Easy to use: You can launch an Amazon EMR cluster in minutes.

Is AWS and Hadoop same?

Hadoop 101 As opposed to AWS EMR, which is a cloud platform, Hadoop is a data storage and analytics program developed by Apache. You can think of it this way: if AWS EMR is an entire car, then Hadoop is akin to the engine.

Is Hadoop still used?

After all, a large number of Internet companies still use Apache Hadoop (at their scale, only the open-source version can be used).

Does AWS S3 use Hadoop?

We're pleased to announce that Amazon Simple Storage Service (Amazon S3) Access Points can now be used in Apache Hadoop 3.3. 2 and any framework consuming the S3A connector or relying on the Hadoop Distributed File System (such as Apache Spark, Apache Hive, Apache Pig, and Apache Flink).


1 Answers

For hadoop, there is an awesome talk on Hadoop's ecosystem on AWS and EMR by the AWS team : http://www.youtube.com/watch?v=hrRUAvKVfxw

Then there are a series of videos tutorial they have on EMR training:

  1. http://www.youtube.com/watch?v=RlKndm22bXw
  2. http://www.youtube.com/watch?v=y8YM2rAsAhY
  3. http://www.youtube.com/watch?v=cAZur5maWZE
  4. http://www.youtube.com/watch?v=yN0TPbj23dY
  5. http://www.youtube.com/watch?v=5lA93QzUny8
  6. http://www.youtube.com/watch?v=ZSu8N2PoVbM
  7. http://www.youtube.com/watch?v=06rz0h5-arw
  8. http://www.youtube.com/watch?v=o5D9dmZX9zo
  9. http://www.youtube.com/watch?v=1IUokcqDRcQ
  10. http://www.youtube.com/watch?v=5i20nf3Kyzg
  11. http://www.youtube.com/watch?v=y4z6RxWAvqs

Update: You can read this book as well : Learning Big Data with Amazon Elastic MapReduce

The Cloudera team supports deployment to AWS, and provide a whole range of documentation. Try searching for Cloudera and AWS on google, and read the documentation here.

like image 156
Amar Avatar answered Oct 21 '22 06:10

Amar