Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Free Hadoop Cluster for Experiments [closed]

Tags:

hadoop

I would like to run hadoop program in a hadoop cluster to test times. Is any free Hadoop Cluster available for experiments with big data for Academic use?

like image 754
Eleftherios K. Avatar asked Aug 06 '13 11:08

Eleftherios K.


People also ask

Can I use Hadoop for free?

You can practice Hadoop, Spark and Hive for free in AWS. Hadoop is a framework for processing big data in a distributed environment.

How can I practice Hadoop at home?

Installing Hadoop Using VM: You can setup apache hadoop on a vm. You will find tons of videos or tutorials for it. Here is the link for one - https://www.edureka.co/blog/install-hadoop-single-node-hadoop-cluster Just follow along the instruction specified in the blog.

Can you run Hadoop on AWS?

Running Hadoop on AWS Amazon EMR is a managed service that lets you process and analyze large datasets using the latest versions of big data processing frameworks such as Apache Hadoop, Spark, HBase, and Presto on fully customizable clusters. Easy to use: You can launch an Amazon EMR cluster in minutes.

Is Hadoop open source?

Apache Hadoop is an open source software platform for distributed storage and distributed processing of very large data sets on computer clusters built from commodity hardware. Hadoop services provide for data storage, data processing, data access, data governance, security, and operations.


2 Answers

I doubt if there is something which is 100% free. One feasible way could be to use Amazon EC2 ready to use Hadoop cluster. It's not free but cheap enough to get your hands dirty. And if you don't want to pay anything, you could probably use Cloudera's VM and create a cluster using VMs on your machine. That would be a lot more convenient and cheaper as well.

HTH

like image 129
Tariq Avatar answered Sep 19 '22 01:09

Tariq


Actually, there is a free cluster for Greek academics (I assume you are Greek), provided by GRNET, in case you haven't found it already. I have been using it for over two months:

https://okeanos.grnet.gr/home/

However, you'll probably have to setup everything by yourself, since I don't believe that there is a public image with hadoop.

UPDATE (for future reference): It seems that there is now an easy wizard-like way to set up a hadoop cluster, too.

like image 20
vefthym Avatar answered Sep 18 '22 01:09

vefthym