Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to stop EMR Cluster without terminating it?

I know it is possible to stop individual EC2 instances, but what about the EMR cluster?

If I stop all EC2 instances comprising EMR cluster, would I still be billed?

like image 219
Jessa Avatar asked Jan 03 '16 23:01

Jessa


People also ask

How do you automatically close EMR cluster?

Open the Amazon EMR console at https://console.aws.amazon.com/elasticmapreduce/ . Choose Create cluster. Under Hardware configuration, select Auto-termination. Specify the number of idle hours and minutes after which the cluster should auto-terminate.


1 Answers

At this time there is not a way to STOP and EMR cluster in the same sense you can with EC2 instances. The EMR cluster uses instance-store volumes and the EC2 start/stop feature relies on the use of EBS volumes which are not appropriate for high-performance, low-latency HDFS utilization.

The best way to simulate this behavior is to store the data in S3 and then just ingest as a start up step of the cluster then save back to S3 when done.

like image 106
m.aibin Avatar answered Sep 24 '22 12:09

m.aibin