Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to restart yarn on AWS EMR

I am using Hadoop 2.6.0 (emr-4.2.0 image). I have made some changes in yarn-site.xml and want to restart yarn to bring the changes into effect.

Is there a command using which I can do this?

like image 830
nish Avatar asked Jan 22 '16 18:01

nish


People also ask

Can we restart EMR cluster?

You must use the start command and not restart . The following fetches the status for hadoop-hdfs-namenode . You can use the status command to verify that the process has stopped or started.


1 Answers

Edit (10/26/2017): A more detailed Knowledge Center article on how to do this has been published here by AWS officially - https://aws.amazon.com/premiumsupport/knowledge-center/restart-service-emr/.

You can ssh into the master node of your EMR cluster and run -

"sudo /sbin/stop hadoop-yarn-resourcemanager" "sudo /sbin/start hadoop-yarn-resourcemanager" 

commands to restart the Yarn resource manager. EMR AMI 4.x.x uses upstart - /sbin/{start,stop,restart} are all symlinks to /sbin/initctl, which is part of upstart. See the initctl man page for more information.

Alternatively, you can follow the instructions here to propagate your changes to yarn-site.xml - yarn-change-configuration-on-yarn-site-xml

like image 180
annunarcist Avatar answered Sep 19 '22 17:09

annunarcist