Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to restart Spark service in EMR after changing conf settings?

I am using EMR-5.9.0 and after changing some configuration files I want to restart the service to see the effect. How can I achieve this?

I tried to find the name of the service using initctl list, as I saw in other answers but no luck...

like image 565
Dimitris Poulopoulos Avatar asked Oct 12 '17 12:10

Dimitris Poulopoulos


1 Answers

Since Spark runs as an application on Hadoop Yarn you can try

 sudo stop hadoop-yarn-resourcemanager  
 sudo start hadoop-yarn-resourcemanager  

If you meant the Spark History Server then you can use

 sudo stop spark-history-server  
 sudo start spark-history-server  

Checking the status of the services can be done using

sudo status hadoop-yarn-resourcemanager
sudo status spark-history-server

EDIT:
As hadooper suggested, for more recent versions of EMR use

sudo systemctl stop/start/status hadoop-yarn-resourcemanager
like image 159
J00MZ Avatar answered Oct 11 '22 17:10

J00MZ