Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Yarn autorestart failed application

Tags:

hadoop-yarn

We've a streaming application running on yarn and we would like to ensure that is up running 24/7.

Is there a way to tell yarn to automatically restart a specific application on failure?

like image 966
Aminouvic Avatar asked Sep 29 '22 10:09

Aminouvic


2 Answers

Have you tried Hadoop Yarn - ResourceManger Restart

Yarn will restart the driver if this fails with the feature “yarn.resourcemanager.am.max-attempts”, and by default it’s 2.

like image 144
Tao Li Avatar answered Dec 31 '22 21:12

Tao Li


You can specify the max attempt of a specific application using ApplicationSubmissionContext::setMaxAppAttempts Here is the document for this function

like image 36
hjk41 Avatar answered Dec 31 '22 20:12

hjk41