Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

In YARN what is the difference between a managed and an unmanaged Application Manager

Tags:

hadoop-yarn

I'm experimenting with the Distributed Shell example in YARN 2.2 and am hoping that someone can clarify what the difference between a managed and and an un-managed application manager is?

For example the following lines appear in the client code

// unmanaged AM
appContext.setUnmanagedAM(true);

but I am unable to find documentation explaining the difference this line makes to the execution behaviour.

Many thanks.

like image 568
Daniel Goodman Avatar asked Feb 19 '14 17:02

Daniel Goodman


People also ask

What is application Manager in yarn?

Yarn - Applications Manager (ASM) The ApplicationsManager is responsible for: accepting job-submissions, negotiating the first container for executing the application specific ApplicationMaster. restarting the ApplicationMaster container on failure.

How many applications Master in yarn?

YARN: Application Startup In YARN, there are at least three actors: the Job Submitter (the client) the Resource Manager (the master) the Node Manager (the slave)

What is the role of application Manager in Hadoop?

The ApplicationMaster is, in effect, an instance of a framework-specific library and is responsible for negotiating resources from the ResourceManager and working with the NodeManager(s) to execute and monitor the containers and their resource consumption.

What is the role of application master?

The Application Master is the process that coordinates the execution of an application in the cluster. Each application has its own unique Application Master that is tasked with negotiating resources (Containers) from the Resource Manager and working with the Node Managers to execute and monitor the tasks.


1 Answers

The setUnmanagedAM(true) is used for debugging purposes i.e. it runs an application manager in local mode and does not submit it to a cluster so it is easier to step into code and debug. You can see it in use in the hadoop-yarn-applications-unmanaged-am-launcher.jar that ships with yarn

like image 103
Arnon Rotem-Gal-Oz Avatar answered Oct 13 '22 00:10

Arnon Rotem-Gal-Oz