Menu
I have deployed Hadoop 2.3 as a single node cluster . Since YARN allocates resources as a unit which is termed as a container , how would I know how many containers are running in my single node cluster (by looking at logs, console etc)? .
I could not find any way to determine that , could someone please guide me to see the number or containers that are being utilized and hopefully the total number of JVMs from there ?
Thanks in advance!
901
A Container grants rights to an application to use a specific amount of resources (memory, cpu etc.) on a specific host. The ApplicationMaster has to take the Container and present it to the NodeManager managing the host, on which the container was allocated, to use the resources for launching its tasks.
In simple terms, Container is a place where a YARN application is run. It is available in each node. Application Master negotiates container with the scheduler(one of the component of Resource Manager). Containers are launched by Node Manager.
Yarn container are a process space where a given task in isolation using resources from resources pool. It's the authority of the resource manager to assign any container to applications. The assign container has a unique customerID and is always on a single node.
If cluster is up and running you can see it on web app of cluster
http://<namenode_hostname>:8088/cluster
where port number can be configured in yarn-site with property following yarn.resourcemanager.webapp.address
The number of containers depends on resource (cpu,memory) availability.
Following document can give better understanding of container size and container numbers. Please refer
Determine YARN and MapReduce Memory Configuration Settings
152
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
