Yarn - Cluster

About

On a cluster level, Yarn consists of:

• a single global leader process (the central authority): ResourceManager,
• a per-node (worker|agent) NodeManager ,

Articles Related

Components

ResourceManager

The ResourceManager is the (head|leader) process that arbitrates resources among all the applications in the system. (The Scheduler is part of the resource manager).

NodeManager

The NodeManager (Resource manager agent) is responsible for:

• containers,
• monitoring their resource usage (cpu, memory, disk, network)
• and reporting the same to the ResourceManager/Scheduler.