Yarn - Cluster

About

On a cluster level, Yarn consists of:

Components

ResourceManager

The ResourceManager is the (head|leader) process that arbitrates resources among all the applications in the system. (The Scheduler is part of the resource manager).

NodeManager

The NodeManager (Resource manager agent) is responsible for:

  • monitoring their resource usage (cpu, memory, disk, network)
  • and reporting the same to the ResourceManager/Scheduler.

Powered by ComboStrap