About
The Yarn (ie MapReduce) framework consists of three topology level:
- federation of independent cluster
- application (that the Yarn cluster runs)
Articles Related
Level
Federation
Federation allow multiple independent clusters to be used together for very large jobs, or for tenants who have capacity across all of them.
Cluster
On a cluster level, Yarn consists of:
- a single global leader process ResourceManager,
- a per-node (worker|agent) NodeManager ,
More … see Yarn - Cluster
Application
On a application level, Yarn consists of:
- a per-application ApplicationMaster
- a per-application Container running on a NodeManager