Yarn - Resource Manager

About

The ResourceManager is the central authority of the Yarn cluster. It has two main components:

Access

UI

See Yarn - Yarn UI (ResourceManager UI)

Conf: yarn.resourcemanager.webapp.address

Rest API

Application submissions

for application submissions. ie The address of the applications manager interface

IPC

Conf: yarn.resourcemanager.address

  • 8032 – Default port number
  • 8050 – Default port number when you create your cluster using Ambari.

HTTP

  • 8025 - conf yarn.resourcemanager.resource-tracker.address

Scheduler

Management

Resource Reservation

YARN supports the notion of resource reservation via the ReservationSystem, a component that allows users to specify a profile of resources over-time and temporal constraints (e.g., deadlines), and reserve resources to ensure the predictable execution of important jobs.

Restart

Restart is a feature that allow him to keep functioning across restarts and also makes the down-time invisible to end-users.

Documentation / Reference


Powered by ComboStrap