Yarn - Resource Manager

1 - About

The ResourceManager is the central authority of the Yarn cluster. It has two main components:

3 - Access

3.1 - UI

See Yarn - Yarn UI (ResourceManager UI)

Conf: yarn.resourcemanager.webapp.address

3.2 - Rest API

3.3 - Application submissions

for application submissions. ie The address of the applications manager interface

3.3.1 - IPC

Conf: yarn.resourcemanager.address

  • 8032 – Default port number
  • 8050 – Default port number when you create your cluster using Ambari.

3.3.2 - HTTP

  • 8025 - conf yarn.resourcemanager.resource-tracker.address

3.4 - Scheduler

4 - Management

4.1 - Resource Reservation

YARN supports the notion of resource reservation via the ReservationSystem, a component that allows users to specify a profile of resources over-time and temporal constraints (e.g., deadlines), and reserve resources to ensure the predictable execution of important jobs.

4.2 - Restart

Restart is a feature that allow him to keep functioning across restarts and also makes the down-time invisible to end-users.

5 - Documentation / Reference


Data Science
Data Analysis
Statistics
Data Science
Linear Algebra Mathematics
Trigonometry

Powered by ComboStrap