About
A queue is a scheduler data structure that allows scheduler implementation to categorize apps into queue.
Articles Related
Properties
Queue definitions and properties such as capacity, ACLs can be changed, at runtime.
Capacity
Full
The utilization of the queue may become full (100% utilization) because the rate at which new jobs get submitted is higher than the rate at which the old jobs are completed.
The following image shows a joblauncher queue at 714.4% overused.
This is acceptable so long as there is still free capacity in the default queue to borrow from. However, when the cluster is fully utilized and the YARN memory is at 100% capacity, new jobs must wait, which causes timeouts on the client side (submit)
Management
Add
Administrators can add additional queues at runtime.
Delete
Queues cannot be deleted at runtime.
Stop
Administrators can stop queues at runtime. Existing applications continue to completion
If a queue is in STOPPED state, new applications cannot be submitted.
Start
A stopped queue can be started.
Info
yarn queue
List
- with the yarn cli
yarn top
Status
yarn queue -status <QueueName>
State or status can be:
- STOPPED - Existing applications continue to completion.
- …