YARN Services

The YARN Services page displays memory and CPU utilization of YARN processes running on nodes in the cluster over a period of time.

The top panel displays the following metrics:

MetricDescription
Active Resource ManagersThe total number of active resource managers.
Live Node ManagersThe total number of live resource managers.

Charts in YARN Services

The following table provides the description of the charts in the YARN Services page:

Chart NameDescription
YARN RM ProcessThe active state of the YARN resource manager process.
YARN NM ProcessThe active state of the YARN node manager process.
RM Running ThreadsThe number of runnable threads in the resource manager.
NM Running ThreadsThe number of runnable threads in the node manager.
RM Waiting Threads

The number of threads waiting in the resource manager. metric You can observe the following metrics:

Threads waiting: The number of threads waiting to execute.

Threads Timed Waiting: The number of threads waiting for other threads to execute for up to a specified waiting time.

NM Waiting Threads

The number of threads waiting in the node manager. You can observe the following metrics:

Threads waiting: The number of threads waiting to execute.

Threads Timed Waiting: The number of threads waiting for other threads to execute for up to a specified waiting time.

CPU Usage Node ManagerThe rate of change of CPU utilization by the NodeManager.
CPU Usage Resource ManagerThe rate of change of CPU utilization by the ResourceManager.
Physical Memory Node ManagerThe amount of physical memory used by the NodeManager process running on a node aggregate shows mean usage by default.
Physical Memory Resource ManagerThe amount of physical memory used by Resource Manager process on a node.
Heap Memory Resource Manager

The amount of heap memory used by the resource manager. You can observe the following metrics:

Mem Heap Max:The maximum amount of heap memory available to use.

Mem Heap Committed: The amount of heap memory committed to use.

Mem Heap Used: The amount of heap memory used.

Heap Memory Node Manager

The amount of heap memory used by the node memory. You can observe the following metrics:

Mem Heap Max:The maximum amount of heap memory available to use.

Mem Heap Committed: The amount of heap memory committed to use.

Mem Heap Used: The amount of heap memory used.

Resource Allocation Trend

This chart displays the resource trend analysis on the hosts with the following metrics:

  • Allocated Containers: The number of containers allocated to the resources by the resource manager.
  • Allocated Memory: The amount of memory allocated to resources by the resource manager (in GB).
  • Allocated Cores: The number of VCores allocated to resources by the resource manager.
  • Available Memory: The amount of memory available to use.
  • Available Cores: The number of VCores available to use.
Container Summary Trend

This chart displays the summary trend of usage of containers on different hosts with the following metrics:

  • Containers Completed: The number of containers that completed executing.
  • Containers Running: The number of containers currently running.
  • Containers Failed: The number of containers that failed execution.
  • Containers Killed: The number of containers that were terminated.
  • Containers Launched: The number of containers launched.

Dashplots style is reflected on the dashboards. Ensure to install Dashplots to view the diagrams in the dashboard.

The charts display aggregated values of the metrics. To view individual usage of the host, perform the following:

  1. Click Show Individuals in the chart. The drop-down menu is displayed.
  2. Select the host from the host drop-down list.
  3. Select the metric from the metrics drop-down list. The required data is displayed.
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard