Node Details

The Node Details page enables you to get further metrics details about nodes, such as the applications running, the number of containers used, total allocated memory, etc., and charts of those metrics.

  1. Log in to the Pulse UI. On the Home page, click on Overview.
  2. On the Nodes page, click on Hostname.

The Hosts manage and run multiple nodes.

The Node details page provides the following functionalities:

FunctionalityDescription
Summary PanelThis panel provides a node's metrics such as CPU and Memory Usage, IO Usage, Network Usage, Disk Usage, etc.
Service Status

This service status icon denotes the status of the services running on the node.

A notification of 1 indicates that one service is down on that node. Click the icon to know which service is down.

TimestampChoose an option to select a time period (For example, Today, Last 12 hours, Last 3 Months, etc.) or choose a “custom date and time” of your choice and click Apply.
Refresh the Status

Click the ⏵ (Play) and ⏸ (Pause) buttons at the top left of the page, to toggle between play and pause respectively.

Click the Play button to refresh the cluster status every ten seconds and the Pause button to temporarily stop the refresh.

ChartsThis Charts functionality provides a graphical representation of the node’s metrics.

Summary Panel

The summary panel provides the following metrics with details.

MetricDescription
Up TimeThe time that the node is available and running.
CPU'sThe number of CPUs in the node.
Total MemoryThe total memory allocated to the node.
Memory Used %The amount of memory used (in %).
CPU Used %The amount of CPU used (in %).
Disk Used %The amount of Disk used (in %).
ApplicationsThe number of applications running on the node.
ContainersThe number of containers used in the node.

Charts

You can monitor the following metrics charts on the Nodes details page.

ChartDescription
CPU UsageDisplays the amount of CPU utilized by the node.
Memory Usage

Displays the amount of Memory utilized by the node.

You can view the usage of the following memory types:

  • Used
  • Buffered
  • Cached
  • Free
IO Usage

The IO Usage charts describe the number of input bytes read and the number of output bytes written to a node. The following IO metrics are displayed:

  • I/O Ops: The input/output operations per second. This chart displays the data for Read IOPS and Write IOPS.
  • I/O Time: The time utilized by input/output operations. This chart displays the Read Time and Write Time (in ms) of I/O operations in a node.
  • I/O Bytes: The size of I/O operations. This chart displays the size of incoming and outgoing operations in the form of Read Bytes and Write Bytes.
  • I/O Request Time: The time taken by I/O requests waiting in queue to execute.

Note: Click Show Per Mount Usage to view I/O usage on every mount in the node.

Network Usage per Second

This chart displays the network throughput measured for every second. You can monitor the following network statistics:

  • Sent Bytes
  • Received Bytes

Note To view individual network usage statistics of processes in the node, click Show Individual. By default, the aggregated value is displayed.

Disk UsageThis chart displays the amount of disk used by the node in directories. The value is displayed in %. Hover the scale to view the disk usage.
Hadoop Application CPU and Memory UsageThis tile displays the top five memory-intensive and CPU-intensive processes running on a node, at the top and the charts display the amount of memory and CPU utilized by the processes in the node (in MB).
Yarn Container Metrics

This chart displays the launch duration of containers.

  • Avg Launch Duration Time
  • Running Container
JVM GC Count

The chart displays the amount of GC memory used based on the following metrics:

  • Resource Manager
  • Data Node
  • Zookeeper
  • Kafka
  • Hive Metastore
JVM GC Time

The chart displays the GC time based on the following metrics:

  • Resource Manager
  • Data Node
  • Zookeeper
  • Kafka
  • Hive Metastore
Error & Fatal Logs

Error & Fatal Logs is a table that displays all the errors that have occurred. It displays the Log Time and Message about the error. The Error & Fatal Logs tile displays the logs of any errors or unexpected behavior on the node. The table stores the following column details:

  • Log Time: The time at which the error was reported in the log.
  • Source: The origin or entity where the error or event was triggered.
  • Service: The specific service or application that encountered the error.
  • Host: The system where the service is running.
  • Yarn App ID: The identifier for the application in Hadoop YARN
  • Container ID: The unique identifier for the container running the application in YARN.

Note Click the log icon to view all Logs.

Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard