HBase

HBase Dashboard

HBase integration in Pulse is a distributed column-oriented database that stores huge amounts of data that can be accessed in a random manner. It also provides random real-time read/write access to data in the Hadoop File System.

The HBase Dashboard provides you with the basic statistics about an HBase cluster.

The default time range is Last 24 hrs. To view metrics for a custom date range, click the Timeframe icon in the top-right corner of the page and select the required time frame and timezone.

Cluster

The following table describes the Cluster tile:

MetricsDescription
Num Region ServersThe total number of region servers in the cluster. To view details of the region servers in the HBase Regions page, click on Num Region Servers.
Region Servers DeadThe total number of region servers that are dead in the cluster. To view details of the dead servers in the Nodes page, click on Region Servers Dead.
Master StatusThe state of the HBase Master in the cluster, whether it is running or stopped.
Cluster RequestsThe total number of requests in the cluster.
SizeThe size of the cluster, in GB.
Req Rate/SecThe total number of requests per second.
Read CountThe total number of reads completed in the cluster.
Write CountThe total number of writes completed in the cluster.

Region

The following table describes the Region tile:

MetricDescription
Num RegionsThe number of regions in the cluster.
Regions Over ThresholdThe number of regions in transition state for longer than 1 minute in the cluster.
Regions in TransitionThe number of regions in transition in the cluster.
WAL File CountThe number of Write-Ahead-Log files in the cluster.
WAL File SizeThe total files size of Write-Ahead-Log in the cluster.
Store File CountThe total number of store files in the cluster.
Store File SizeThe total size of store files in the cluster.
Files Local %Percentage of files served from the local Data Node for the region server in the cluster.

Region Compaction

The following table describes the Region Compaction tile:

MetricDescription
Avg Compaction TimeThe average time taken to process compaction operations in the region server.
Compaction Queue SizeThe total number of compaction operations waiting to be processed in the region server.
Num Compaction RunningThe total number of compactions being processed in the region server.

Table

The following table describes the Table tile:

MetricDescription
# TablesThe total number of tables in the cluster.
Table Size [Min, Max]The total size of the data for the table.
Table Request [Min, Max]The total number of read and write requests per second for the table.

Cache Metrics

The following table describes the Cache Metrics tile:

MetricsDescription
Hit RatioThe block cache hit ratio (0 to 100%) from Region Server.
Avg Flush TimeThe average latency for Flush Operation for the tables.
Flush Queue SizeThe size of the output file for Flush Operations for the tables.

Region Stats

The following table describes the Regions Stats tile:

MetricsDescription
OnlineThe number of regions online.
Offline

The number of regions offline.

Note You cannot read and write on Offline regions. If you disable any table, all regions in that table will move to offline state.

Failed

The number of failed regions

Note All regions that are not in open state due to region metadata corruption or failure in the region server are considered as failed regions.

SplitThe number of split regions. Regions split when they reach the configured threshold.
OthersThe number of regions that are not in the above categories.
TotalThe sum of all the metrics in the Region Stats tile.

Charts on the HBase Dashboard

The following table describes all the charts displayed in the HBase Dashboard.

Chart NameDescription
Region & Table Distribution

Displays the following charts:

  • Region Count Distribution per Host: Displays the number of regions per host.
  • Table Count Distribution per Host: Displays the number of tables per host.
Cluster JVM Usage (95th percentile)

Region server Heap plays a critical role in holding Hbase Region’s memstore and high heap utilization, can cause frequent flush which can impact write latencies directly as it involves disk i/o.

Click Show Individual to view individual JVM Usage metrics in the region server.

Click Show Aggregated to view a consolidated chart of all JVM Usage metrics in the HBase cluster.

Request Count

Request Count chart is a time series chart that displays the number of requests(reads and writes) sent by all the regions servers at a particular time.

Click Show Individual to view individual server region request count in the region server.

Click Show Aggregated to view a consolidated chart of all request counts for all region servers in the HBase cluster.

RPC Count

RPC Count chart is a time series chart that displays the count of RPC at a particular time.

Click Show Individual to view individual server region request count in the region server.

Click Show Aggregated to view a consolidated chart of all request counts for all region servers in the HBase cluster.

Region Latency Timeline (95th percentile)

It is a time series chart that displays the time taken by HBase region servers to process your request. Click the down arrow key to select the following Request Type:

  1. Get: Displays a time series chart with the time taken by all region servers to read data by using the primary key
  2. ScanTime: Displays a time series chart displaying the time taken by all region servers to read data without using a WHERE condition.
  3. Append: Displays a time series chart displaying the time taken to write requests.
  4. Delete: Displays a time series chart displaying the time taken by all regions servers to delete a read or write request.
Region Load

It is a histogram chart displaying the read and write request count for all region servers in the cluster. Click the SortBy to select the following request count:

  1. Reads
  2. Writes
Region Latency-95th Percentile

It is a histogram chart displaying the the latency time taken by HBase region servers to process your request. Click the down arrow key to select the following Request Type:

  1. Get: Displays the time taken by all region servers to read data by using the primary key
  2. ScanTime: Displays the time taken by all region servers to read data without using a WHERE condition.
  3. Append: Displays the time taken to write requests.
  4. Delete: Displays the time taken by all regions servers to delete a read or write request.
ConnectionsIt is a bar chart displaying the number of open connections in a region server.
Request HandlersIt is bar chart displaying the number of request handlers in a region server.
Compaction MetricsIt is a multi-series line chart that shows the number of compactions run as well as the duration of the compaction.
RPC Time & Process Time - 95th PercentileIt is a histogram chart displaying the processing time and queue time of a region server.

Compaction Region Server

The following table describes the components of the Compaction Region Server metrics.

MetricDescription
Region ServerThe name or ID of the region server.
Compacting KVsThe number of key values in compacting state.
Compacted KVsThe number of key values that have finished compacting.
Compaction ProgressThe compaction progress, expressed as a percentage.

Note Click on any row to view the details in HBase Region Server Details page.

Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard