Server Dashboard

Pulse provides charts that offer deep insights into Pinot Server performance—covering JVM memory, CPU, garbage collection, threads, and system-level metrics like physical and swap memory.

There are other charts that track indexing failures, query throughput, ingestion delays, and Helix-ZooKeeper connectivity to help identify issues and ensure cluster reliability.

In the Pulse UI, navigate to the menu option and select Pinot > Server Dashboard. The metrics and charts appear on the screen for you to analyze.

Pinot Server Charts

ChartDescription
Memory: Heap Memory Usage

This chart shows the heap memory usage at different stages:

  • Heap_Memory_Init_Value: Initial heap memory requested by the JVM at startup.
  • Heap_Memory_Committed Value: Heap memory reserved by the OS and guaranteed for JVM use.
  • Heap_Memory_Used_Value: Actual heap memory consumed by live objects in the application.
  • Heap_Memory_Max_Value: Maximum heap memory allowed for the JVM to use.
Memory: Non-Heap Memory

This chart shows the heap memory usage at different stages:

  • Non_Heap_Memory_Init: Initial non-heap memory requested by the JVM at startup, including metaspace, code cache, and compressed class space.
  • Non_Heap_Memory_Committed: Memory reserved by the OS for JVM non-heap use, such as class metadata and compiled code.
  • Non_Heap_Memory_Used: Actual non-heap memory in use, reflecting actual consumption of metaspace, code cache, and class space.
  • Non_Heap_Memory_Max: Maximum non-heap memory allowed for the JVM to use.
Threading: Thread Count

This chart displays key thread metrics for the Pinot JVM process:

  • ThreadCount – Current number of live threads.
  • PeakThreadCount – Highest number of live threads observed since the JVM started (resets on restart).
  • TotalStartedThreadCount – Total threads ever created (including terminated ones); this value keeps increasing until the JVM restarts.
Operating System: CPU Load

This chart shows:

  • SystemCpuLoad – Recent CPU usage of the entire system, as reported by the operating system.
  • ProcessCpuLoad – Recent CPU usage of the Pinot JVM process, relative to the total available CPUs.
Operating System: Free Swap Space SizeShows the available free swap space (in bytes) on the host system, as observed by the Pinot Server’s JVM process.
Operating System: Free Physical Memory SizeShows the amount of free physical memory available on the host system running the Pinot Server.
GC: Collection Time

Shows the total time the JVM has spent in Garbage Collection (GC) for a specific collector.

  • G1 Young Generation (frequent short-lived collections)
  • G1 Old Generation (infrequent, long-lived collections)

These charts help assess JVM memory management efficiency.

GC: Collection Count

Shows the number of garbage collection (GC) events over time for both:

  • G1 Young Generation (frequent short-lived collections)
  • G1 Old Generation (infrequent, long-lived collections)

Tracks the frequency of GC events to help identify memory pressure and potential performance issues in the JVM.

Indexing FailuresShows the number of indexing operations that have failed during segment ingestion and processing.
Indexing Failures: RateShows the average indexing failure rate since the server started.
Helix Zookeeper Reconnects

Shows the number of times a Pinot server instance has reconnected to Apache Helix or ZooKeeper.

Helix is the cluster management library used by Pinot to coordinate nodes through ZooKeeper.

This Helix-reported metric reflects connection-level events between the Pinot server and the ZooKeeper ensemble.

Helix Zookeeper Reconnects: RateShows the average rate of ZooKeeper reconnects over different time windows (1 min, 5 min, 15 min, and overall), helping assess both short-term spikes and long-term connection stability.
Scheduling Timeout ExceptionsShows the number of times a query scheduling timed out on the Pinot Server.
Scheduling Timeout Exceptions: RateShows the rate of query timeout on a Pinot Server.
QueriesShows the number of incoming queries handled by the Pinot Server.
Queries: RateShows the rate of incoming queries handled by the Pinot Server.
LLC Partition ConsumingShows the number of Low-Level Consumer (LLC) partitions currently in the consuming state on a given server.
Document CountShows the count of documents ingested.
Realtime Ingestion Delay: MaxShows the maximum delay between event generation time and the time the event is ingested into Pinot.
Realtime Ingestion Delay: AverageShows the average delay between event generation time and the time the event is ingested into Pinot.
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard