Controller Dashboard

Pulse monitors Pinot's JVM performance and system health. You can track heap and non-heap memory usage, GC activity, CPU load, thread count, and disk/swap space.

There are other charts that show controller stability, leadership changes, and errors related to schema uploads and table operations, enabling effective troubleshooting and performance tuning.

In the Pulse UI, navigate to the menu option and select Pinot > Controller Dashboard. The metrics and charts appear on the screen for you to analyze.

Pinot Controller Charts

Metric	Description
Memory: Heap Memory Usage	This chart shows the heap memory usage at different stages: Heap_Memory_Init_Value: Initial heap memory requested by the JVM at startup. Heap_Memory_Committed Value: Heap memory reserved by the OS and guaranteed for JVM use. Heap_Memory_Used_Value: Current heap memory consumed by live objects in the application. Heap_Memory_Max_Value: Maximum heap memory allowed for the JVM to use.
Memory: Non-Heap Memory	This chart shows the heap memory usage at different stages: Non_Heap_Memory_Init: Initial non-heap memory requested by the JVM at startup, including metaspace, code cache, and compressed class space. Non_Heap_Memory_Committed: Memory reserved by the OS for JVM non-heap use, such as class metadata and compiled code. Non_Heap_Memory_Used: Current non-heap memory in use, reflecting actual consumption of metaspace, code cache, and class space. Non_Heap_Memory_Max: Maximum non-heap memory allowed for the JVM to use.
Threading: Thread Count	This chart displays key thread metrics for the Pinot JVM process: ThreadCount – Current number of live threads. PeakThreadCount – Highest number of live threads observed since the JVM started (resets on restart). TotalStartedThreadCount – Total threads ever created (including terminated ones); this value keeps increasing until the JVM restarts.
Operating System: CPU Load	This chart shows: SystemCpuLoad – Recent CPU usage of the entire system, as reported by the operating system. ProcessCpuLoad – Recent CPU usage of the Pinot JVM process, relative to the total available CPUs.
Operating System: Free Physical Space Size	Shows the amount of free physical memory available on the host system running the Pinot Broker.
Operating System: Free Swap Space Size	Shows the available free swap space (in bytes) on the host system, as observed by the Pinot Controller’s JVM process.
GC: Collection Time	Shows the total time the JVM has spent in Garbage Collection (GC) for a specific collector. G1 Young Generation (frequent short-lived collections) G1 Old Generation (infrequent, long-lived collections) These charts help assess JVM memory management efficiency.
GC: Collection Count	Shows the number of garbage collection (GC) events over time for both: G1 Young Generation (frequent short-lived collections) G1 Old Generation (infrequent, long-lived collections) Tracks the frequency of GC events to help identify memory pressure and potential performance issues in the JVM.
Leadership Change Without Callback	Shows how often the controller changed leadership without invoking the expected callback logic.
Leadership Change Without Callback: Mean Rate	Shows the average rate of leadership changes that occurred without triggering the expected callback logic, measured over the controller's entire uptime.
Broker Resource Validation Manager: Periodic Task Run	Shows how many times the periodic broker resource validation task has run since the controller started.
Schema Upload Error	Shows the number of schema upload failures since the controller started.
Schema Upload Error: Rates	Shows the rate of schema upload failures since the controller started.
Table Add Error	Shows the number of errors that occurred while adding new tables to the cluster since the controller started.
Table Add Error: Rates	Shows the rate of errors that occurred while adding new tables to the cluster since the controller started.
Table Update Error	Shows the number of errors that occurred while updating existing tables since the controller started.
Table Update Error: Rates	Shows the rate of errors that occurred while updating existing tables since the controller started.
Table Schema Update Error	Shows the number of errors that occurred while updating the schema for the existing tables.
Table Schema Update Error: Rates	Shows the rate of errors that occurred while updating the schema for the existing tables.

Last updated on

Was this page helpful?