Pinot

Apache Pinot is a real-time OLAP datastore built for ultra-fast analytics on large-scale streaming and batch data. It powers dashboards, anomaly detection, and operational insights.

Pinot Monitoring with Pulse

Pulse offers real-time observability into Pinot’s Controller, Server, and Broker through dashboards with focused metrics.

• Controller: Track leadership changes, schema errors, and table update issues to ensure metadata accuracy.
• Server: Monitor JVM health, system memory, GC, ingestion delays, document counts, and ZooKeeper reconnects for ingestion and node stability.
• Broker: Analyze query rates, scatter-gather patterns, errors, and response times to optimize query handling.

Key Benefits

Some of the benefits of using Pulse include:

• Unified Monitoring: Get visibility into all Pinot components from a single interface.
• Faster Troubleshooting: Quickly detect and isolate ingestion, memory, or query issues.
• Performance Tuning: Optimize JVM, GC, and query behavior using real-time metrics.
• Proactive Health Checks: Monitor cluster state to prevent downtime and instability.
• Alert Integration: Set alerts on key metrics for timely, automated responses.

Pinot Logs and Node Health

In the Pulse UI, navigate to the Logs and Nodes pages to monitor Pinot operations and infrastructure:

• Logs Page: View detailed Pinot logs (info, warning, error) to troubleshoot failures and track service behavior. For more information, see Logs.
• Nodes Page: View real-time metrics like CPU, memory, and disk usage, and application status for each node running Pinot. For more information, see Nodes.

These pages provide operational insights to ensure performance, identify degradation, and maintain uptime.

Pinot Alerts

Pulse continuously monitors the health of the Pinot service and raises alerts when services become unavailable. Also, you can create custom alerts for the metrics you want to monitor closely with specific conditions. For more information, see Monitor Pinot with Pulse Alerts.

Pinot Metrics in Pulse UI

In the Pulse UI, select Pinot from the left navigation panel. Key metrics and charts appear instantly. This gives you a complete view of service behavior.

Pulse shows Pinot metrics through intuitive dashboards and charts that track Controller, Server, and Broker performance.

• Broker Dashboard: Monitors query activity, system usage, and ingestion health for Pinot Brokers.
• Controller Dashboard: Tracks metadata operations, leadership status, and schema/table errors.
• Server Dashboard: Analyzes ingestion performance, resource usage, and document-level metrics.