Configure Impala Agent

The ad-impala Agent collects and queries the Impala profile and Impala coordinator metrics and sends them to ad-events as it maintains data persistence.

Impala Agent is enabled to collect the Impala Coordinator metrics.

You can install the Impala Agent on the Impala coordinator nodes. This Agent performs two independent collection tasks and sends the metrics to ad-events (NATs).

1. Profile Log Daemon

   • Tails and parses Impala profile logs
   • Emits COMPLETED events
   • Includes:
     • query_id
     • state = COMPLETED
     • timestamps
     • profile metrics

2. Inflight Queries Poller

   • Periodically polls /inflight-queries
   • Emits RUNNING events
   • Includes:
     • query_id
     • state = RUNNING
     • snapshot timestamp
     • partial metrics

Configuration

Ensure the following environment variables are set to true in the override.yml file available on the Pulse node.

This enables the Impala Agent functionality for collecting in-flight and completed Impala queries and ensures timely log monitoring for effective query visibility and troubleshooting.

base:

   enable_impala_agent_inflight_queries: "true"

   enable_impala_agent_completed_queries: "true"

   impala_agent: "true"

​

components:

   impala_agent_log_check_duration: "5"