Pulse Add-on Services

Pulse Add-on services are optional services to extend observability for specific Hadoop services.

You can choose which add-ons to deploy based on the Hadoop services in your environment and your monitoring needs.

These services are categorized by purpose, such as:

  • Connectors
  • Log Management
  • High Availability
  • Authentication and Access Control
  • Optimizer
  • Recommendation

This classification helps you understand the function of each service and deploy only those that are relevant to your setup.

Connectors

ServiceDescription
Acceldata SQL Analysis ServiceProvides Hive table-level analysis. The data is available after the fsimage is successfully loaded.
Core Connector

This service comprises two components: ad-connectors and ad-sparkstats.

  • ad-connectors: Processes and analyzes all Hive, Tez, and MapReduce queries, as well as YARN applications.
  • ad-sparkstats: Processes asd analyzes Spark data.
Impala ConnectorProcesses and analyzes Impala service data.
Oozie ConnectorProcesses and analyzes Oozie service data.
Ozone ConnectorProcesses and analyzes Ozone service data.
Druid AnalyzerProcesses and analyzes Druid service data. Runs on port 19090.
Kafka Connector (Both)Processes and analyzes Kafka service data.
Trino ConnectorProcesses and analyzes Trino service data.
Standalone ConnectorDeploys ad-connector as a standalone service.

Log Management

ServiceDescription
FSAnalytics V2ad-fsanalyticsv2-connector: Fetches and processes the FSImage, then pushes the data to ElasticSearch.
FS ElasticRuns FSAnalytics on a separate node and routes statistics or logs into a dedicated ElasticSearch instance.

Pulse UI High Availability (HA)

ServiceDescription
GraphQL HAEnables high availability (HA) for the Pulse UI.

Authentication and Access Control

ServiceDescription
LDAPIntegrates with the organization’s LDAP for user authentication and RBAC in Pulse UI.

Optimizer Services

ServiceDescription
Yarn OptimizerUsed for optimizing the YARN Cluster for resources.

Recommendation Services

ServiceDescription
Recommendation ServiceUsed for calculating recommendations for various Hadoop services for query recommendations.
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard