Take a Look at Pulse through the Latest Version!

Pulse v3.7.1

25th June, 2025

Every Pulse release is cumulative, incorporating all features and fixes from previous releases. The Pulse 3.7.1 release also includes the scope of the recently released 3.6.5 and 3.6.6 versions.

Kafka 3

• Pulse Kafka 3 supports scram-based authentication.

Hive Hook

• Introduced an updated Hive hook jar (version 1.2.3) with minor improvements. It ensures that jobs continue to run without failure even if the ad-events service is unavailable.

Pulse v3.7.0

24th April, 2025

Monitors

• Kafka 3 on KRaft or Zookeeper Observability: Added monitoring support for Kafka 3 on KRaft or Zookeeper, including JMX metrics for KRaft Controller.
• HDFS Small File Size Configuration: Introduced configurable small file size threshold using hdfs.analytics.file.size.
• Spark v3 on YARN: Added support for Spark v3 on YARN in ODP 3.3.6.0-1.
• NiFi Registry Logging: Enabled automated logging of NiFi Registry into the Pulse Server.

YARN Optimizer

• Static Queue Optimization: Added support for optimizing static queues in YARN capacity schedulers.

Dashplots

• Slack Integration for Dashplot Reports: Dashplot reports can now be sent via Slack.
• Highlighting in Custom Dashplots: Added support to highlight data in Dashplots based on values and conditions.

APIs

• API for Pulse Version: New API introduced to fetch Pulse version details.

Learn More

Pulse v3.6.7

24th July, 2025

This release includes only resolved issues.

Pulse v3.6.6

10th June, 2025

HDFS

• Pulse supports processing larger DS and NS quota values up to exabytes (19 digits), enhancing its ability to handle high-volume data workloads.

Pulse v3.6.5

1st June, 2025

Alerts

• Added alerting support for the namenode_topuser_opcounts_count metric to track high RPC activity per user and call type.

Dashplots

• Custom Dashplots now support conditional row/column highlighting with configurable color codes.
• Added visualization for HDFS DS and NS quota usage in Path Analysis charts.

Impala

• Added Statistics Corrupt and Statistics Missing metrics to the Impala Queries pages.

Encryption Support

• Added support for encrypting LDAP bind passwords with the encryptedPassword=true parameter and updating them in configuration files.
• Added support for encrypting SSL passphrases for GraphQL and updating them in configuration files.

Pulse v3.6.4

4th April, 2025

This release includes only resolved issues.

Pulse v3.6.3

25th March, 2025

Dashplots

• Custom Dashboards: The Storage I/O Metrics and HDFS I/O Metrics dashboards are now available by default on the Dashplots page.

Pulse v3.6.2

20th March, 2025

Impala

• Optimized performance for the Impala Connector.

Pulse v3.6.1

18th March, 2025

Enhancements

• YARN now honors the configured Node memory limit in Ambari to reduce OOM risks.
• Logs page now supports page number editing to jump directly to the specific page and first/last page navigation icons.
• Pulse is certified for JDK-11, bringing better performance and compatibility.
• Support for Spark 3.5.2 in standalone environments is now available.

Pulse v3.6.0

February 21, 2025

New Pulse Alerts

• The new alerts have been introduced to enhance system monitoring and ensure optimal performance:
• HDFS Path Usage Alert
• Kafka Read and Write Skewness Alert
• NiFi Connection Status Alert
• Queued Flowfile Alert
• The Pulse Alerts now support regex matching in filters.

Reports and Dashboard

• Introduced a capability to generate and download a Pulse Stock Report to verify the number of applications running, their status, the hosts on which they are running, and other relevant details.
• Introduced the NiFi API Summary Dashboard, which distinguishes between external and internal API requests.

Actions and Executions

• Introduced the Yarn Application Auto-Killer action, which automatically terminates Yarn applications that exceed predefined conditions.
• Enhanced Action Execution Tracking for killed queries by highlighting them in red, enabling detailed insights and easy navigation to related components.
• The “Move Pending App Queue” action now supports multiple destination queues, intelligently selecting the one with the most available resources while ensuring job submission permissions.
• Enables cleanup of HDFS and local files by configuring the last access date (atime) in the respective actions, streamlining file management.
• Introduced Cron Generator on Actions to simplify scheduling and managing tasks with precise time intervals.
• Several new parameters have been added to the HDFS Balancer Playbook, enhancing its customizability and scalability.

Notification

• Enables to configure multiple Xmatters groups and keys using the accelo config alerts notifications command.
• Enhanced Quantum Notification details by including environment or cluster information in the ticket when an alert is raised.

Security

• Enhanced security by masking the spark.authenticate.secret in the Pulse UI > Spark > Jobs Compare Metrics section.

Visualization and User Experience

• Enables to create dashplot or visualization for Impala Kill Queries and YARN Kill Applications, providing deeper insights into query termination patterns.
• Enhanced the "View in Context" option in Logs UI for a more comprehensive and seamless log viewing experience.

Other Enhancements

• Optimized the ad-alerts component with various mechanisms to enhance the overall stability and performance of the system.
• Supports downloading over 10K rows of data in CSV or XLSX format for modules like Tez Queries, Spark Jobs, Impala Queries, and Yarn Application Explorer without RM Live.
• Displays the total driver runtime for Spark jobs in the Spark Jobs Timeline section, enhancing visibility into driver execution runtime.
• Introduced the Queue-Level Job Details to display the top applications utilizing the most queue capacity within the selected interval.

Learn More

Pulse v3.5.3

30th January, 2025

Enhancements

• The utiliseFQDNYarnOptimise flag has been introduced in the configuration file of Yarn App Metrics.

Pulse v3.5.2

14 January, 2025

Enhancements

• Pulse now allows you to override specific information in the default-endpoints.yml file.

New Changes

• Upgraded the Ubuntu Base Image of the containers (Logstash, Elastic, and MongoDB) from version 23.04 to 24.04

Pulse v3.5.1

22nd November, 2024

Security Enhancements

• This release strengthens security on the Pulse Agent by enforcing strict file ownership and permissions within the directory.
• This release enhances security by removing the default plain text passwords from the template or configuration files to avoid access to unauthorized users.

Other Enhancements

• This release supports Yarn Optimizer on the CDP distribution.
• This release splits the Agents summary into individual Agents Summary.
• Improved the Yarn Optimization workflow by allowing you to configure the OverCommit Connection Timeout Value to the pipeline.

New Changes

• Upgraded the Postgres version from 12.X to 16.4.

Pulse v3.5.0

31st October, 2024

New and Enhanced Observability

• Pulse provides real-time observability capabilities for the following services:
  • Airflow
  • Kafka Connect
  • Kafka Cruise Control
  • Schema Registry
  • NiFi Registry
• Pulse now enhances the real-time observability capabilities for the NiFi and Impala services.

New Capabilities

• Introduced the Yarn Optimizer capability designed to enhance the performance of Yarn Clusters by optimizing the allocation of memory for yarn jobs, leading to a significant performance improvement.
• Introduced the Auditing capability to show the Agent and Pulse statistics such as hosts where the Agent status is down, page login activity, the most viewed pages of Pulse, etc.
• Pulse collects the Impala coordinator metrics to create dashboards and alerts.
• Introduced the new action runbooks such as Perform HDFS Non Admin Operations, HDFS Top 10 Directories, and Kerberos to automate tasks.

Enhancements

• Pulse supports notifications via the Big Panda notification channel.
• Enhanced the HDFS Filtering Records Capability to filter files and folders.
• The Actions Service workflow has been improved.

New Changes

• The new steps are available to deploy Playbooks using the command: accelo deploy playbooks.

Learn More

Pulse v3.4.5

29th October 2024

Enhancements

• Enhanced Pulse Agent Security – Restricts access to /opt/pulse files for improved security.
• Secured Template Files – Removes default plain-text passwords to prevent unauthorized access.
• Yarn Optimizer Support for CDP – Enables port configuration for Yarn Optimizer on the CDP distribution.
• Improved Yarn OverCommit Timeout Handling – Ensures stability by reverting memory if optimization fails.

Pulse v3.4.4

11th October 2024

This release includes only resolved issues.

Pulse v3.4.3

27th August 2024

Enhancements

• Standalone Pulse Add-ons Deployment – Deploy Ad-alerts, Ad-notifications, and Ad-director on standalone nodes for faster processing.
• Total Directory Size in HDFS Explorer – View the total size of the current directory dynamically on the HDFS > File Explorer page.
• Multi-KDC Multi-Node Deployment Support – Enables deployment of ad-connectors in GraphQL across multiple KDCs and nodes.
• Executor Placement Strategy for Yarn Optimizer – Distributes workloads based on free memory, reducing allocation skew in Yarn scheduling.
• Queue Capacity Strategy for Yarn Optimizer – Triggers overallocation only when Yarn queues are heavily loaded or memory is low.
• Optimized Yarn Optimization Calculation – Excludes removed or unhealthy nodes from Yarn Optimization to enhance accuracy.

Pulse v3.4.2

5th August 2024

This release includes only resolved issues.

Pulse v3.4.1

5th July 2024

Enhancements

• Upgraded HDFS File Explorer – Introduces infinite scrolling and batch data retrieval for seamless browsing.
• Enhanced Visibility Controls – Adds a toggle to reveal hidden or empty folders in the file system.

Pulse v3.4.0

18th June 2024

New Features

• (Beta) Introduced Yarn Optimizer – Optimizes memory usage on the Yarn cluster for better performance.
• Pulse on Kubernetes – Enables deployment on Kubernetes (v1.26+), simplifying orchestration.

Enhancements

• Pulse provides real-time observability capabilities for the following services:
  • Kafka Mirror Maker
  • Hadoop Ozone
  • Apache Druid
• Improved Actions Service Architecture – Enables OS-agnostic execution of actions without SSH dependency.
• Database Backup & Restore – Supports manual backups for MongoDB and VictoriaDB to ensure data recovery.
• New Notification Channels – Supports Quantum and xMatters for enhanced alerting.
• Elasticsearch Security Upgrade – Strengthens security to prevent information disclosure vulnerabilities.
• Enhanced Yarn Search Capability – Provides dynamic search suggestions and advanced filtering options.
• Improved Hive Visibility – Adds charts for Hive Metastore and Hive Server2 insights in the Tez Dashboard.
• Yarn NodeManager Metrics Alerts – Allows alert creation based on specific Yarn NodeManager metrics.
• Real-time Impala Runtime Metrics – Enables dynamic monitoring with enhanced performance insights.
• Automated Elastic Data Migration – Introduces accelo migrate command for seamless version upgrades.
• (Beta) New UI Facelift – Introduces a fresh, intuitive, and user-friendly interface.

Learn More

Pulse v3.3.24

10th July, 2024

This release includes only resolved issues.

Pulse v3.3.23

26th June, 2024

Enhancements

• Pulse now allows you to override specific information in the default-endpoints.yml file.

Pulse v3.3.10

5th June, 2024

This release includes only resolved issues.

Pulse v3.3.22

3rd June, 2024

Enhancements

• Enabled persistent configuration storage and seamless YARN RM node switching with MongoDB-backed algorithm behavior.

Pulse v3.3.9

27th May, 2024

Enhancements

• Enhanced ES Client Connection: GraphQL ES client now supports a comma-separated list of hosts without ports.
• Multi-Node Elasticsearch Support: Enabled multi-node Elasticsearch connectivity via updated configurations.
• New Oozie Schema Field: Added support for non-default Oozie database schemas in configuration files.
• Zookeeper Automation in NiFi: Automated Zookeeper Service configuration for NiFi Standalone via Pulse CLI.
• Pulse Java Services Performance: Improved MongoDB performance with a shared connection pool per service.

Pulse v3.3.21

15th May, 2024

Enhancements

• Added HDFS Utilization chart to display used, total storage capacity, and usage percentage.

Pulse v3.3.8

31st March, 2024

Enhancements

• xMatters Integration: Added xMatters notification channel for streamlined incident alerts and actions.
• New Stock Alert: Introduced YARN_LONG_RUNNING_JOB_WITH_FILTERS alert for monitoring long-duration Yarn jobs.
• MapReduce Query Trends Enhancement: Improved Query Trends chart performance by removing the DelayTime field.
• Table Usage Chart Update: Added a date picker to filter data by specific date ranges on the Databases page.

Pulse v3.3.20

25th March, 2024

Enhancements

• MongoDB Shard Cluster: Implemented shard clustering for improved data distribution, availability, and scalability.
• Query Count Chart Enhancement: Added a date picker to filter data by specific date ranges.
• Yarn Optimizer & Metrics Agent: Enhanced security and configuration for better deployment flexibility.
• Retention Logging: Config changes now logged in logs/accelo.log for better tracking.
• Tez Query Filtering: Enabled exclusion of specific connection verification queries for streamlined data collection.
• Storage Efficiency: Optimized yarn_yarnapp_lifecycle collection to reduce storage usage.

Pulse v3.3.7

9th March, 2024

This release includes only resolved issues.

Pulse v3.3.6

6th March, 2024

Enhancements

• Impala Queries Runbook (CDP): Introduced a runbook to terminate Impala queries based on predefined conditions.
• Kill Impala Queries by Query ID: Enabled termination of Impala queries using query IDs.
• IMPALA_NOT_ALLOWED_QUERIES Alert: Added an alert to detect and trigger actions on restricted Impala query patterns.

Pulse v3.3.5

7th February, 2024

Enhancements

• Enhanced Pulse Data Visualization: Improved Pulse with better stability, UI/UX, and data pipelines across key components like NiFi, Tez, Yarn, HDFS, and more.
• Advanced Spark Jobs Metrics: Upgraded Spark Jobs Metrics pipeline for improved efficiency and deeper job insights.
• Enhancements for ODP: Pulse v3.3.5 is now officially verified for Acceldata’s Open Data Platform (ODP).

Pulse v3.3.4

5th December, 2023

Enhancements

• Optimized Pulse UI Performance: Improved UI responsiveness for smoother navigation of long-duration data on the Spark Job Details page.

Pulse v3.3.3

23rd November, 2023

Enhancements

• Improved Spark Standalone Installation: Simplified integration of Spark Standalone clusters into Pulse with a consistent setup process.
• View Spark Standalone Application Logs: Added support to view Spark Standalone stage logs directly in the LogSearch page.
• Introduced Node Monitoring: Enabled infrastructure monitoring for individual nodes in Pulse.
• Introduced .Log Download Format: Logs can now be downloaded in .log format with extended context up to 200 lines.

Pulse v3.3.2

1st December, 2023

Enhancements

• Optimized Pulse UI Performance: Improved UI performance for smoother viewing of long-duration data in Yarn Chargeback Reports.
• Enhanced Container Security: Added support to enable readOnlyRootFSEnabled in accelo.yml for tighter container security.

Pulse v3.3.0

11th October, 2023

Tez

• View YARN Schedule Delay Time: Added a Delay Time widget on Tez Query Details to show YARN scheduling delays.
• Highlight Tables with Small Files: Identifies tables with small files across query pages with recommendations provided.
• View Long-Running Applications: Displays start and end times for long-running YARN apps in Application Explorer.
• Group Tez Queries by Queue: Added ability to group Tez and MapReduce queries by Queue in the Group By menu.
• New Improved DAG: Updated DAG visualization on Tez Query Details for better query execution insights.
• New Mapper Scan Duration Column: Shows min, max, and average vertex runtime for each query UID.
• View User Details: Added a Users column on Tez Table Details to list users accessing the tables.

Kafka

• View Consumer Rebalancing Data: Pulse now displays reasons for Kafka consumer rebalancing events for better visibility and troubleshooting.

Dashplots and Dashboards

• View Long-Running Containers: View and filter long-running containers that exceed threshold limits in Pulse.
• View Delta Files: Displays the count of delta files in tables on the Database Table Details page.
• Download Data from Dashboards: Enables downloading of chart data across YARN, Tez, Spark, and more.
• Configure Step Interval: Allows configuration of step intervals (minutes to weeks) for global time selection.
• Compare Chart Data: Compare chart data across multiple time periods, like current vs. previous month.

Alerts and Actions

• Pause Alert Notifications: Allows pausing of alert notifications for a defined time period to suppress noise.
• New Predefined Alerts: Introduced KAFKA_CONSUMER_GROUP_NO_CONSUMPTION and FS_SNAPSHOT_ANALYSIS_REPORT as new predefined alerts.

YARN

• New Queue Usage By User Chart: Added a bar graph on the YARN Summary page to show queue consumption per user.
• New Predefined Alerts: Introduced KAFKA_CONSUMER_GROUP_NO_CONSUMPTION and FS_SNAPSHOT_ANALYSIS_REPORT as new predefined alerts.

Databases

• New “Usage Count” Column: Shows how many times each column was used across all queries in the Column Details table.
• New “Hive Locks” Section: Displays real-time lock information on tables in the new Hive Locks section.
• New Columns and Widgets: Added detailed metrics like table size, file count, partitions, and columns to the Database Table Details view.

Learn More

Pulse v3.2.14

16 February, 2024

Enhancements

• Quantum Ticketing Integration: Integrated Pulse Alerts and Actions with Quantum Ticketing to auto-raise and clear incidents on the Quantum platform.

Pulse v3.2.0

9 May, 2023

Spark

• New Concurrent Jobs Section: Displays parallel applications running in the same queue on the Spark Job Details page.
• New Concurrent Jobs Section: Displays parallel applications running in the same queue on the Spark Job Details page.
• View Reason for Blank Job Details: Provides reasons and guidance when Spark Job Details page appears blank.
• Compare Any Two Spark Executions: Allows comparison between any two Spark job executions, not limited to the last 10.
• New DAG Chart: Visualizes the task execution flow in a DAG hierarchy on the Spark Job Details page.
• New Nodes Tab: Shows a list of unhealthy nodes associated with the application in the new Nodes tab.

Hive

• View Hive Audit Logs: Introduced a new page in Pulse to display Hive audit logs for enhanced auditability.

Alerts and Actions

• New Stock Alerts: Added HIVE_QUERIES_HDFS_BYTES_READ and HIVE_QUERIES_HDFS_BYTES_WRITTEN as new stock alerts.
• New Predefined Alerts: Introduced five predefined alerts including YARN_QUEUE_CAPACITY_USAGE and SPARK_EXECUTOR_NODE_BLACKLISTED.
• New Runbooks: Added runbooks to kill YARN apps exceeding thresholds and to move pending apps to different queues.
• Clear JIRA Status Automatically: Pulse now auto-sets JIRA ticket status to "Done" once the related incident is resolved.
• Pass Arguments from Alerts to Actions: Supports passing dynamic alert values to override default action configs for auto-actions.
• Export and Import Actions: Allows exporting actions as JSON and importing them across clusters with generic value mappings.

YARN

• New Queue Usage By User Chart: Added a bar chart on the YARN Capacity page to show per-user queue consumption.

HDFS

• New Last Modified File Count Chart (HDFS): Added a chart on the HDFS Analytics page to show file modification counts based on selected time periods.

Databases

• Filter Tables by Created Time (Databases): Enabled filtering of tables by creation time on the Database page for easier data exploration.

Dashplots and Dashboards

• Improved Search Bar: Enhanced search functionality with partial string match and NOT IN operator across multiple pages.
• Retain Visualization after Dashboard Deletion: Visualizations are retained if the Deep Delete checkbox is disabled when deleting a dashboard.
• New Filter Operators on Dashplot: Introduced equals, not equals, and NOT IN filter options on the Dashplot page.
• Reporting Feature: Added report scheduling for dashboards and visualizations with hourly to monthly frequencies via dashplots-studio.
• Pass Arguments from Alerts to Actions: Supports passing dynamic alert values to override default action configs for auto-actions.
• Download Visualization Data: Enabled downloading of data directly from visualizations on dashboards.

CLI

• Ability to Use Gauntlet: Introduced Gauntlet component for deleting Elasticsearch indices and purging/compacting MongoDB collections.
• New CLI Commands: Added accelo admin override, accelo config actions notifications, and accelo admin database migrate.
• New Option in Kerberos Config Command: Added -u flag to update Kerberos user in Pulse container files via CLI.
• Deploy Monitoring Stack: Introduced optional Pulse Monitoring Stack for enhanced system monitoring and observability.

Learn More

Pulse v3.1.2

6 June, 2023

Enhancements

• Support for Postgres Database: Pulse now supports using Postgres as the Hive metastore database.

Pulse v3.1.1

7 April, 2023

This release includes only resolved issues.

Pulse v3.1.0

1 April, 2023

Platform

• View Hive Audit Logs: Introduced a new page in Pulse to display Hive audit logs for enhanced auditability.

CLI

• New CLI Command for Missing Data: Added accelo report application to generate reports on missing data in Pulse.
• Additional FSAnalytics Variables: Introduced new configurable variables for the FSAnalytics container.
• New -a Option in Migrate Command: Enables multi-cluster migration automation using the -a flag in accelo migrate.
• Hyphen Support in Cluster Names: Cluster names can now include hyphens without breaking the reconfig cluster command.

Learn More

Pulse v3.0.0

25 November, 2022

Oozie

• Oozie Observability: Pulse now integrates with Oozie, providing dashboards and metrics for Bundle, Coordinator, and Workflow jobs.
• Enhanced Oozie Features: Added capabilities to map Oozie IDs, debug workflows, view job definitions, and manage SLA requirements.

Dashboard

• Dashboard Reporting Capabilities: Users can now schedule and email dashboards as attachments via Dashplots.
• New PULSE-AGENT-STATS Dashboard: Introduced a dashboard to monitor Pulse agent CPU, memory, state, and configuration updates.
• New HIVE-SERVICE-SUMMARY Dashboard: Added a new dashboard to visualize critical Hive service metrics.

Others

• Application Log Link in Alerts: Alerts now include a direct link to application logs in the Pulse Log section.
• Redirection to Consumer Group: Group Details button on Topic Details now redirects to the selected consumer group’s details.
• Type-in Search for Kafka Lag Chart: Kafka Dashboard's lag chart now supports time-based validation and type-in search.
• Improved Search Behavior: Enhanced search functionality for more precise and one-click results.
• Terminate Jobs by Memory/Vcore: New action added to kill YARN apps exceeding memory or Vcore thresholds.
• Color-coded HDFS Capacity Trend: HDFS usage trends now displayed with color-coding based on consumed capacity.

Learn More

Pulse v2.2.5

22 December, 2022

Enhancements

• Pulse is now improved with Tez and LLAP latency enhancements.

Pulse v2.2.1

27 July, 2022

Enhancements

• Hive Connection Count Alerts: Pulse now supports alerts for Hive Connection Count metrics.
• YARN Long-Running Job Alerts: New alert added for YARN jobs running beyond a defined threshold time.
• Zombie LLAP Daemon Alert: Alert introduced to detect and notify about Zombie Hive LLAP Daemon processes.

Pulse v2.2.0

20 July, 2022

YARN

• YARN Summary Tab: A new Yarn Summary tab provides key performance indicators for clusters and nodes.
• Live Queue Distribution: Real-time hierarchy and metric values now shown via the Live Queue Distribution graph.

Application Explorer

• YARN Application Detail Page: Clicking on App ID in YARN Application Explorer now opens detailed view of running applications.

Tez

• Query Execution Summary Chart: A new chart shows time taken at each execution stage on the Tez Query Details page.
• DAG Comparison: You can now compare two DAGs side-by-side to optimize query flows.
• New Tez Filters: Memory and VCore filters added to the Sankey chart in the Tez Dashboard.

Logs

• Download More Log Data: You can now download up to 2000 rows of log data as a spreadsheet from the Pulse Log page.

Kafka

• Total Replica Fetcher Lag Metric: A new metric on the Kafka Topic page shows the lag in messages per follower replica.

HBase

• New HBase Replication Metrics: Pulse now displays detailed replication metrics on the HBase Region Server listing page.
• Cluster-Level Compaction Trends: A new graph on the HBase Dashboard shows compaction trends across the cluster with adjustable view options.

Others

• Data Migration from InfluxDB to VictoriaMetrics: Pulse now supports migrating data from InfluxDB to VictoriaMetrics for improved performance and scalability.
• New Table Temp Chart in Hive File Analytics: A bar chart named Table Temp has been added to show file temperature based on modification dates.
• Password-Based SSH Authentication: Users can now create SSH keys with password-based authentication in the SSH tab under User Management.

Learn More

Pulse v2.1.1

08 June, 2022

This release includes only resolved issues.

Pulse v2.1.0

28 April, 2022

Actions

• Kerberos Support for Actions: Pulse now allows enabling Kerberos authentication for Actions to support secure environments.
• Display of Kerberos-Enabled List: A new checkbox in Create Actions displays all Kerberos profiles configured, making selection easier.
• New Playbook to Kill Long-Running Tez Queries: A new playbook is available to automatically terminate long-running Tez queries.

Alerts

• New YARN Alert Group by App Name: Alerts can now be grouped by yarn_application_name for better organization.
• CLI Supports Multiple Emails: You can now add multiple email addresses for notifications using the CLI.
• HBase Master Failover Alert: New predefined alert HBASE_MASTER_FAILOVER added to track master switch events.
• Hive Interactive Endpoint Check: New alert HIVE_INTERACTIVE_ENDPOINT_CHECK monitors HiveServer2 interactive availability.
• Hive JVM Heap Usage Alert: Pulse raises alerts if Hive interactive server heap usage exceeds thresholds.
• Global Default Email for Alerts: Use a global default email config in the alert notification wizard.
• Bulk Enable/Disable Alerts: Alerts can now be enabled or disabled in bulk from the listing page.
• Bulk Enable/Disable Notifications: Notifications can now be toggled in bulk using checkboxes.
• Jira Integration for Alerts: Pulse now supports Jira integration directly from the Create Alerts Notification wizard.

Other Enhancements

• YARN Capacity Metric Options: Users can now view avg, min, and max for VCore and Memory usage per user on the YARN Capacity dashboard.
• Help Links in UI: Pulse UI now includes direct links to help guides and API documentation.
• Impala Query Grouping: Impala Queries page now supports grouping by Resource Pool and User.
• Keytab Upload Support: Pulse now allows uploading Keytab files for streamlined Kerberos authentication.
• Node Page Search Bar: A new search bar has been added to the Nodes page for easier filtering.
• Saved Tez Query Searches: Tez Queries page now supports saving search parameters for quicker access.

Learn More

Pulse v2.0.0

14 March, 2022

Hydra Agent

• Introduction of Hydra for SSH Access: Pulse 2.0 introduces Hydra, a major enhancement designed to simplify and secure SSH access to cluster nodes. The Hydra Agent supports both CDP and non-CDP platforms, offering easy deployment and maintenance for users. This marks a significant milestone in Pulse’s evolution.

Alerts

• New Notification Channels: Pulse now supports Telegram, Line, and ServiceNow as additional notification channels for alerts.
• Tooltips for Predefined Alerts: A description tooltip now appears under the Edit Alert section for predefined alerts, helping users understand the alert variables.
• New Predefined Alerts Introduced:
  • YARN_LONG_RUNNING_JOB – Triggers on unusually long-running YARN jobs.
  • YARN_PENDING_JOBS_COUNT – Alerts if more than 15 YARN jobs are in a pending state.YARN_PENDING_JOBS_COUNT – Alerts if more than 15 YARN jobs are in a pending state.
  • YARN_PENDING_APPS_COMPARISON – Compares current vs. historical pending job counts. Raises an alert if the current percentage exceeds the threshold.
  • HBASE_REGION_STATE_CHANGE – Detects and notifies any changes in the HBase Region State.
  • New alert HBASE_REGION_STATE_OFFLINE detects offline or transitional HBase region states (HBase 2.x+).
  • New alert HBASE_REGION_STATE_OFFLINE flags HBase region state changes to offline or transitional (HBase 2.x+).
  • New Chrony alert category added for monitoring NTP service issues.
  • Pulse now asks for a reason when clearing an incident.
  • New alert KAFKA_ZOOKEEPER_REQUEST_LATENCY_MS detects Kafka-Zookeeper quorum issues.

Kafka

• Kafka Capacity Planning now suggests required broker count based on utilization.
• New Kafka Offline Partitions page displays topics with offline partitions.
• Kafka Consumers page now includes a new column called Time Lag.
• Two new charts added to Kafka Topic Details: Topic Partition and Broker Disk Distribution.

Impala

• Impala Queries page now supports filtering by Resource Pool.
• Impala Daemon page now includes Memory Limit and Memory Over Limit charts.
• Impala Dashboard shows average admission wait time for queries.
• Impala data is now grouped and displayed by Resource Pool.
• New Impala Resource Pool properties are now viewable in the Impala Dashboard.

CLI

• CLI now supports setting custom retention time for execution logs.
• CLI can now install/uninstall Hydra agent and deploy Hydra server as an addon.
• CLI now allows purging MongoDB data after a specified time period.
• VictoriaMetrics data now has a default retention policy of 31 days.
• adpulse is now the only user-added agent component for Hadoop node installations.

Actions

• New HDFS Balance Runbook helps balance data load across HDFS nodes.
• New DNS Lookup Runbook checks forward and reverse DNS resolution for hosts.
• New Hive Canary Check Runbook monitors daily Hive query runtimes and triggers alerts on discrepancies.

Tez

• New tab added in Tez Query Details to compare configuration differences between runs.
• HDFS Read and Write data now visible in Query Trends chart on Tez Query Details page.
• Table details in Tez Table Details now redirect to the Database Table Details page.

Other Enhancements

• Pulse now retains Error logs for up to 30–45 days and Info logs for 7 days.
• Nodes page heat map can now be sorted by Host utilization.
• Dropdown filters in Application Explorer now support arrow and enter key navigation.

Learn More

Pulse v1.8.2

25 January, 2022

This release includes only resolved issues.

Pulse v1.8.0

10 December, 2021

Enhancements

• Tez Query Details page now shows Hive Configurations via a new Hive Config option.
• JVM GC charts now include metrics for hive_server_2 and hive_meta_store.
• HBase dashboard includes a new RPC Count chart.
• Column widths are now manually adjustable in Kafka Brokers and Nodes pages.
• Inactive Kafka brokers can now be deleted from the Kafka Brokers page.
• Application Explorer includes a new search option.
• Predefined Alerts are now grouped under Stock Alerts on the Alerts page.
• New API added to create roles and add bulk users.
• LLAP Daemons page now shows host IP and details.
• A new Refresh Configuration button is available on the Landing Dashboard.
• CLI now prompts for Kerberos settings when configuring agents for HDP clusters.
• Victoriametrics is now supported as a metrics DB to reduce InfluxDB load.
• New CLI command compact-db added to free disk space after purge-db.
• Kafka Brokers page now includes Broker Partition, Disk Distribution, and Leader Imbalance Ratio charts.

Learn More