Analyze YARN Workloads or Applications

An application in YARN is created when a user submits a program or query. The execution framework (such as MapReduce, Tez, Spark, etc.) translates the submission into jobs or stages. These jobs or stages are then coordinated by an ApplicationMaster, which YARN registers and runs.

YARN treats the entire set of jobs or stages as a single application if they share the same ApplicationMaster.

Pulse provides a unified view of all workloads or applications (jobs and queries) running on YARN. It lists applications across services such as MapReduce, Spark, Tez, Hive, Impala, etc., showing key details including application type, status, user, resource usage, logs, etc.

This capability enables you to:

• View real-time or historical applications or workloads.
• View the Queue and Container-level resource availability during application runtime
• Search and filter applications by key attributes.
• Analyze metrics to identify trends and issues.
• Save and reuse search queries for faster reuse.
• Review recommendations to improve performance.
• Track incidents affecting applications and troubleshoot issues.
• Track the number of applications running at the same time
• Compare two or more applications and analyze data.
• Access Application logs to troubleshoot issues.

Explore in Detail

• Analyze Application-Level Metrics
• Visualize Application Resources
• Search and Filter YARN Applications
• Save and Reuse Search Queries
• Analyze Concurrency and Compare Data
• Apply Performance Recommendations
• Track Application Incidents and Alerts