Application Explorer

The Applications Explorer board displays the status of applications that run on YARN. You can do the following using this dashboard.

  • View inconsistent applications or incidents.
  • View recommendations for faulty apps.

Filtering Option

In Applications Explorer, click any filter and choose a criteria to display the results. You can filter applications by the following criteria.

FilterDescription
QueuesThe list of queues used in YARN.
App TypeThe type of application submitted to YARN for execution.
StatusThe status of the job.
UsersThe user executing the job in the application.

Search Option

Perform the following steps to search for a record in the Applications Explorer.

  1. Select a search parameter. Pulse provides you multiple search parameters.
  2. Select a suitable operator for your parameter.
  3. Enter the search term and click the enter key.

Alternate Search Option

Note To enable the alternate search option, contact support@acceldata.io.

To search a record using this feature, perform the following:

  1. After enabling this search option, click the search box at the top of the data table. Automatic suggestions appear. You may now paste the fields such as column name, operator, value, or unit and click , the filter will be applied instantly and you will see the search results. You may also press TAB after entering a field. Use , to add further values and filter.
  2. (Optional) To navigate through the drop-down menu, use the up and down arrow keys, and then use the enter key to select from it.
  3. Select the type of filter you want to apply from the drop-down menu. You can add multiple filters.
  4. To remove a filter, click X .

Note To search for a start or end date, the date must be entered in the same format (YYYY-MM-DD HH:MIN:SEC) as displayed in the column.

Important

For String Data type fields, you can use the =~ operator. This operator allows you to search strings by entering partial string.

You can also use regular expressions to view all the items that match your regular expression.

Viewing Details

You may now view the specifics of the running applications by clicking on their IDs.

Application Explorer

Application Explorer

Recommendations

For jobs of every application type you submit, you can view recommendations to optimize the performance of your jobs. These recommendations are based on jobs submitted by applications in the YARN queue of your Hadoop cluster.

Viewing Recommendations

To view recommendations for optimization of jobs, do the following.

  1. Click Recommendations button in the top. A Recommendations tile is displayed. The recommendation is displayed in the following format. Number of applications, potential problem category. For example, 2 Apps, High memory status means that two applications might have high memory issues.
  2. In the Recommendations tile, click the recommendations for the problem category you want to view. The IDs of applications that have recommendations in that category are displayed.
  3. Click the application ID in the table to view the recommendation.

Viewing Incidents

To view incidents in the application explorer, do the following.

  1. Click Incidents button in the top. An Incidents tile is displayed. The incident is displayed in the following format: Number of incidents, service name whose incident was reported, View incidents link. For example, 2 Incidents, Hadoop Service, View Incidents status means that two incidents were raised by Hadoop service.
  2. Click View incidents to know more. The Incidents window is displayed.

Incidents

The Incidents page displays the list of incidents raised by a service. Each incident is displayed in the following format.

(Incident name ) (Time start time and end time of the incident) (The host on which the incident was raised) (Severity of the incident) (Status of the incident, whether cleared or raised)

The following image is an example of the incident format.

Incident Format

Incident Format

Viewing Incident Details

To view incident details, click the incident name to expand the details.

A Details and Alert tab are displayed.

  • The Details tab displays all details of the incident.
  • The Alert tab lets you edit the alert raised by the incident. Click the Edit button to edit the fields of the alert.
  • From the incident details window you can also do the following to view the date and time at which the incident was raised and evaluated.
    1. Click Raised at to expand detailed information of the date and time at which the incident raised.
    2. Click Evaluated at to expand detailed information of the incident evaluation.

Metrics

By default, the table in the dashboard allows you to view the following metrics of jobs carried out by applications installed in YARN.

MetricDescription
IDThe ID of the application.
VarianceThe value that displays by how many times the application is running slow.
TypeThe type of application.
Final StatusThe status of the application when the associated job completed execution. The final status can be either of the following. Succeeded, Failed, Killed, Undefined, Unknown.
NameThe name of the job.
UserThe name of the user executing the job.
MemoryThe amount of memory consumed by the job.
vCoresThe amount of vCores used by the application.
DurationThe time consumed to complete the job.
QueueThe name of the queue the application resides in.
StartedThe time at which the job in the application started.
EndedThe time at which the job in the application ended.
cpuUsePercentThe amount of CPU used (in %) by the application.
avgCoreThe average number of cores used.
avgMemoryMbThe average amount of memory used (in MB).
maxMemoryMbThe maximum amount of memory used (in MB).
memoryUsePercentThe amount of memory used (in %).
containersThe number of containers used by the application.
hostsThe list of hosts the application executed jobs on.
memoryMbSecThe rate of memory utilization.
coresSecThe rate of core utilization.
totalTimeThe total time taken to execute the job.

The metrics table might display the following icons for a record. Click these icons to know more.

  • The alert button displays the service(s) of the application that might require attention.
  • The tachometer button displays more details of the selected application ID.
  • The three horizontal dots button displays the following options.

Add to Compare: Compares any two jobs to list the configuration difference. Choose this option for any two jobs in the table that you want to compare.

View Concurrency: Displays the list of jobs that were running at the same time as the selected application ID.

Viewing Logs

For every record, you can view the status log. To view the logs, as shown in the screenshot below, click the ID's in the Id column of the record whose log you want to view.

Log

Log

Adding/Removing Columns

To add or remove a column to the Applications Explorer table, perform the following:

  1. In the top right column of the table, click the table settings icon. A Select Column window appears.
  2. From the available list of columns, select the column name you want to add to the table or deselect a column name you want to remove from the table.
  3. Click Apply. The table is modified.
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard