Rogue Users & Processes

Cluster / Tenant Level

Rogue users and processes are defined by various factors not limited to their resource consumption. One of the first methods to identify rogue users and processes is by Duration or Resource Consumption.

The simplest mechanism to identify is the following steps:

• Select Calendar Interval

• Select all Jobs/Filter by Queue

• Select parameter of interest

  • Duration

  • Vcore

  • Memory

• Select Application(s) for Diagnosis

Hive Map Reduce Example

Steps For Identification

• Select Calendar Interval

• Select all Jobs/Filter by Queue

• Select parameter of interest

  • Mapper Count

  • Reducer Count

  • Duration

  • Shuffle Time

  • Sort Time

  • Reduce Time

• Select Application(s) for Diagnosis