Spark Thrift Chargeback Reports

The Spark Thrift Chargeback Reports page enables you to monitor and predict the costs of using shared resources on a cluster over a period of time. You can monitor the costs using the data of reports you create.

Note

The default time range is Last 24 hrs. To view statistics from a custom date range, click the icon and select a time frame and timezone of your choice.

Summary Panel

The chargeback summary panel displays the following details:

Field Name	Description
Groups	Displays how the report is grouped.
Compute Cost VCore/Hr	The computing cost of resources per hour (in $).
Memory Cost GB/Hr	The cost of memory used per hour (in $).

Creating Reports

You can create one or more than one report in chargeback reports. To create a report, do the following.

Click Create Report.
Enter details of the following fields:
- Name: The name of the chargeback report.
- Compute Cost/Hr: The computing cost of resources per hour (in $).
- Memory Cost/Hr: The cost of memory used per hour (in $).
- Groups: Select a group from the following for which you want to monitor the cost.

Note You can select more than one group: - User - Status

(Optional) Click Apply to see the results in the table below Create Report panel.
Click Save to create a report.

Note

You can view your created reports in the left pane of the Chargeback Reports page under Reports panel.

The chargeback report is created.

Chargeback Reports Table

After creating a chargeback report, you can monitor the following metrics.

Note

If you choose Status while creating a report, the metrics are grouped by Status.

Metric	Description
Status	The current status of the queries in Spark Thrift server.
User	The name of the user executing queries.
Total Applications	The total number of applications used by a query.
VCore Seconds	Calculated as the aggregated number of vcores Spark Thrift application allocates x the number of seconds the application has been running.
VCore Cost	The cost of vcore consumption (in $).
Memory Seconds	Calculated as the aggregated amount of memory (in megabytes) Spark Thrift application has allocates x the number of seconds the application has been running.
Memory Cost	The cost of memory consumption (in $).
Total Cost	The total combined cost of VCore Cost and Memory Cost.

Features

The following are the features of the Spark Chargeback Reports page.

Exporting Table

To export the report, click the Export button on the top right corner of the page. The table is downloaded in .xlxs format.

Searching Report

To search a report, perform the following:

Go to the left Reports panel and click the icon.
Type the name of the report in the Search Reports box. The report is displayed.
(Optional) To cancel search, click .

Editing Report

To edit the report, click the icon.

Last updated on

Was this page helpful?