Spark Thrift Table Details

The Table Details page displays the details of the table you selected in Spark Thrift -> Tables. As a summary, the following data of a table is displayed under Queries executed on.

Note

The default time range is Last 24 hrs. To view statistics from a custom date range, click the icon and select a time frame and timezone of your choice.

Data	Description
# of Partitions	The number of partitions in the table.
# of Files	The number of files in the table.
# of Rows	The number of rows in the table.
# of Cols	The number of columns in the table.
Total Size	The total size of the table (in bytes).
Compression	State of the table. The following are the states of the table: True if the table is compressed. False if the table is not compressed.

Queries executed on (table name)

The following metrics gives you the information about the table you selected:

Metric	Description
Row Count During Query Execution	The number of rows while executing a table query.
# of Times Query Executed	The number of times the query executed.
Join Types	The associated types of joins in the query. The color displays the type of joins, the following are the type of Joins: Broadcast Hash Join: Joining two datasets, one of them is substantially smaller than the other. Sort Merge Join: Sort the datasets and then merge the sorted data into the partition by iterating through the elements and joining the rows with the same value using the join key. Self Join: Joining a database table to itself
# of Join Columns	The number of columns in the resultant table join.
# of Filter Columns	The number of columns filtered by Spark.
Join Output Row Range	The first and last row value of a resultant join query.
Query Times Range	The time range within which the query executed.
Unique Users	The number of unique users of the queries executed in the table.

Click any row in Queries executed on table and the following details are displayed:

The SQL for the query executed for the table. To copy the SQL, click the icon and click to switch to JSON.
A table displays all of the query's details, including the Table Name, Join Type, and Output Rows for each table.
Information about the Filter Column, Filter Expression, Table Output rows is also displayed.

Last updated on

Was this page helpful?