Spark Thrift Table Details
The Table Details page displays the details of the table you selected in Spark Thrift -> Tables. As a summary, the following data of a table is displayed under Queries executed on.
The default time range is Last 24 hrs. To view statistics from a custom date range, click the
| Data | Description |
|---|---|
| # of Partitions | The number of partitions in the table. |
| # of Files | The number of files in the table. |
| # of Rows | The number of rows in the table. |
| # of Cols | The number of columns in the table. |
| Total Size | The total size of the table (in bytes). |
| Compression | State of the table. The following are the states of the table: True if the table is compressed. False if the table is not compressed. |
Queries executed on (table name)
The following metrics gives you the information about the table you selected:
| Metric | Description |
|---|---|
| Row Count During Query Execution | The number of rows while executing a table query. |
| # of Times Query Executed | The number of times the query executed. |
| Join Types | The associated types of joins in the query. The color displays the type of joins, the following are the type of Joins: Broadcast Hash Join: Joining two datasets, one of them is substantially smaller than the other. Sort Merge Join: Sort the datasets and then merge the sorted data into the partition by iterating through the elements and joining the rows with the same value using the join key. Self Join: Joining a database table to itself |
| # of Join Columns | The number of columns in the resultant table join. |
| # of Filter Columns | The number of columns filtered by Spark. |
| Join Output Row Range | The first and last row value of a resultant join query. |
| Query Times Range | The time range within which the query executed. |
| Unique Users | The number of unique users of the queries executed in the table. |
Click any row in Queries executed on table and the following details are displayed:
- The SQL for the query executed for the table. To copy the SQL, click the
icon and click to switch to JSON. - A table displays all of the query's details, including the Table Name, Join Type, and Output Rows for each table.
- Information about the Filter Column, Filter Expression, Table Output rows is also displayed.