Discover Assets

The Discover Assets page in ADOC is designed to help users efficiently explore, monitor, and manage data assets across their organization. It provides a centralized view of assets, along with critical insights such as policy mappings, data quality scores, and alert statuses. By using this page, you can streamline asset discovery and ensure proactive management of data quality.

This guide explains the functionalities available on the Discover Assets page, providing step-by-step instructions for a user-friendly and effective experience.

🔐 Prerequisite: Domain-Based Access

Access to assets in the Discover Assets page is governed by Domain Management within Acceldata's Role-Based Access Management (RBAM) framework. Users can only view and interact with assets that they have permission to access based on their domain roles (e.g., Viewer, Editor, Manager).

Learn more about Domain Management and how access is granted via Resource Groups and Roles.

Key Interface Elements

Navigator (Left Panel)

• Data Source List: Browse through connected data sources (e.g., databases, file systems, or streaming platforms).
• Expand/Collapse Controls: Click the + or - icons next to a data source to view or hide its associated assets.

Groups (Left Panel)

To filter the assets table by groups, follow these steps:

1. Click the Navigator menu in the left panel.

2. From the dropdown, choose the Groups option.

   • This replaces the Navigator's data source list with the following filters:
     • Source Type
     • Policy Type
     • Alerts
     • Asset Type
     • Data Source

3. View Asset/Policy Counts: Beside each filter option, a count of existing assets or policies is displayed. This count dynamically updates based on your filter selections, providing a better understanding of the distribution of assets or policies for the selected criteria.

Example:

• Selecting the Snowflake checkbox under the Source Type filter displays the count of Data Quality policies specific to Snowflake next to the Data Quality Policy filter under Policy Type.
• This allows you to quickly see how many Data Quality policies are applied to the Snowflake source type, simplifying navigation and filter interactions.

Main Search and Filter Bar (Top)

• Search by Asset Name: Quickly locate an asset by typing its name.
• Tag, Watched Assets, Profiled, and Policy Filters: Narrow results to focus on assets that meet specific criteria, such as those tagged or monitored, or assets with policies applied.

Assets Table (Center Panel)

Each row represents an asset with key metrics:

Actions Menu (Top-Right)

Use the Actions menu to:

• Add SQL View: Create a virtual SQL-based view of the selected asset.
• Add Visual View: Generate a visual representation or dashboard-like view.
• Query Lineage: Trace the data’s origin and downstream dependencies.

Add SQL View

An SQL View asset in the ADOC platform functions similarly to a standard data asset but is powered by custom SQL logic. Instead of referencing a physical table directly, the asset is defined using a user-provided SQL query. This allows you to model complex data logic—such as joins, aggregations, or transformations—within the asset itself. During profiling or Data Quality operations, the platform executes the defined SQL to retrieve and analyze the data, enabling flexible and customized monitoring workflows.

To create an SQL View asset, perform the following:

1. Navigate to the Discover Assets page in the ADOC platform.
2. Click the ⌘ (Actions) button and select Add SQL View. This opens the Add SQL View configuration page.
3. In the Name field, provide a name for your SQL View. This will represent your virtual asset within the platform.
4. Under Select Datasource, choose the relevant data source.
5. Select the relevant Database on which you want to create the SQL View.
6. Enter a meaningful Description to help users understand the purpose or logic of the view.
7. In the Query input field, enter your SQL query. This query defines the logic for the virtual asset.
8. Click Preview to view the sample data based on the query entered.
9. Click Save to create the SQL View. Once saved, it can be used like any other data asset for data quality, profiling, or reconciliation tasks.

Add Visual View

A visual view is a graphical way to create a virtual data asset (table). It behaves similar to any physical asset (table). The visual graph in the visual view is translated into proper data fetch and joins at runtime in the execution environment. It provides the ability to join data from different datasources and once the visual view asset (table) is created, it can be used for data quality check, profiling and other operations.

To add a Visual View, perform the following:

1. Navigate to the Discover Assets page in the ADOC platform.
2. Click the ⌘ (Actions) button and select Add Visual View. This opens the Add Visual View configuration page.
3. Provide a name for the Visual View.
4. Select a data source.
5. Offer a description and click Next. This will display an empty canvas.
6. Add Asset from the top-right corner of the canvas, which opens the Join Assets pop-up. Complete the procedure to create the initial stage of your visual view.
7. Click the Validate button to check the Visual View for syntax issues and to retrieve the example result data set. When validation is successful, a table with the resulting data is displayed below the visual representation, and you can save the visual representation.
8. When a visual view is stored, it becomes an asset on your dashboard. As a result, you will be able to execute various activities on it, such as profiling and data quality policies.

How to edit the Visual View?

To edit a visual view, perform the following steps:

1. Navigate to the Discover Assets page.
2. Search for the visual view asset by using the Groups filter on the left and selecting the Visual_view checkbox. The list of visual view assets are displayed in the asset list panel.
3. Click the name of the visual view that you would like to edit. The asset details page for it is displayed.
4. Navigate to the Visual View tab and click the edit icon. The Visual View is displayed in editing mode.
5. Click the edit icon for a particular asset in the visual view. The Join Assets pop-up is displayed in editing mode.

6. Click the Edit icon for a particular asset in the visual view. The Join Assets pop-up is displayed in editing mode.
7. Click the Verify Changes button on Step 7. Edit Filters page.

8. Click the Save Changes button to update your changes for the visual view.
9. Click the Validate button to validate the Visual View for any syntax errors and also to fetch the sample result data set.
10. On successful validation, you can save the visual view by clicking the Save button.

Query Lineage

The Structured Query Language (SQL) data lineage is a data lineage derived from SQL. It is a data lineage that employs the SQL query to create, update, and manage data sources and database tables.

The Query Analyzer Service extracts an asset's lineage information. You can upload custom queries that may contain critical information about an asset's pedigree. To insert a query, do the following:

1. From the Actions menu, click on Query Lineage. The Query Lineage window is displayed.

2. Fill in the following information in the Query Lineage window:

   1. Select Data Source: Select a data source from the list.
   2. Select Database: Select a database.
   3. Select Schema: Select a schema.
   4. SQL Query Statements: Enter the SQL query.

3. Click the Save button.

You can add multiple SQL Query Statements in the dialog box. Make sure that each of the statements are correct. If there is an error in the SQL Query Statements, then the following error is displayed:

View Switcher (Top-Right)

Toggle between different layout (e.g., Discover Assets or Data Catalog) to find the display that best suits your needs.

Column-Level Insights

Column-level insights provide a detailed analysis of data compliance and quality within a selected table. To access these details:

1. Select a table from the Navigator panel.
2. The column-level breakdown appears in the main panel, displaying the following details for each column:
   • Column Name: Lists the individual columns within the selected table.
   • Avg Policy Score: Indicates the average policy rule score for each column, reflecting adherence to data governance rules.
   • No. of Rules: Displays the number of policy rules applied to each column, highlighting areas that may require attention.

Common Operations

• Locate an Asset: Use the search bar or filters to pinpoint the asset you’re looking for.
• Check for Alerts or Quality Issues: Review the “Active Alerts” or “Quality Error” filters, then open the asset to find root causes and recommended fixes.
• Understand Data Sources at a Glance: View the asset’s type, schema count, and last crawl time to gauge its complexity and freshness.
• Perform Actions on Assets: Use the Actions menu to add SQL or visual views and understand lineage, enabling advanced data analysis and troubleshooting.