SnapLogic

SnapLogic is an iPaaS (Integration Platform as a Service) platform used to build, orchestrate, and run data pipelines across cloud and on-prem systems. ADOC integrates natively with SnapLogic to provide visibility into pipeline executions, operational health, failures, and logs directly within the ADOC Pipelines module.

Once integrated, ADOC automatically discovers SnapLogic pipelines and enables monitoring, alerting, and policy-driven observability for ELT workflows.

Prerequisites

Before adding SnapLogic as a data source in ADOC, ensure the following requirements are met:

  • A running ADOC Data Plane deployed in the customer environment

  • Access to a SnapLogic account with sufficient privileges to read pipeline execution metadata

    • Read access to pipeline executions, logs, and project metadata is required
  • (Optional) Knowledge of SnapLogic project paths if you want to restrict pipeline discovery

Adding SnapLogic as a Data Source

To add SnapLogic as a data source in ADOC:

  1. Navigate to the left main navigation menu, click Control Center -> Integrations.

  2. From the Integrations page, click Add Data Source.

  3. Select SnapLogic from the list of available data sources.

  4. Provide the SnapLogic account details:

    • SnapLogic endpoint URL
    • Account credentials with required read access
  5. (Optional) Specify a Project Path:

    • If a project path is provided, ADOC discovers and monitors only pipelines under that path.
    • If no project path is provided, ADOC automatically discovers all pipelines in the account.
  6. Click Submit to complete onboarding. Once configured, the data source is added to the list of data sources on Data Sources tab.

Pipeline Discovery Behavior

  • SnapLogic pipelines are automatically discovered when they are executed after onboarding.
  • Only pipelines that run after the integration is added are discovered.
  • Discovery is based on execution metadata received from SnapLogic APIs via the data plane.

Snowflake Asset Lineage

From ADOC v26.4.0, ADOC extracts lineage for Snowflake tables used within SnapLogic pipelines using a native Snowflake API. This approach is used in place of the SnapLogic lineage API, which does not return current pipeline run data.

When a SnapLogic pipeline includes a Snowflake Select snap, ADOC identifies the Snowflake tables associated with that pipeline and surfaces them as linked assets with their upstream and downstream lineage relationships.

Configuration requirement: For asset stitching to work correctly, the hostname configured in your SnapLogic account must match the URL used when onboarding the Snowflake data source in ADOC. If these values differ, ADOC will not resolve the asset linkage.

With Snowflake asset lineage for SnapLogic, you can:

  • View Snowflake tables connected to a SnapLogic pipeline as linked assets in ADOC
  • Trace upstream and downstream lineage between SnapLogic pipelines and Snowflake tables

Nested Pipeline Linkage

ADOC tracks dependencies across nested SnapLogic pipelines using the Pipeline Execute snap. When a parent pipeline calls one or more child pipelines via Pipeline Execute, ADOC represents these inter-pipeline relationships in the lineage view. Multi-level nesting is supported, meaning a parent pipeline can link to a child pipeline, which can in turn link to further downstream pipelines.

With nested pipeline linkage, you can:

  • View parent-to-child pipeline dependencies as linked assets in ADOC
  • Trace lineage across any depth of nested SnapLogic pipelines

Example: A parent pipeline pipeline_nested_parent is configured with two Pipeline Execute snaps pointing to pipeline_nested_child_1 and pipeline_nested_child_2. In ADOC, navigating to pipeline_nested_parent shows both child pipelines as linked assets. If either child pipeline has its own downstream dependencies, those are traceable from the child asset in turn.

What You Can Do After Adding SnapLogic

After SnapLogic is added as a data source, users can:

  • View SnapLogic pipelines in the Pipelines module

  • Monitor pipeline execution states:

    • Running
    • Completed
    • Failed
  • Inspect pipeline execution details, including:

    • Execution duration
    • Spans and events
    • Error messages and logs (when available)
  • Track historical pipeline runs for operational analysis

  • Configure monitoring and reliability policies based on pipeline outcomes (for example, pipeline duration or failure conditions)

This provides end-to-end visibility into SnapLogic pipeline health without requiring users to leave ADOC.

Next Steps

Once SnapLogic is successfully integrated, navigate to the Pipelines page to view and monitor SnapLogic pipelines.

Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard