Pipeline API 1.0

Pipelines

Create or update a pipeline

Creates a new pipeline or updates an existing one. The pipeline object is provided in the request body as a PipelineInputRequest.

Auth

Request Body

Pipeline definition

PipelineInputRequest	object
pipeline	object
context	object?
*	object
createdAt
DateTime	object
description	string?
enabled	boolean
id	integer
interrupt	boolean
latestRunId	integer
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string
notificationChannels
NotificationPayload	object
alertsEnabled	boolean
configuredNotificationGroupIds	array[integer]
notifyOn	array[string]	Enum: `ERROR`,`WARNING`,`SUCCESS`,`ALL`
notifyOnSuccess	boolean
notifyOnWarning	boolean
reNotifyFactor	integer
severity	string?	Enum: `LOW`,`MEDIUM`,`HIGH`,`CRITICAL`
tags	array[string]
string	string
pipelineBaselineMetric
PipelineBaselineMetric	object
includeSuccessfulRunsOnly	boolean
metrics	integer
unit	string	Enum: `DAYS`,`RUNS`
schedule	string?
scheduled	boolean
schedulerType	string	Enum: `INTERNAL`,`EXTERNAL`
sourceType	string	Enum: `AIRFLOW`,`AZURE_DATA_FACTORY`,`TRINO`,`OTHERS`,`AUTOSYS`,`SPARK`,`DBT`,`FIVETRAN`,`SNAPLOGIC`
tags	array[object]
createdAt
DateTime	object
displayName	string
id	integer
name	string
updatedAt
DateTime	object
uid	string
updatedAt
DateTime	object

PUT /torch-pipeline/api/pipelines

 
curl --request PUT \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines' \ --data '{  "pipeline": {    "context": {},    "createdAt": {},    "description": "{string,null}",    "enabled": "{boolean}",    "id": "{integer}",    "interrupt": "{boolean}",    "latestRunId": "{integer}",    "meta": {      "codeLocation": "{string,null}",      "owner": "{string,null}",      "team": "{string,null}"    },    "name": "{string}",    "notificationChannels": {      "alertsEnabled": "{boolean}",      "configuredNotificationGroupIds": [        "{array[integer]...}"      ],      "notifyOn": [        "{array[string]...}"      ],      "notifyOnSuccess": "{boolean}",      "notifyOnWarning": "{boolean}",      "reNotifyFactor": "{integer}",      "severity": "{string,null}",      "tags": [        "{array[string]...}"      ]    },    "pipelineBaselineMetric": {      "includeSuccessfulRunsOnly": "{boolean}",      "metrics": "{integer}",      "unit": "{string}"    },    "schedule": "{string,null}",    "scheduled": "{boolean}",    "schedulerType": "{string}",    "sourceType": "{string}",    "tags": [      {        "createdAt": {},        "displayName": "{string}",        "id": "{integer}",        "name": "{string}",        "updatedAt": {}      }    ],    "uid": "{string}",    "updatedAt": {}  }}'
Copy

Responses

200

Created or updated pipeline

PipelineResponse	object
pipeline	object
context	object?
*	object
createdAt
DateTime	object
description	string?
enabled	boolean
id	integer
interrupt	boolean
latestRunId	integer
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string
notificationChannels
NotificationPayload	object
alertsEnabled	boolean
configuredNotificationGroupIds	array[integer]
notifyOn	array[string]	Enum: `ERROR`,`WARNING`,`SUCCESS`,`ALL`
notifyOnSuccess	boolean
notifyOnWarning	boolean
reNotifyFactor	integer
severity	string?	Enum: `LOW`,`MEDIUM`,`HIGH`,`CRITICAL`
tags	array[string]
string	string
pipelineBaselineMetric
PipelineBaselineMetric	object
includeSuccessfulRunsOnly	boolean
metrics	integer
unit	string	Enum: `DAYS`,`RUNS`
schedule	string?
scheduled	boolean
schedulerType	string	Enum: `INTERNAL`,`EXTERNAL`
sourceType	string	Enum: `AIRFLOW`,`AZURE_DATA_FACTORY`,`TRINO`,`OTHERS`,`AUTOSYS`,`SPARK`,`DBT`,`FIVETRAN`,`SNAPLOGIC`
tags	array[object]
createdAt
DateTime	object
displayName	string
id	integer
name	string
updatedAt
DateTime	object
uid	string
updatedAt
DateTime	object

Response

 
{ "pipeline": {  "context": {},  "createdAt": {},  "description": "{string,null}",  "enabled": "{boolean}",  "id": "{integer}",  "interrupt": "{boolean}",  "latestRunId": "{integer}",  "meta": {   "codeLocation": "{string,null}",   "owner": "{string,null}",   "team": "{string,null}"  },  "name": "{string}",  "notificationChannels": {   "alertsEnabled": "{boolean}",   "configuredNotificationGroupIds": [    "{array[integer]...}"   ],   "notifyOn": [    "{array[string]...}"   ],   "notifyOnSuccess": "{boolean}",   "notifyOnWarning": "{boolean}",   "reNotifyFactor": "{integer}",   "severity": "{string,null}",   "tags": [    "{array[string]...}"   ]  },  "pipelineBaselineMetric": {   "includeSuccessfulRunsOnly": "{boolean}",   "metrics": "{integer}",   "unit": "{string}"  },  "schedule": "{string,null}",  "scheduled": "{boolean}",  "schedulerType": "{string}",  "sourceType": "{string}",  "tags": [   {    "createdAt": {},    "displayName": "{string}",    "id": "{integer}",    "name": "{string}",    "updatedAt": {}   }  ],  "uid": "{string}",  "updatedAt": {} }}
Copy

Delete a pipeline

Deletes the pipeline with the given ID.

Auth

Path Params

pipelineId

string

Pipeline ID

DELETE /torch-pipeline/api/pipelines/{pipelineId}

 
curl --request DELETE \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/{pipelineId}'
Copy

Responses

200

Pipeline deleted successfully

No response body

404

Pipeline not found

409

Pipeline could not be deleted due to a conflict

Response

 
No response
Copy

Update pipeline graph with jobs

Updates the pipeline's job graph. The request specifies the job nodes and their relationships within the pipeline DAG.

Auth

Path Params

pipelineId

string

Pipeline ID

Request Body

Job graph definition

JobRequest	array[object]
context	object?
*	object
description	string?
inputs	array[object]
assetId	integer
assetType	string?
asset_uid	string?
jobUid	string?
name	string?
owner	string?
parentNodeId	integer
source	string?
sourceType	string?
team	string?
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string
outputs	array[object]
assetId	integer
assetType	string?
asset_uid	string?
jobUid	string?
name	string?
owner	string?
parentNodeId	integer
source	string?
sourceType	string?
team	string?
parentNodeId	integer
pipeLineRunId	integer
uid	string
version	integer

PUT /torch-pipeline/api/pipelines/{pipelineId}/jobs

 
curl --request PUT \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/{pipelineId}/jobs' \ --data '[  {    "context": {},    "description": "{string,null}",    "inputs": [      {        "assetId": "{integer}",        "assetType": "{string,null}",        "asset_uid": "{string,null}",        "jobUid": "{string,null}",        "name": "{string,null}",        "owner": "{string,null}",        "parentNodeId": "{integer}",        "source": "{string,null}",        "sourceType": "{string,null}",        "team": "{string,null}"      }    ],    "meta": {      "codeLocation": "{string,null}",      "owner": "{string,null}",      "team": "{string,null}"    },    "name": "{string}",    "outputs": [      {        "assetId": "{integer}",        "assetType": "{string,null}",        "asset_uid": "{string,null}",        "jobUid": "{string,null}",        "name": "{string,null}",        "owner": "{string,null}",        "parentNodeId": "{integer}",        "source": "{string,null}",        "sourceType": "{string,null}",        "team": "{string,null}"      }    ],    "parentNodeId": "{integer}",    "pipeLineRunId": "{integer}",    "uid": "{string}",    "version": "{integer}"  }]'
Copy

Responses

200

Updated node graph

NodeResponse	object
node	object
alertsCount	integer
assetId	integer
context	object?
*	object
createdVia	string	Enum: `PIPELINE_CREATION`,`MANUAL_ADDITION`,`QUERY_LOG_ANALYSIS`,`AUTO_DERIVED_ASSET`,`DEPENDS_ON_RELATION`,`CRAWLER_CREATION`
description	string?
id	integer
jobNodeMetric	array[object]
Metric	object
change	number
denominator	integer
name	string
type	string	Enum: `COST`,`DURATION`,`RECORDS_PROCESSED`,`RELIABILITY`
unit	string?
value	number
jobStatus	string?	Enum: `SUCCESS`,`ERROR`,`ABORTED`,`RUNNING`
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string?
parentId	integer
pipelineId	integer
reliabilityPolicySummary	array[object]
PolicySummary	object
aborted	integer
error	integer
policyType	string	Enum: `DATA_QUALITY`,`RECONCILIATION`,`EQUALITY`,`DATA_DRIFT`,`SCHEMA_DRIFT`,`DATA_CADENCE`,`PROFILE_ANOMALY`,`AUTO_ANOMALY`
success	integer
total	integer
status	string	Enum: `ACTIVE`,`STALE`,`DELETED`
type	string	Enum: `ASSET`,`FUNCTIONAL`
uid	string?
versionId	integer

400

Invalid job request

Response

 
{ "node": {  "alertsCount": "{integer}",  "assetId": "{integer}",  "context": {},  "createdVia": "{string}",  "description": "{string,null}",  "id": "{integer}",  "jobNodeMetric": [   {    "change": "{number}",    "denominator": "{integer}",    "name": "{string}",    "type": "{string}",    "unit": "{string,null}",    "value": "{number}"   }  ],  "jobStatus": "{string,null}",  "meta": {   "codeLocation": "{string,null}",   "owner": "{string,null}",   "team": "{string,null}"  },  "name": "{string,null}",  "parentId": "{integer}",  "pipelineId": "{integer}",  "reliabilityPolicySummary": [   {    "aborted": "{integer}",    "error": "{integer}",    "policyType": "{string}",    "success": "{integer}",    "total": "{integer}"   }  ],  "status": "{string}",  "type": "{string}",  "uid": "{string,null}",  "versionId": "{integer}" }}
Copy

Get a pipeline by identity

Returns details of a pipeline identified by its numeric ID or name.

Auth

Path Params

identity

string

Pipeline ID (numeric) or pipeline name

GET /torch-pipeline/api/pipelines/{identity}

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/{identity}'
Copy

Responses

200

Pipeline details

PipelineResponse	object
pipeline	object
context	object?
*	object
createdAt
DateTime	object
description	string?
enabled	boolean
id	integer
interrupt	boolean
latestRunId	integer
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string
notificationChannels
NotificationPayload	object
alertsEnabled	boolean
configuredNotificationGroupIds	array[integer]
notifyOn	array[string]	Enum: `ERROR`,`WARNING`,`SUCCESS`,`ALL`
notifyOnSuccess	boolean
notifyOnWarning	boolean
reNotifyFactor	integer
severity	string?	Enum: `LOW`,`MEDIUM`,`HIGH`,`CRITICAL`
tags	array[string]
string	string
pipelineBaselineMetric
PipelineBaselineMetric	object
includeSuccessfulRunsOnly	boolean
metrics	integer
unit	string	Enum: `DAYS`,`RUNS`
schedule	string?
scheduled	boolean
schedulerType	string	Enum: `INTERNAL`,`EXTERNAL`
sourceType	string	Enum: `AIRFLOW`,`AZURE_DATA_FACTORY`,`TRINO`,`OTHERS`,`AUTOSYS`,`SPARK`,`DBT`,`FIVETRAN`,`SNAPLOGIC`
tags	array[object]
createdAt
DateTime	object
displayName	string
id	integer
name	string
updatedAt
DateTime	object
uid	string
updatedAt
DateTime	object

404

Pipeline not found

Response

 
{ "pipeline": {  "context": {},  "createdAt": {},  "description": "{string,null}",  "enabled": "{boolean}",  "id": "{integer}",  "interrupt": "{boolean}",  "latestRunId": "{integer}",  "meta": {   "codeLocation": "{string,null}",   "owner": "{string,null}",   "team": "{string,null}"  },  "name": "{string}",  "notificationChannels": {   "alertsEnabled": "{boolean}",   "configuredNotificationGroupIds": [    "{array[integer]...}"   ],   "notifyOn": [    "{array[string]...}"   ],   "notifyOnSuccess": "{boolean}",   "notifyOnWarning": "{boolean}",   "reNotifyFactor": "{integer}",   "severity": "{string,null}",   "tags": [    "{array[string]...}"   ]  },  "pipelineBaselineMetric": {   "includeSuccessfulRunsOnly": "{boolean}",   "metrics": "{integer}",   "unit": "{string}"  },  "schedule": "{string,null}",  "scheduled": "{boolean}",  "schedulerType": "{string}",  "sourceType": "{string}",  "tags": [   {    "createdAt": {},    "displayName": "{string}",    "id": "{integer}",    "name": "{string}",    "updatedAt": {}   }  ],  "uid": "{string}",  "updatedAt": {} }}
Copy

List all pipelines with summary

Returns a paginated summary of all pipelines. Supports filtering by pipeline source, instrumentation type, and namespaces.

Auth

Query String

pipelineSource	string	Filter by pipeline source (e.g., AIRFLOW)
instrumentedBy	string	Filter by instrumentation method (e.g., SDK, OPENLINEAGE)
namespaces	string	Filter by namespaces
page	string	Page number (0-based)
size	string	Number of items per page
sort	string	Sort field and direction

GET /torch-pipeline/api/pipelines/summary

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/summary' \ --data pipelineSource={pipelineSource} \ --data instrumentedBy={instrumentedBy} \ --data namespaces={namespaces} \ --data page={page} \ --data size={size} \ --data sort={sort}
Copy

Responses

200

Paginated pipeline summary

PipelinesListingResponse	object
meta	object
count	integer
page	integer
size	integer
pipelines	array[object]
assetNodesCount	integer
functionalNodesCount	integer
latestRunFinishedAt
DateTime	object
latestRunId	integer
latestRunResult	string?
latestRunStartedAt
DateTime	object
latestRunVersionId	integer
pipelineSummary	object
id	integer
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string
uid	string
policyCounts	object
*	integer
sourceType	string	Enum: `AIRFLOW`,`AZURE_DATA_FACTORY`,`TRINO`,`OTHERS`,`AUTOSYS`,`SPARK`,`DBT`,`FIVETRAN`,`SNAPLOGIC`
totalRunsCount	integer

Response

 
{ "meta": {  "count": "{integer}",  "page": "{integer}",  "size": "{integer}" }, "pipelines": [  {   "assetNodesCount": "{integer}",   "functionalNodesCount": "{integer}",   "latestRunFinishedAt": {},   "latestRunId": "{integer}",   "latestRunResult": "{string,null}",   "latestRunStartedAt": {},   "latestRunVersionId": "{integer}",   "pipelineSummary": {    "id": "{integer}",    "meta": {     "codeLocation": "{string,null}",     "owner": "{string,null}",     "team": "{string,null}"    },    "name": "{string}",    "uid": "{string}"   },   "policyCounts": {},   "sourceType": "{string}",   "totalRunsCount": "{integer}"  } ]}
Copy

Pipeline Graph

GET

/torch-pipeline/api/pipelines/{pipelineId}/graph

Get pipeline graph

Returns the full pipeline graph including jobs and assets. Optionally filtered by version, run, and node status.

Auth

Path Params

pipelineId

string

Pipeline ID

Query String

versionId	string	Specific graph version ID
runId	string	Pipeline run ID to scope the graph
nodeStatus	string	Filter nodes by status (ALL, RUNNING, FAILED, etc.)

GET /torch-pipeline/api/pipelines/{pipelineId}/graph

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/{pipelineId}/graph' \ --data versionId={versionId} \ --data runId={runId} \ --data nodeStatus={nodeStatus}
Copy

Responses

200

Pipeline graph details

PipelineDetailsResponse	object
details	object
edges	array[object]
fromAssetType	string?	Enum: `ASSET`,`FUNCTIONAL`
fromId	integer
id	integer
toAssetType	string?	Enum: `ASSET`,`FUNCTIONAL`
toId	integer
versionId	integer
nodes	array[object]
alertsCount	integer
assetId	integer
context	object?
*	object
createdVia	string	Enum: `PIPELINE_CREATION`,`MANUAL_ADDITION`,`QUERY_LOG_ANALYSIS`,`AUTO_DERIVED_ASSET`,`DEPENDS_ON_RELATION`,`CRAWLER_CREATION`
description	string?
id	integer
jobNodeMetric	array[object]
Metric	object
change	number
denominator	integer
name	string
type	string	Enum: `COST`,`DURATION`,`RECORDS_PROCESSED`,`RELIABILITY`
unit	string?
value	number
jobStatus	string?	Enum: `SUCCESS`,`ERROR`,`ABORTED`,`RUNNING`
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string?
parentId	integer
pipelineId	integer
reliabilityPolicySummary	array[object]
PolicySummary	object
aborted	integer
error	integer
policyType	string	Enum: `DATA_QUALITY`,`RECONCILIATION`,`EQUALITY`,`DATA_DRIFT`,`SCHEMA_DRIFT`,`DATA_CADENCE`,`PROFILE_ANOMALY`,`AUTO_ANOMALY`
success	integer
total	integer
status	string	Enum: `ACTIVE`,`STALE`,`DELETED`
type	string	Enum: `ASSET`,`FUNCTIONAL`
uid	string?
versionId	integer
pipeline	object
context	object?
*	object
createdAt
DateTime	object
description	string?
enabled	boolean
id	integer
interrupt	boolean
latestRunId	integer
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string
notificationChannels
NotificationPayload	object
alertsEnabled	boolean
configuredNotificationGroupIds	array[integer]
notifyOn	array[string]	Enum: `ERROR`,`WARNING`,`SUCCESS`,`ALL`
notifyOnSuccess	boolean
notifyOnWarning	boolean
reNotifyFactor	integer
severity	string?	Enum: `LOW`,`MEDIUM`,`HIGH`,`CRITICAL`
tags	array[string]
string	string
pipelineBaselineMetric
PipelineBaselineMetric	object
includeSuccessfulRunsOnly	boolean
metrics	integer
unit	string	Enum: `DAYS`,`RUNS`
schedule	string?
scheduled	boolean
schedulerType	string	Enum: `INTERNAL`,`EXTERNAL`
sourceType	string	Enum: `AIRFLOW`,`AZURE_DATA_FACTORY`,`TRINO`,`OTHERS`,`AUTOSYS`,`SPARK`,`DBT`,`FIVETRAN`,`SNAPLOGIC`
tags	array[object]
createdAt
DateTime	object
displayName	string
id	integer
name	string
updatedAt
DateTime	object
uid	string
updatedAt
DateTime	object
pipelineRun
PipelineRun	object
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer
metrics	array[object]
change	number
denominator	integer
name	string
type	string	Enum: `COST`,`DURATION`,`RECORDS_PROCESSED`,`RELIABILITY`
unit	string?
value	number

400

Invalid or missing pipelineId

Response

xxxxxxxxxx
 
{
 "details": {...},
 "metrics": [...]
}
Copy

Pipeline Runs

POST

/torch-pipeline/api/pipelines/{pipelineId}/runs

PUT

/torch-pipeline/api/pipelines/runs/{runId}

GET

/torch-pipeline/api/pipelines/runs/{runId}/span-job-associations

GET

/torch-pipeline/api/pipelines/runs/{identifier}

GET

/torch-pipeline/api/pipelines/{id}/latestRun

GET

/torch-pipeline/api/pipelines/{id}/runs

Create a pipeline run

Creates a new run for the specified pipeline.

Auth

Path Params

pipelineId

string

Pipeline ID

Request Body

Pipeline run definition

PipelineRunRequest	object
run	object
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer

POST /torch-pipeline/api/pipelines/{pipelineId}/runs

 
curl --request POST \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/{pipelineId}/runs' \ --data '{  "run": {    "args": {},    "avgExecutionTime": {      "intVal": {        "signum": "{integer}",        "mag": [          {}        ],        "bitCountPlusOne": "{integer}",        "bitLengthPlusOne": "{integer}",        "lowestSetBitPlusTwo": "{integer}",        "firstNonzeroIntNumPlusTwo": "{integer}"      },      "scale": "{integer}",      "precision": "{integer}",      "stringCache": "{string}",      "intCompact": "{integer}"    },    "continuationId": "{string,null}",    "errorEvents": "{integer}",    "externalRunId": "{string,null}",    "finishedAt": {},    "id": "{integer}",    "pipelineId": "{integer}",    "result": "{string}",    "startedAt": {},    "status": "{string}",    "successEvents": "{integer}",    "tenantId": "{string,null}",    "versionId": "{integer}",    "warningEvents": "{integer}"  }}'
Copy

Responses

200

Created pipeline run

PipelineRunRequest	object
run	object
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer

Response

 
{ "run": {  "args": {},  "avgExecutionTime": {   "intVal": {    "signum": "{integer}",    "mag": [     {}    ],    "bitCountPlusOne": "{integer}",    "bitLengthPlusOne": "{integer}",    "lowestSetBitPlusTwo": "{integer}",    "firstNonzeroIntNumPlusTwo": "{integer}"   },   "scale": "{integer}",   "precision": "{integer}",   "stringCache": "{string}",   "intCompact": "{integer}"  },  "continuationId": "{string,null}",  "errorEvents": "{integer}",  "externalRunId": "{string,null}",  "finishedAt": {},  "id": "{integer}",  "pipelineId": "{integer}",  "result": "{string}",  "startedAt": {},  "status": "{string}",  "successEvents": "{integer}",  "tenantId": "{string,null}",  "versionId": "{integer}",  "warningEvents": "{integer}" }}
Copy

Update a pipeline run

Updates an existing pipeline run by its run ID.

Auth

Path Params

runId

string

Pipeline run ID

Request Body

Updated pipeline run data

PipelineRunRequest	object
run	object
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer

PUT /torch-pipeline/api/pipelines/runs/{runId}

 
curl --request PUT \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/runs/{runId}' \ --data '{  "run": {    "args": {},    "avgExecutionTime": {      "intVal": {        "signum": "{integer}",        "mag": [          {}        ],        "bitCountPlusOne": "{integer}",        "bitLengthPlusOne": "{integer}",        "lowestSetBitPlusTwo": "{integer}",        "firstNonzeroIntNumPlusTwo": "{integer}"      },      "scale": "{integer}",      "precision": "{integer}",      "stringCache": "{string}",      "intCompact": "{integer}"    },    "continuationId": "{string,null}",    "errorEvents": "{integer}",    "externalRunId": "{string,null}",    "finishedAt": {},    "id": "{integer}",    "pipelineId": "{integer}",    "result": "{string}",    "startedAt": {},    "status": "{string}",    "successEvents": "{integer}",    "tenantId": "{string,null}",    "versionId": "{integer}",    "warningEvents": "{integer}"  }}'
Copy

Responses

200

Updated pipeline run

PipelineRunRequest	object
run	object
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer

Response

 
{ "run": {  "args": {},  "avgExecutionTime": {   "intVal": {    "signum": "{integer}",    "mag": [     {}    ],    "bitCountPlusOne": "{integer}",    "bitLengthPlusOne": "{integer}",    "lowestSetBitPlusTwo": "{integer}",    "firstNonzeroIntNumPlusTwo": "{integer}"   },   "scale": "{integer}",   "precision": "{integer}",   "stringCache": "{string}",   "intCompact": "{integer}"  },  "continuationId": "{string,null}",  "errorEvents": "{integer}",  "externalRunId": "{string,null}",  "finishedAt": {},  "id": "{integer}",  "pipelineId": "{integer}",  "result": "{string}",  "startedAt": {},  "status": "{string}",  "successEvents": "{integer}",  "tenantId": "{string,null}",  "versionId": "{integer}",  "warningEvents": "{integer}" }}
Copy

Get span-job associations for a run

Returns the mapping between spans and jobs within the specified pipeline run. Useful for understanding which jobs produced which spans.

Auth

Path Params

runId

string

Pipeline run ID

GET /torch-pipeline/api/pipelines/runs/{runId}/span-job-associations

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/runs/{runId}/span-job-associations'
Copy

Responses

200

Span-job association mappings

SpanJobAssociationsResponse	object
associations	array[object]
id	integer
jobUid	string
result	string	Enum: `SUCCESS`,`WARNING`,`ERROR`,`SKIPPED`
runId	integer
spanUid	string
meta	object
count	integer
page	integer
size	integer

404

Pipeline run not found

Response

 
{ "associations": [  {   "id": "{integer}",   "jobUid": "{string}",   "result": "{string}",   "runId": "{integer}",   "spanUid": "{string}"  } ], "meta": {  "count": "{integer}",  "page": "{integer}",  "size": "{integer}" }}
Copy

Get a pipeline run

Returns details of a specific pipeline run.

Auth

Path Params

identifier

string

Pipeline run ID

GET /torch-pipeline/api/pipelines/runs/{identifier}

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/runs/{identifier}'
Copy

Responses

200

Pipeline run details

PipelineRunRequest	object
run	object
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer

404

Pipeline run not found

Response

 
{ "run": {  "args": {},  "avgExecutionTime": {   "intVal": {    "signum": "{integer}",    "mag": [     {}    ],    "bitCountPlusOne": "{integer}",    "bitLengthPlusOne": "{integer}",    "lowestSetBitPlusTwo": "{integer}",    "firstNonzeroIntNumPlusTwo": "{integer}"   },   "scale": "{integer}",   "precision": "{integer}",   "stringCache": "{string}",   "intCompact": "{integer}"  },  "continuationId": "{string,null}",  "errorEvents": "{integer}",  "externalRunId": "{string,null}",  "finishedAt": {},  "id": "{integer}",  "pipelineId": "{integer}",  "result": "{string}",  "startedAt": {},  "status": "{string}",  "successEvents": "{integer}",  "tenantId": "{string,null}",  "versionId": "{integer}",  "warningEvents": "{integer}" }}
Copy

Get latest pipeline run

Returns the most recent run for the specified pipeline.

Auth

Path Params

string

Pipeline ID

GET /torch-pipeline/api/pipelines/{id}/latestRun

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/{id}/latestRun'
Copy

Responses

200

Latest pipeline run

PipelineRunRequest	object
run	object
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer

404

No runs found for the pipeline

Response

 
{ "run": {  "args": {},  "avgExecutionTime": {   "intVal": {    "signum": "{integer}",    "mag": [     {}    ],    "bitCountPlusOne": "{integer}",    "bitLengthPlusOne": "{integer}",    "lowestSetBitPlusTwo": "{integer}",    "firstNonzeroIntNumPlusTwo": "{integer}"   },   "scale": "{integer}",   "precision": "{integer}",   "stringCache": "{string}",   "intCompact": "{integer}"  },  "continuationId": "{string,null}",  "errorEvents": "{integer}",  "externalRunId": "{string,null}",  "finishedAt": {},  "id": "{integer}",  "pipelineId": "{integer}",  "result": "{string}",  "startedAt": {},  "status": "{string}",  "successEvents": "{integer}",  "tenantId": "{string,null}",  "versionId": "{integer}",  "warningEvents": "{integer}" }}
Copy

List runs for a pipeline

Returns a paginated list of runs for the specified pipeline.

Auth

Path Params

string

Pipeline ID

Query String

page	string	Page number (0-based)
size	string	Number of items per page
sort	string	Sort field and direction

GET /torch-pipeline/api/pipelines/{id}/runs

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/{id}/runs' \ --data page={page} \ --data size={size} \ --data sort={sort}
Copy

Responses

200

Paginated list of pipeline runs

PipelineRunsResponse	object
meta	object
count	integer
page	integer
size	integer
runs	array[object]
args	object?
*	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
continuationId	string?
errorEvents	integer
externalRunId	string?
finishedAt
DateTime	object
id	integer
pipelineId	integer
result	string	Enum: `RUNNING`,`SUCCESS`,`FAILURE`,`CANCELLED`
startedAt
DateTime	object
status	string	Enum: `STARTED`,`COMPLETED`,`FAILED`,`ABORTED`
successEvents	integer
tenantId	string?
versionId	integer
warningEvents	integer

404

Pipeline not found

Response

 
{ "meta": {  "count": "{integer}",  "page": "{integer}",  "size": "{integer}" }, "runs": [  {   "args": {},   "avgExecutionTime": {    "intVal": {     "signum": "{integer}",     "mag": [      {}     ],     "bitCountPlusOne": "{integer}",     "bitLengthPlusOne": "{integer}",     "lowestSetBitPlusTwo": "{integer}",     "firstNonzeroIntNumPlusTwo": "{integer}"    },    "scale": "{integer}",    "precision": "{integer}",    "stringCache": "{string}",    "intCompact": "{integer}"   },   "continuationId": "{string,null}",   "errorEvents": "{integer}",   "externalRunId": "{string,null}",   "finishedAt": {},   "id": "{integer}",   "pipelineId": "{integer}",   "result": "{string}",   "startedAt": {},   "status": "{string}",   "successEvents": "{integer}",   "tenantId": "{string,null}",   "versionId": "{integer}",   "warningEvents": "{integer}"  } ]}
Copy

Spans

POST

/torch-pipeline/api/pipelines/runs/{runId}/spans

GET

/torch-pipeline/api/pipelines/runs/{runId}/spans

GET

/torch-pipeline/api/pipelines/runs/{runId}/spans/{identity}

GET

/torch-pipeline/api/pipelines/spans/{spanId}/childSpans

Create a span for a pipeline run

Creates a new span within the specified pipeline run. A span represents a unit of work within the pipeline execution.

Auth

Path Params

runId

string

Pipeline run ID

Request Body

Span definition with optional job associations

SpanRequest	object
associatedJobUids	array[string]
span	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
errorEvents	integer
finishedAt
DateTime	object
id	integer
parentSpanId	integer
pipelineRunId	integer
startedAt
DateTime	object
status	string	Enum: `INITIALIZED`,`STARTED`,`FINISHED`,`ERRORED`,`ABORTED`,`SKIPPED`
successEvents	integer
totalTime	integer
uid	string
warningEvents	integer

POST /torch-pipeline/api/pipelines/runs/{runId}/spans

 
curl --request POST \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/runs/{runId}/spans' \ --data '{  "associatedJobUids": [    "{array[string]...}"  ],  "span": {    "avgExecutionTime": {      "intVal": {        "signum": "{integer}",        "mag": [          {}        ],        "bitCountPlusOne": "{integer}",        "bitLengthPlusOne": "{integer}",        "lowestSetBitPlusTwo": "{integer}",        "firstNonzeroIntNumPlusTwo": "{integer}"      },      "scale": "{integer}",      "precision": "{integer}",      "stringCache": "{string}",      "intCompact": "{integer}"    },    "errorEvents": "{integer}",    "finishedAt": {},    "id": "{integer}",    "parentSpanId": "{integer}",    "pipelineRunId": "{integer}",    "startedAt": {},    "status": "{string}",    "successEvents": "{integer}",    "totalTime": "{integer}",    "uid": "{string}",    "warningEvents": "{integer}"  }}'
Copy

Responses

200

Created span

SpanRequest	object
associatedJobUids	array[string]
span	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
errorEvents	integer
finishedAt
DateTime	object
id	integer
parentSpanId	integer
pipelineRunId	integer
startedAt
DateTime	object
status	string	Enum: `INITIALIZED`,`STARTED`,`FINISHED`,`ERRORED`,`ABORTED`,`SKIPPED`
successEvents	integer
totalTime	integer
uid	string
warningEvents	integer

404

Pipeline run not found

Response

 
{ "associatedJobUids": [  "{array[string]...}" ], "span": {  "avgExecutionTime": {   "intVal": {    "signum": "{integer}",    "mag": [     {}    ],    "bitCountPlusOne": "{integer}",    "bitLengthPlusOne": "{integer}",    "lowestSetBitPlusTwo": "{integer}",    "firstNonzeroIntNumPlusTwo": "{integer}"   },   "scale": "{integer}",   "precision": "{integer}",   "stringCache": "{string}",   "intCompact": "{integer}"  },  "errorEvents": "{integer}",  "finishedAt": {},  "id": "{integer}",  "parentSpanId": "{integer}",  "pipelineRunId": "{integer}",  "startedAt": {},  "status": "{string}",  "successEvents": "{integer}",  "totalTime": "{integer}",  "uid": "{string}",  "warningEvents": "{integer}" }}
Copy

List spans for a pipeline run

Returns all spans associated with the given pipeline run. When onlyRootSpan=true, returns only the root span.

Auth

Path Params

runId

string

Pipeline run ID

Query String

onlyRootSpan

string

Return only root spans (default false)

GET /torch-pipeline/api/pipelines/runs/{runId}/spans

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/runs/{runId}/spans' \ --data onlyRootSpan={onlyRootSpan}
Copy

Responses

200

List of spans

SpansResponse	object
spans	array[object]
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
errorEvents	integer
finishedAt
DateTime	object
id	integer
parentSpanId	integer
pipelineRunId	integer
startedAt
DateTime	object
status	string	Enum: `INITIALIZED`,`STARTED`,`FINISHED`,`ERRORED`,`ABORTED`,`SKIPPED`
successEvents	integer
totalTime	integer
uid	string
warningEvents	integer

404

Pipeline run not found

Response

 
{ "spans": [  {   "avgExecutionTime": {    "intVal": {     "signum": "{integer}",     "mag": [      {}     ],     "bitCountPlusOne": "{integer}",     "bitLengthPlusOne": "{integer}",     "lowestSetBitPlusTwo": "{integer}",     "firstNonzeroIntNumPlusTwo": "{integer}"    },    "scale": "{integer}",    "precision": "{integer}",    "stringCache": "{string}",    "intCompact": "{integer}"   },   "errorEvents": "{integer}",   "finishedAt": {},   "id": "{integer}",   "parentSpanId": "{integer}",   "pipelineRunId": "{integer}",   "startedAt": {},   "status": "{string}",   "successEvents": "{integer}",   "totalTime": "{integer}",   "uid": "{string}",   "warningEvents": "{integer}"  } ]}
Copy

Get a span by identity

Returns a specific span within a pipeline run.

Auth

Path Params

runId	string	Pipeline run ID
identity	string	Span identity (ID or name)

GET /torch-pipeline/api/pipelines/runs/{runId}/spans/{identity}

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/runs/{runId}/spans/{identity}'
Copy

Responses

200

Span details

SpanRequest	object
associatedJobUids	array[string]
span	object
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
errorEvents	integer
finishedAt
DateTime	object
id	integer
parentSpanId	integer
pipelineRunId	integer
startedAt
DateTime	object
status	string	Enum: `INITIALIZED`,`STARTED`,`FINISHED`,`ERRORED`,`ABORTED`,`SKIPPED`
successEvents	integer
totalTime	integer
uid	string
warningEvents	integer

404

Span not found

Response

 
{ "associatedJobUids": [  "{array[string]...}" ], "span": {  "avgExecutionTime": {   "intVal": {    "signum": "{integer}",    "mag": [     {}    ],    "bitCountPlusOne": "{integer}",    "bitLengthPlusOne": "{integer}",    "lowestSetBitPlusTwo": "{integer}",    "firstNonzeroIntNumPlusTwo": "{integer}"   },   "scale": "{integer}",   "precision": "{integer}",   "stringCache": "{string}",   "intCompact": "{integer}"  },  "errorEvents": "{integer}",  "finishedAt": {},  "id": "{integer}",  "parentSpanId": "{integer}",  "pipelineRunId": "{integer}",  "startedAt": {},  "status": "{string}",  "successEvents": "{integer}",  "totalTime": "{integer}",  "uid": "{string}",  "warningEvents": "{integer}" }}
Copy

List child spans

Returns all child spans of the specified span.

Auth

Path Params

spanId

string

Parent span ID

GET /torch-pipeline/api/pipelines/spans/{spanId}/childSpans

 
curl --get \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/spans/{spanId}/childSpans'
Copy

Responses

200

List of child spans

ChildSpanResponse	object
childSpans	array[object]
avgExecutionTime
BigDecimal	object
intVal	object
signum	integer
mag	array[object]
bitCountPlusOne	integer
bitLengthPlusOne	integer
lowestSetBitPlusTwo	integer
firstNonzeroIntNumPlusTwo	integer
scale	integer
precision	integer
stringCache	string
intCompact	integer
errorEvents	integer
finishedAt
DateTime	object
id	integer
parentSpanId	integer
pipelineRunId	integer
startedAt
DateTime	object
status	string	Enum: `INITIALIZED`,`STARTED`,`FINISHED`,`ERRORED`,`ABORTED`,`SKIPPED`
successEvents	integer
totalTime	integer
uid	string
warningEvents	integer

404

Span not found

Response

 
{ "childSpans": [  {   "avgExecutionTime": {    "intVal": {     "signum": "{integer}",     "mag": [      {}     ],     "bitCountPlusOne": "{integer}",     "bitLengthPlusOne": "{integer}",     "lowestSetBitPlusTwo": "{integer}",     "firstNonzeroIntNumPlusTwo": "{integer}"    },    "scale": "{integer}",    "precision": "{integer}",    "stringCache": "{string}",    "intCompact": "{integer}"   },   "errorEvents": "{integer}",   "finishedAt": {},   "id": "{integer}",   "parentSpanId": "{integer}",   "pipelineRunId": "{integer}",   "startedAt": {},   "status": "{string}",   "successEvents": "{integer}",   "totalTime": "{integer}",   "uid": "{string}",   "warningEvents": "{integer}"  } ]}
Copy

Span Events

POST

/torch-pipeline/api/pipelines/spans/{spanId}/events

GET

/torch-pipeline/api/pipelines/spans/{spanId}/events

GET

/torch-pipeline/api/pipelines/spans/events/{spanEventId}/log

Create a span event

Records an event within the specified span. Events capture data points, metrics, or status changes during span execution.

Auth

Path Params

spanId

string

Span ID

Request Body

Span event data

SpanEventRequest	object
event	object
contextData	object?
*	object
createdAt
DateTime	object
eventUid	string
logData	string?
spanId	integer
tenantId	string?

POST /torch-pipeline/api/pipelines/spans/{spanId}/events

 
curl --request POST \ --url 'https://docs.acceldata.io/torch-pipeline/api/pipelines/spans/{spanId}/events' \ --data '{  "event": {    "contextData": {},    "createdAt": {},    "eventUid": "{string}",    "logData": "{string,null}",    "spanId": "{integer}",    "tenantId": "{string,null}"  }}'
Copy

Responses

200

Created span event

SpanEventResponse	object
event	object
alert
EventAlertObject	object
alertSeverity	string?	Enum: `LOW`,`MEDIUM`,`HIGH`,`CRITICAL`
isIncidentRaised	boolean
contextData	object?
*	object
createdAt
DateTime	object
eventUid	string
id	integer
meta	object?
*	object
spanId	integer
spanUid	string?
type	string	Enum: `SUCCESS`,`WARNING`,`ERROR`,`SKIPPED`

404

Span not found

Response

List events for a span

Returns all events recorded within the specified span.

Auth

Path Params

spanId

string

Span ID

GET /torch-pipeline/api/pipelines/spans/{spanId}/events

Responses

200

List of span events

SpanEventsResponse	object
events	array[object]
alert
EventAlertObject	object
alertSeverity	string?	Enum: `LOW`,`MEDIUM`,`HIGH`,`CRITICAL`
isIncidentRaised	boolean
contextData	object?
*	object
createdAt
DateTime	object
eventUid	string
id	integer
meta	object?
*	object
spanId	integer
spanUid	string?
type	string	Enum: `SUCCESS`,`WARNING`,`ERROR`,`SKIPPED`
meta	object
count	integer
page	integer
size	integer

404

Span not found

Response

Get span event log

Returns the detailed log output for a specific span event.

Auth

Path Params

spanEventId

string

Span event ID

GET /torch-pipeline/api/pipelines/spans/events/{spanEventId}/log

Responses

200

Span event log content

No response body

Response

Pipeline Nodes

GET

/torch-pipeline/api/pipelines/nodes/{id}

Get a pipeline node by ID

Returns details for a specific pipeline node (job or task).

Auth

Path Params

string

Node ID

GET /torch-pipeline/api/pipelines/nodes/{id}

Responses

200

Node details

NodeDetailsResponse	object
data	object
node	object
alertsCount	integer
assetId	integer
context	object?
*	object
createdVia	string	Enum: `PIPELINE_CREATION`,`MANUAL_ADDITION`,`QUERY_LOG_ANALYSIS`,`AUTO_DERIVED_ASSET`,`DEPENDS_ON_RELATION`,`CRAWLER_CREATION`
description	string?
id	integer
jobNodeMetric	array[object]
Metric	object
change	number
denominator	integer
name	string
type	string	Enum: `COST`,`DURATION`,`RECORDS_PROCESSED`,`RELIABILITY`
unit	string?
value	number
jobStatus	string?	Enum: `SUCCESS`,`ERROR`,`ABORTED`,`RUNNING`
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string?
parentId	integer
pipelineId	integer
reliabilityPolicySummary	array[object]
PolicySummary	object
aborted	integer
error	integer
policyType	string	Enum: `DATA_QUALITY`,`RECONCILIATION`,`EQUALITY`,`DATA_DRIFT`,`SCHEMA_DRIFT`,`DATA_CADENCE`,`PROFILE_ANOMALY`,`AUTO_ANOMALY`
success	integer
total	integer
status	string	Enum: `ACTIVE`,`STALE`,`DELETED`
type	string	Enum: `ASSET`,`FUNCTIONAL`
uid	string?
versionId	integer
rules	array[object]
id	integer
nodeId	integer
rule	object
additionalPersistedColumns	array[string]
analyticsPipelineId	integer
anomalyStrengthThreshold	string?	Enum: `HIGH`,`MEDIUM`,`LOW`
archivalReason	string?
archived	boolean
autoCreated	boolean
autoRetries	integer
autoRetryEnabled	boolean
backingAssets	array[object]
customQuery	string?
customTableAssetIds	array[integer]
integer	integer
id	integer
marker
MarkerConfig	object
type	string
ruleId	integer
tableAlias	string?
tableAssetId	integer
tableAssetUid	string?
continueExecutionOnFailure	boolean
createdAt	object
createdBy	string?
deletionReason	string?
description	string?
enabled	boolean
engineType	string?	Enum: `SPARK`,`JDBC_SQL`,`POD`
executionSequence	integer
executionTimeoutInMinutes	integer
filter	string?
id	integer
includeInQualityScore	boolean
isCompositeRule	boolean
isProtectedResource	boolean
jobSchedule
JobSchedule	object
backingAssetId	integer
cronExpression	string
enabled	boolean
id	integer
marker
MarkerConfig	object
type	string
name	string?
scheduleType	string
tenantId	string?
timeZone	string
labels	array[object]
Label	object
key	string
labelType	string?	Enum: `ASSET`,`RULE`,`DQ_RULE_ITEM`,`RECONCILIATION_COLUMN_MAPPING`,`POLICY_TEMPLATE_MEASURE`,`USER_DEFINED_FUNCTION`
value	string
lastUpdatedBy	string?
leftCustomSqlConfig
CustomSqlConfig	object
columnMetadataList	array[object]
name	string
type	string
columnVariables	array[object]
format	string?
getOnlyWithVariableName	object
isNumber	boolean
name	string
value	string?
queryType	string
ruleVersion	integer
sanitizedQuery	string
sqlExpression	string
tableAlias	string?
markedForDeletion	boolean
markedForDeletionAt	integer
name	string
notificationChannels
NotificationPayload	object
alertsEnabled	boolean
configuredNotificationGroupIds	array[integer]
notifyOn	array[string]	Enum: `ERROR`,`WARNING`,`SUCCESS`,`ALL`
notifyOnSuccess	boolean
notifyOnWarning	boolean
reNotifyFactor	integer
severity	string?	Enum: `LOW`,`MEDIUM`,`HIGH`,`CRITICAL`
tags	array[string]
string	string
parentId	integer
policyGroups	array[object]
PolicyGroup	object
createdAt
DateTime	object
description	string?
id	integer
name	string?
tenantId	string?
updatedAt
DateTime	object
policyScoreStrategy	string	Enum: `CUSTOM`,`WEIGHTAGE`,`RULES`
policyTransformUDFS	array[object]
assetId	integer
columnNames	array[string]
string	string
id	integer
name	string
parameters	array[object]
isColumnVariable	boolean
key	string
value	string?
ruleId	integer
udfId	integer
resourceStrategyType	string?	Enum: `INVENTORY`,`CUSTOM`
rightCustomSqlConfig
CustomSqlConfig	object
columnMetadataList	array[object]
name	string
type	string
columnVariables	array[object]
format	string?
getOnlyWithVariableName	object
isNumber	boolean
name	string
value	string?
queryType	string
ruleVersion	integer
sanitizedQuery	string
sqlExpression	string
tableAlias	string?
rightEngineType	string?	Enum: `SPARK`,`JDBC_SQL`,`POD`
rightFilter	string?
rightSparkFilterSelectedColumns	array[string]
string	string
rightSparkSQLDynamicFilterVariableMapping
RuleSparkSQLDynamicFilterVariableMapping	object
mapping	array[object]
isColumnVariable	boolean
key	string
value	string?
ruleId	integer
ruleName	string
rightSparkSQLFilterType	string	Enum: `STATIC`,`DYNAMIC`
ruleSetId	integer
schedule	string?
scheduled	boolean
segments	array[object]
ShortSegment	object
id	integer
name	string?
type	string
selectedResourceInventory	string?
sparkFilterSelectedColumns	array[string]
string	string
sparkResourceConfig
SparkResourceConfig	object
additionalConfiguration	object?
*	string
databricks
DataBricksSparkResourceConfig	object
clusterDriverType	string?
clusterWorkerType	string?
maxWorkers	integer
minWorkers	integer
dataproc
DataprocSparkResourceConfig	object
clusterMasterType	string?
clusterWorkerType	string?
numMasterNodes	integer
numWorkerNodes	integer
invalidFields	array[string]
livy
LivySparkResourceConfig	object
driverCores	integer
driverMemory	string?
executorCores	integer
executorMemory	string?
numExecutors	integer
yunikorn
YunikornSparkResourceConfig	object
driverCores	integer
driverLimitCores	string?
driverMemory	string?
driverMemoryOverhead	string?
driverMemoryOverheadFactor	number
driverRequestCores	string?
executorCores	integer
executorLimitCores	string?
executorMemory	string?
executorMemoryOverhead	string?
executorMemoryOverheadFactor	number
executorRequestCores	string?
maxExecutors	integer
minExecutors	integer
sparkSQLDynamicFilterVariableMapping
RuleSparkSQLDynamicFilterVariableMapping	object
mapping	array[object]
isColumnVariable	boolean
key	string
value	string?
ruleId	integer
ruleName	string
sparkSQLFilterType	string	Enum: `STATIC`,`DYNAMIC`
subType	string?	Enum: `ASSET`,`SQL`
tags	array[object]
RuleTag	object
id	integer
name	string
ruleId	integer
tagId	integer
tenantId	string?
tenantId	string?
thresholdLevel
AbsoluteThresholdConfig	object
config
AboveConfigs	object
direction	string	Enum: `ABOVE`,`BELOW`,`RANGE`,`CHANGES_BY`,`DECREASED_BY`,`INCREASED_BY`
success	number
warning	number
success	number
type	string	Enum: `ANOMALY`,`RELATIVE`,`TIME_BASED`,`ABSOLUTE`
warning	number
timeZone	string
totalExecutionTimeoutInMinutes	integer
treatZeroRowsAsSuccess	boolean
type	string	Enum: `DATA_QUALITY`,`RECONCILIATION`,`EQUALITY`,`DATA_DRIFT`,`SCHEMA_DRIFT`,`DATA_CADENCE`,`PROFILE_ANOMALY`,`AUTO_ANOMALY`
updatedAt	object
version	integer

404

Node not found

Response

Pipeline Tags

GET

/torch-pipeline/api/tags

List all pipeline tags

Returns all tags used for categorizing pipelines and pipeline entities.

Auth

GET /torch-pipeline/api/tags

Responses

200

List of pipeline tags

No response body

Response

Pipeline Lineage

POST

/torch-pipeline/api/assets/{id}/lineage

GET

/torch-pipeline/api/assets/{id}/lineage

Create or update asset lineage

Creates or updates the lineage information for the specified asset.

Auth

Path Params

string

Asset ID

Request Body

Lineage data with upstream and downstream connections

PipelineLineageRequest	object
assetIds	array[integer]
direction	string	Enum: `UPSTREAM`,`DOWNSTREAM`
process
ProcessDetails	object
description	string?
name	string

POST /torch-pipeline/api/assets/{id}/lineage

Responses

200

Updated lineage

LineageResponse	object
graph	object
edges	array[object]
fromAssetType	string?	Enum: `ASSET`,`FUNCTIONAL`
fromId	integer
id	integer
toAssetType	string?	Enum: `ASSET`,`FUNCTIONAL`
toId	integer
versionId	integer
nodes	array[object]
canAddDownstreamLineage	boolean
canAddUpstreamLineage	boolean
canDelete	boolean
functionalNodeGroup	integer
lineage	string?	Enum: `UPSTREAM`,`DOWNSTREAM`
node	object
alertsCount	integer
assetId	integer
context	object?
*	object
createdVia	string	Enum: `PIPELINE_CREATION`,`MANUAL_ADDITION`,`QUERY_LOG_ANALYSIS`,`AUTO_DERIVED_ASSET`,`DEPENDS_ON_RELATION`,`CRAWLER_CREATION`
description	string?
id	integer
jobNodeMetric	array[object]
Metric	object
change	number
denominator	integer
name	string
type	string	Enum: `COST`,`DURATION`,`RECORDS_PROCESSED`,`RELIABILITY`
unit	string?
value	number
jobStatus	string?	Enum: `SUCCESS`,`ERROR`,`ABORTED`,`RUNNING`
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string?
parentId	integer
pipelineId	integer
reliabilityPolicySummary	array[object]
PolicySummary	object
aborted	integer
error	integer
policyType	string	Enum: `DATA_QUALITY`,`RECONCILIATION`,`EQUALITY`,`DATA_DRIFT`,`SCHEMA_DRIFT`,`DATA_CADENCE`,`PROFILE_ANOMALY`,`AUTO_ANOMALY`
success	integer
total	integer
status	string	Enum: `ACTIVE`,`STALE`,`DELETED`
type	string	Enum: `ASSET`,`FUNCTIONAL`
uid	string?
versionId	integer
remainingColumnCount	integer

403

Insufficient permissions

Response

Get lineage for an asset

Returns the upstream and downstream lineage graph for the specified asset, showing data flow through pipelines and transformations.

Auth

Path Params

string

Asset ID

GET /torch-pipeline/api/assets/{id}/lineage

Responses

200

Asset lineage graph

LineageResponse	object
graph	object
edges	array[object]
fromAssetType	string?	Enum: `ASSET`,`FUNCTIONAL`
fromId	integer
id	integer
toAssetType	string?	Enum: `ASSET`,`FUNCTIONAL`
toId	integer
versionId	integer
nodes	array[object]
canAddDownstreamLineage	boolean
canAddUpstreamLineage	boolean
canDelete	boolean
functionalNodeGroup	integer
lineage	string?	Enum: `UPSTREAM`,`DOWNSTREAM`
node	object
alertsCount	integer
assetId	integer
context	object?
*	object
createdVia	string	Enum: `PIPELINE_CREATION`,`MANUAL_ADDITION`,`QUERY_LOG_ANALYSIS`,`AUTO_DERIVED_ASSET`,`DEPENDS_ON_RELATION`,`CRAWLER_CREATION`
description	string?
id	integer
jobNodeMetric	array[object]
Metric	object
change	number
denominator	integer
name	string
type	string	Enum: `COST`,`DURATION`,`RECORDS_PROCESSED`,`RELIABILITY`
unit	string?
value	number
jobStatus	string?	Enum: `SUCCESS`,`ERROR`,`ABORTED`,`RUNNING`
meta
Meta	object
codeLocation	string?
owner	string?
team	string?
name	string?
parentId	integer
pipelineId	integer
reliabilityPolicySummary	array[object]
PolicySummary	object
aborted	integer
error	integer
policyType	string	Enum: `DATA_QUALITY`,`RECONCILIATION`,`EQUALITY`,`DATA_DRIFT`,`SCHEMA_DRIFT`,`DATA_CADENCE`,`PROFILE_ANOMALY`,`AUTO_ANOMALY`
success	integer
total	integer
status	string	Enum: `ACTIVE`,`STALE`,`DELETED`
type	string	Enum: `ASSET`,`FUNCTIONAL`
uid	string?
versionId	integer
remainingColumnCount	integer

403

Insufficient permissions to view lineage

Response