Bring Your Own LLM
Bring Your Own LLM (BYOLLM) lets you configure your organization’s large language model providers for use with ADM. You can connect a provider directly or connect through an enterprise LLM gateway.
ADM provides the agents and tools that support data-management tasks. The configured model interprets requests and participates in those workflows, such as discovering assets, investigating data-quality issues, and coordinating actions.
Before you begin
Prepare the following information before configuring a provider:
Access to ADM Settings and permission to configure LLM providers.
Credentials for the provider or gateway, and access to the models you intend to use.
The applicable endpoint, region, deployment name, or model identifier.
For a gateway connection, the authentication details and any additional headers supplied by your gateway administrator.
Confirm with your administrator that the ADM environment can reach the required provider and authentication endpoints. Use a provider and model approved for the data your organization will process.
Access LLM settings
From the home page, select Settings in the left navigation menu.
Select the ADM Settings tab.
Select LLM Settings.
Open the LLM Providers panel and start a New Provider configuration.
The AI Model page displays the available models, including models associated with configured custom providers.
Enter provider details
Select a Provider Type, then enter the provider details.
The available provider types are AWS Bedrock, Azure OpenAI, OpenAI, Anthropic, and LLM Gateway.
Field | Required | Description |
|---|---|---|
Provider Name | Yes | A name that identifies this provider configuration in ADM. Use a descriptive name, such as |
Description | No | Additional information about the provider, such as its purpose, environment, or intended use. |
Credentials | Depends on the provider | The authentication and connection settings ADM uses to access the selected provider. The fields change according to the provider and authentication method. |
Do not enter passwords, API keys, or other secrets in Provider Name, Description, or model display names.
Configure provider credentials
AWS Bedrock
Select AWS Bedrock to configure access to models through Amazon Bedrock.
Under Credentials, select a Bedrock authentication method.
Authentication method | Description |
|---|---|
Direct AWS IAM | Authenticate using an AWS access key ID and secret access key. When using temporary AWS credentials, also provide the associated session token. |
Custom AI gateway | Connect through a gateway that accepts AWS Bedrock Runtime API requests. Authenticate with gateway HTTP headers; AWS access keys are not used. |
Direct AWS IAM
Select Direct AWS IAM and complete the following fields.
Field | Required | Description |
|---|---|---|
AWS Access Key ID | Yes | The access key ID for the AWS identity used to access Amazon Bedrock. |
AWS Secret Access Key | Yes | The secret access key associated with the access key ID. Enter the matching key pair. |
AWS Session Token | Conditional | The session token associated with temporary AWS credentials. Although the form labels this field optional, it is required when the access key ID and secret access key belong to a temporary session. |
AWS Region | Yes | The AWS Region used for the Bedrock connection, such as |
AWS temporary credentials consist of an access key ID, a secret access key, and a session token. The credentials expire, so ensure that the values supplied to ADM remain valid.
The AWS identity must have permission to invoke the configured models. Depending on the API operations used, this includes bedrock:InvokeModel and, for streaming inference, bedrock:InvokeModelWithResponseStream. Additional requirements can apply to the selected Bedrock inference configuration.
After configuring authentication, add the models that ADM will access through this provider.
Azure OpenAI
Select Azure OpenAI to connect to your organization’s Azure OpenAI resource.
Field | Required | Description |
|---|---|---|
API Key | Yes | An API key for the Azure OpenAI resource associated with the endpoint. |
Azure Endpoint | Yes | The endpoint of that Azure OpenAI resource, for example, |
API Version | No, in the form | The Azure OpenAI API version used for requests. This identifies an API version, not the underlying model version. Use a value supported by your ADM integration and Azure deployment. |
Azure OpenAI API keys and resource endpoints are available from the resource’s Keys and Endpoint settings. Versioned Azure OpenAI APIs use an api-version parameter.
Model identifier: Azure OpenAI requests use the model’s deployment name. When adding an Azure model, enter the deployment name expected by your endpoint in Model ID. A deployment name can differ from the underlying model’s name.
OpenAI
Select OpenAI to configure a direct OpenAI API connection.
Field | Required | Description |
|---|---|---|
API Key | Yes | An OpenAI API key authorized to make model requests for the applicable organization or project. Use an application API key, not an administration-only key. |
Obtain the key from your organization’s OpenAI API account. Keep it confidential and confirm that the associated project can access the intended models.
Under Models, enter the API model identifiers you intend to use.
Anthropic
Select Anthropic to configure a direct connection to the Claude API.
Field | Required | Description |
|---|---|---|
API Key | Yes | An Anthropic API key authorized to access the intended models and workspace. |
Obtain the key from the Anthropic Console. A direct Anthropic connection uses Anthropic credentials; accessing Claude through a cloud provider uses that provider’s authentication instead. For example, configure AWS Bedrock when using Claude through Bedrock.
Under Models, enter the Claude API model identifiers available to the account.
Configure an LLM Gateway
What is an LLM gateway?
An LLM gateway sits between an application and its model services. ADM sends requests to the gateway, which routes them to the model configured behind that endpoint.
Depending on its implementation, a gateway can centralize authentication, access policies, request routing, usage monitoring, and quotas. These capabilities are configured in the gateway; creating a connection in ADM does not itself enable them.
OpenAI-compatible describes the interface exposed by the gateway, not necessarily the company that hosts the underlying model. A gateway can expose multiple providers through an OpenAI-compatible interface.
Gateway compatibility requirements
For the LLM Gateway provider, ADM calls the Chat Completions API, not the Responses API. Requests use the following path:
Set Gateway endpoint to the gateway's API base URL, including any required base path. ADM appends /chat/completions; do not include that operation path in the field.
The gateway and selected model must support the following capabilities for full ADM functionality.
Capability | Requirement |
|---|---|
Streamed responses | Support streamed responses from the Chat Completions API. |
Tool calling | Support tool calling with ADM's parallel_tool_calls: true request setting. |
Structured output | Support response_format with a JSON schema. |
Structured-output warning: If structured output is not supported, Test Connection shows a warning rather than a failure. ADM features that require structured replies may not work with that gateway and model.
A successful basic text-generation request alone does not establish compatibility. After selecting the configured model on the AI Model page, validate the ADM workflows you intend to run.
Choose an authentication method
Select LLM Gateway, then choose an Authentication method.
Authentication method | Use when |
|---|---|
OAuth client credentials | Your organization provides a token endpoint that issues access tokens using an application’s client ID and client secret. |
Bearer token (static) | Your organization provides an access token to supply directly, without a client-credentials token exchange. |
OAuth client credentials is an application-to-application authentication flow. It authenticates the application rather than requiring an individual user to sign in for each request.
OAuth client credentials
Complete the following fields when OAuth client credentials is selected.
Field | Required | Description |
|---|---|---|
Gateway endpoint | Yes | The model API endpoint supplied by your gateway administrator for the ADM integration. This is different from the token endpoint. |
Token URL | Yes | The identity provider endpoint that issues access tokens. |
Client ID | Yes | The identifier of the application authorized to request tokens for the gateway. |
Client secret | Yes | The secret associated with that application. |
Scope | Depends on the identity provider | The resource or access scope requested during authentication. Obtain the exact value from your identity or gateway administrator. |
Microsoft Entra ID scope
For the Microsoft Entra ID v2 client-credentials flow, Scope is required.
Use the target resource’s application ID URI followed by /.default. For a gateway registered with an api:// application ID URI, the value has this form:
The identifier must refer to the gateway API resource you are requesting access to. It is not necessarily the same as the client application’s Client ID. Other resource URI formats are possible, so use the value supplied by your administrator. A missing or incorrect scope can prevent token issuance.
Bearer token authentication
Select Bearer token (static) when your gateway administrator supplies an access token directly. Provide the gateway endpoint and the token in the fields displayed for this authentication method.
This method uses an existing token instead of obtaining one through a client ID and client secret. “Static” describes how the token is supplied; it does not mean the token is valid indefinitely. Arrange replacement according to your organization’s token-expiration and rotation requirements.
Additional headers
Use Additional headers when the gateway requires secret headers in addition to the selected authentication method.
Select Add header and enter the header name and value provided by your administrator. For example:
Header name | Header value |
|---|---|
|
|
The configured headers are sent with gateway requests. Leave this section blank when no additional headers are required.
Treat header values as credentials. Do not enter these secrets in model request parameters.
Add models
Use the Models section to define the models available through the provider. Select Add Model to add another model entry.
Field | Required | Description |
|---|---|---|
Model ID | Yes | The identifier the selected provider or gateway expects when invoking the model. |
Display name | Yes | The user-facing name used to identify the model in ADM. Use a name that makes the intended model or use clear. |
The Model ID and Display name serve different purposes. Changing the display name does not change which model is invoked.
Use the identifier appropriate to the connection:
Provider | Model ID guidance |
|---|---|
AWS Bedrock | Use the model or inference identifier required by the Bedrock configuration. Do not assume a direct provider’s model ID is interchangeable with a Bedrock ID. |
Azure OpenAI | Use the deployment name expected by the Azure endpoint. |
OpenAI | Use the model’s OpenAI API identifier. |
Anthropic | Use the model’s Claude API identifier. |
LLM Gateway | Use the model identifier or alias exposed by the gateway. Obtain it from your gateway administrator. |
Model identifiers can differ across platforms, even for the same underlying model. Azure additionally distinguishes a deployment name from the underlying model name.
Gateway model request parameters
For an LLM Gateway model, Request parameters (JSON) lets you specify optional request-body parameters for that model.
The form specifies a default of:
Values you supply override the corresponding defaults. For example, when supported by your gateway and model:
Enter valid JSON and use only parameters accepted by the gateway and underlying model. Parameter support differs between models and API versions.
A maximum-token setting is a generation limit, not an estimate of actual usage. It does not mean every request consumes that many tokens, and it does not cap the combined usage of a workflow that makes multiple model requests. Reasoning models can also count non-visible generated tokens toward output limits.
Set the default provider, test, and save
Optionally, select Set as default provider to mark this provider as Default in the provider list and list it first. This does not select a model or change which model ADM uses.
Optionally, select Test Connection to check the configuration without leaving the form. Review the result and correct any reported configuration issues.
Select Create Provider to save the provider. Saving also runs a connection check in the background, whether or not you manually selected Test Connection. Select Cancel to leave the form without creating the provider.
Select the model ADM uses
Creating a provider does not change the model ADM uses. ADM uses the model selected on the AI Model page. If the Acceldata-provided model is selected, ADM continues to use it until an administrator selects the new model.
Important: Model selection applies to all users and requires the same permission as configuring providers.
Return to the AI Model page under Settings > ADM Settings > LLM Settings.
Select the model under your provider's name.
Validate representative ADM tasks with the selected model.
Treat connection testing and workflow validation as separate checks: do not use a connection result alone as evidence of model certification.
Choose a provider and model
Provider selection and model selection are different
Choose the provider according to your organization’s approved infrastructure, authentication, network, regional, and commercial requirements.
Choose the model according to the quality, tool-calling capability, response time, and cost required by the workload. Cloud-hosted and direct-provider offerings can differ in feature availability and pricing.
There is no universal provider choice that guarantees the lowest token consumption.
Recommended selection approach
Start with a model that has been validated for your ADM release and intended workflows. Establish a quality baseline, then evaluate less expensive alternatives against the same tasks.
For quick summaries and reformatting, evaluate a faster, lower-cost model. For root-cause analysis and multi-step investigations, prioritize reasoning quality and reliable tool use. This distinction is consistent with Acceldata’s published ADM model-selection guidance.
Compare cost per successfully completed task, not only price per token. A lower token rate is useful only when the model meets the task’s accuracy and reliability requirements.
Model certification
Support for a provider type does not establish that every model available through that provider has been certified for ADM.
Before production use, confirm the validated combination of ADM release, provider, model identifier, and configuration with Acceldata. A successful connection test is not a substitute for workflow validation.
Examples for a model evaluation
The following are evaluation candidates and pricing references—not an Acceldata-certified model list.
Prices below are published standard direct-API rates checked on September 24, 2026, in USD per million tokens. The OpenAI values shown use short-context rates.
Candidate model | Suggested evaluation focus | Input | Output |
|---|---|---|---|
Claude Sonnet 5 | A general-purpose reference candidate for balancing quality and response time. | $2.00 | $10.00 |
Claude Haiku 4.5 | A lower-cost candidate to test on simpler or well-bounded tasks. | $1.00 | $5.00 |
GPT-6 Sol | A general-purpose candidate, subject to compatibility with the ADM connector’s API and tool-calling configuration. | $2.00 | $10.00 |
GPT-6 Luna | A lower-priced candidate to evaluate against the same quality and tool-use requirements. | $0.10 | $0.50 |
The model descriptions and rates above come from the providers’ documentation; the suggested evaluation roles are starting points, not ADM benchmark results.
Check API compatibility before proposing a model. For example, GPT-6 Sol and Luna support function calling through Chat Completions only when reasoning is disabled; reasoning-enabled tool workflows use the Responses API. This must match the ADM integration.
Actual charges can differ with hosting provider, processing tier, context length, caching, regional processing, and negotiated terms. Use the rates applicable to your connection rather than assuming direct-API prices apply everywhere.
Understand token consumption
What contributes to usage?
Token consumption is not limited to the text entered by the user or the final answer displayed in ADM.
Component | How it can contribute |
|---|---|
Instructions and conversation context | Instructions, user messages, and conversation content sent to the model contribute input tokens. |
Tool definitions | Tool names, descriptions, and schemas supplied to the model contribute input tokens. |
Tool calls and results | Generated tool-call arguments contribute output; results sent back to the model contribute input. |
Retrieved context | Asset information, metadata, documents, or other content included in a model request contributes input tokens. |
Generated responses | Intermediate and final model responses contribute output tokens. |
Reasoning tokens | Some models generate non-visible reasoning tokens that are included in billable output usage. |
Provider documentation explicitly accounts for tool definitions, tool-call content, and tool results in token usage. OpenAI also documents that reasoning tokens are billed as output tokens.
Running an ADM tool is not, by itself, a fixed LLM-token charge. The model-facing descriptions, arguments, results, and subsequent model calls are what contribute to LLM usage.
Are tokens fixed because ADM uses a defined set of tools?
No. ADM supplies the tools and workflow, but that does not make token consumption fixed.
Even with the same available tools, usage can differ because of the amount of context supplied, the number of model calls, the size of tool results, and the model’s generated output. Models can also use different tokenizers, so identical text does not necessarily produce identical token counts.
The distinction is:
Token consumption is how many tokens the workflow actually uses.
Token cost is what the provider charges for those tokens.
A lower-priced model can reduce cost, but it should be compared using actual task usage and completion quality—not an assumption that every model consumes the same number of tokens.
Estimate usage and cost
Establish a workload-based estimate
Use a pilot workload that represents the customer’s expected usage. For each task, record the provider and exact model, all model calls, input and output usage, task completion, and response time.
Measure complete tasks rather than only individual chat messages. A single user request can require several model calls in a tool-driven workflow.
A useful measurement report separates task types, such as asset discovery, data-quality investigation, and multi-step analysis. Report average usage and a higher-usage percentile, such as the 95th percentile, so the customer can see both typical and heavier executions.
Where available, token-counting APIs can help estimate input size before execution. They do not predict the full output or all future calls in an agent workflow; actual usage records remain necessary for a reliable task estimate.
Calculate token cost
For standard uncached text requests:
Sum usage across every model call involved in the task.
For cached requests, calculate the applicable cache categories at their respective rates. Include any gateway or other service charges separately. When reasoning tokens are already included in reported output tokens, do not add them again.
Worked example
The following values are hypothetical. They explain the calculation and are not measured ADM consumption estimates.
Assume a task makes three model calls:
Model call | Input tokens | Output tokens |
|---|---|---|
Call 1 | 4,000 | 300 |
Call 2 | 6,500 | 500 |
Call 3 | 9,000 | 1,200 |
Total | 19,500 | 2,000 |
At an assumed input rate of $2 per million tokens and output rate of $10 per million tokens:
One thousand tasks with exactly that usage would cost $59 in model-token charges, excluding other charges.
This is an arithmetic example, not a forecast. Replace the assumed usage and rates with measurements and pricing from the customer’s deployment.
Reduce cost without compromising task quality
Evaluate less expensive models against the same acceptance criteria. Keep requests focused on the relevant assets, time range, and output, and avoid requesting unnecessary detail.
Where supported by the integration, model, and provider, output limits and caching can also help control spending. Verify the effect using measured task cost rather than assuming a configuration change produces a particular saving.
For additional help, contact www.acceldata.force.com OR call our service desk +1 844 9433282
Copyright © 2025