Acceldata
AIO

Last updated: Oct 06, 2026 15:44 UTC

This page explains what the Empty output rule checks, when it raises a finding, and how to set it up for a project.

Definition

Empty output (key empty_output) flags a model call that returned a blank completion. The call itself worked, but it returned no answer.

Property Value
Unit span (one model or tool call)
Check kind deterministic
Category Output integrity
Score type BOOL
Default severity MEDIUM
Parameters None

The rule checks LLM spans only, that is, spans where span.span_kind == 'llm'. Other spans, such as tool calls, get no result at all from this rule. They aren't counted as a pass or a skip.

For each LLM span, the rule fires when the completion has no characters:

size(span.output_preview) == 0

When the rule fires, it records a failed verdict. The result shows these details:

  • Observed value: the length of the output, which is 0.
  • Reasoning: "completion is empty".

Why it matters

A blank completion is a silent failure. The provider reports success, so error monitoring doesn't catch it. Your user still gets no answer. This rule finds those calls and links each finding to the trace that raised it.

What it requires

  • LLM spans in your telemetry. The rule only checks model calls. To send traces, see Instrument your code.
  • Permission to change rules in the project. To create the rule, you need permission to modify the project. For details, see Project permissions.
  • No model API key. This is a deterministic check. It makes no model calls, so it doesn't add model cost.

Configuration examples

This template has no parameters. Create the rule from the template catalog, then set its name, project, and severity. For the full procedure, see Create a rule.

To find the template on the New rule page, use any of these options:

  • In Search templates, enter empty_output or Empty output.
  • Select the Deterministic kind chip.
  • In the Category rail, select Output integrity.

The New rule page, showing the template catalog with kind chips, the Category rail, and template cards

A project can have one rule from this template. If you open the catalog from a project that already has one, the Empty output card is marked In use and you can't select it.

On the Configure rule page, the parameters area says this template has nothing to configure. The How this rule evaluates (read-only) panel shows the precondition and the predicate from the Definition section.

The Configure rule page for a template, with the Name, Project, Severity, and Sampling fields and the read-only evaluation panel

Here's a typical setup for a customer support assistant:

Field Example value
Name Empty output — support-bot (the default follows this pattern, with your project's slug)
Project Your project
Severity MEDIUM (the template default). Use HIGH if a blank answer reaches your users directly.

Select Save & enable to save the rule. Saving turns the rule on straight away.

On the Rules list, the Failed 24h column counts this rule's failed verdicts in the last 24 hours, and Last failed shows when it last failed.

To read the findings, check the Rules column on the step list or the Checks panel on a trace. To list only the traces where this rule failed, use the Rules filter on the trace list. For more information, see Explore traces.

Next steps