Acceldata
 AIO
Search documentation… ⌘K

Last updated: Oct 07, 2026 11:33 UTC

Create a rule

This page shows you how to create a rule from a built-in template and how to turn it on or off afterward.

Prerequisites

  • You need permission to modify the project the rule watches. Without it, the + New rule button doesn't appear. For details, see Project permissions.
  • The project must already exist. To set one up, see Create a project.

Pick a template

  1. Go to the Rules page of your project.

The Rules page for a project, listing its rules with their severity, sampling, recent failures, and status

  1. Select + New rule. The New rule page opens with the template catalog.
  2. Find the template you want. You can:
  • Enter a name, key, or description in Search templates.
  • Select a kind: All kinds, Deterministic, Aggregate, Judge, or Classifier.
  • Select a category in the Category list.

Each card shows the template's name, default severity, key, description, unit, and check kind. To learn what units and check kinds mean, see the rules overview.

The New rule page, showing template cards grouped by category, with search, kind filters, and a category list

  1. Select the template's card, or select Configure › on it. The Configure rule page opens.

Configure and enable the rule

The header of the Configure rule page shows the template name, its key, unit, and check kind, and its description. An aside called How this rule evaluates (read-only) shows the logic the template uses to decide whether the rule applies and when it fails. You can't change that logic. For judge rules, the aside also shows the prompt the judge uses. Select Show full prompt › to read the whole prompt.

The Configure rule page, with fields for name, project, severity, sampling, and template parameters next to the read-only evaluation details

  1. For Name, keep the suggested name or enter your own. The suggestion is the template name followed by the project slug, for example Empty output — checkout.
  2. For Project, choose the project this rule watches. A rule watches exactly one project.
  3. For Severity, select LOW, MEDIUM, HIGH, or CRITICAL. The template's default severity is selected at first. If the template has none, MEDIUM is selected.
  4. For Sampling, enter a percentage from 1 to 100. The default is 100. Aggregate rules don't show this field.
  5. Fill in the template's parameters. For details, see Fill in parameters.
  6. Select Save & enable. The button reads Saving… while the rule saves.

The rule is saved and turned on right away. You return to the Rules page, filtered to the rule's project. Evaluation starts within about 30 seconds.

To leave without saving, select Cancel. You return to the template catalog.

Fill in parameters

Each template declares its own parameters. Each template's page in the rules catalog lists its parameters and their defaults, for example Banned term in output.

  • Each field label shows the parameter's name and whether it's required or optional.
  • Fields that take a regular expression add · RE2 regex to the label. Enter a pattern in RE2 syntax.
  • A description appears under each field, followed by examples. Select an example to put it in the field.
  • Fields start with the template's default values. Some required fields, such as Banned terms, have no default, so you must enter a value.
  • If the template has no parameters, the page shows "Nothing to configure — this template has no parameters."

Turn a rule on or off

Turning off a rule stops evaluation, but the rule and its findings stay. The change takes effect within about 30 seconds.

To turn a rule on or off from the rules list:

  • On the Rules page, in the Status column, turn the rule's switch on or off. The switch label reads on or off.

To turn a rule on or off from its edit page:

  1. On the Rules page, select the rule's name. The Edit rule page opens.

The Edit rule page, showing the rule's settings, its version, and its enabled or disabled state

  1. In the Danger zone, select Disable or Enable.

You only see the switch and the Danger zone if you have permission to modify the rule's project.

Troubleshooting

Errors when you save

Error messages appear after you select Save & enable.

Message

What to do

"Pick the project this rule watches."

Choose a project for Project.

"The rule needs a name."

Enter a Name.

"Sampling is a percentage from 1 to 100."

Enter a whole percentage between 1 and 100 for Sampling.

"Banned terms is required."

Enter a value for the named parameter.

"Latency budget (ms) must be a whole number."

Enter a number without decimals.

"Percent increase to alert on must be a number."

Enter a number.

"Maximum characters must be at least 1."

Enter a larger value.

"Percent increase to alert on cannot exceed 1000."

Enter a smaller value.

If the server rejects the rule, its reasons appear under "The rule was not saved". For example:

  • "a rule named 'Empty output — checkout' already exists — edit it instead of creating it again": choose another name, or open the existing rule from the Rules page and edit it.

Judge or classifier rule stays pending

Judge and classifier rules use a model to check your traffic. They run only when AIO has a model API key configured for them. Without one, their results stay "pending". Ask your administrator to configure the key.

Next steps