Unify Logo Footer.svg
AI Governance
Logo
Outcome Data Model

Outcome Data Model

Logo

3 mins READ

Introduction

An outcome is a small object with one big responsibility: it is the only place in AI Governance where agent activity is converted into money.

Three parts — a definition, a set of sources, and a report computed over a window.

The three parts

Part

What it holds

Who sets it

Definition

Name

You, once

Sources

Each agent credited, with how it is verified and what each counted session is worth

You, per agent

Report

Counts, value, spend and return over a window

Computed

The split matters: the definition is only a name, and everything that decides counting and value lives on each source. Two agents on one outcome can be verified differently and can be worth different amounts.

The definition

Field

Type

Notes

Outcome name

String

Names the result, not the activity. Appears in the list and on the chart.

Created by

User

Shown as the outcome's owner. There is no Owner field to set.

A source

A source is an agent credited with producing the outcome, plus the rule that decides when one of its sessions counts.

Field

Values

Agent

Any registered agent

How it is verified

Rule, AI judge or Automation

Conditions (rule)

One or more, combined with When all or When any

Judge model (judge)

The model that grades the output — text-generation models only

Pass score threshold (judge)

Slider from 0 to 1, default 0.85. Sessions scored below it do not count

Evaluation criterion (judge)

Plain-language description of what a passing output looks like

Recorded by (automation)

An automation built on the outcome callable interface; optionally Also record the outcome value from this automation

What it is worth

A set amount (every counted session books the same figure) or An automation prices it

Each source carries its own rule, because two agents can reach the same result by different paths. One might call a ticketing tool; another might be judged on the quality of its reply.

Condition grammar

A rule condition is entity + target + operator + value.

Entity

Targets

Operators

Tool

A named tool

succeeded, failed, was called, wasn't called, result contains, result doesn't contain

Evaluator

An evaluator bound to the agent

is at least, is at most, is present

Trace text

Output text, Input text

contains, doesn't contain, is present

Trace tag

Trace tag

is, is not, is present

The Evaluator entity is the interesting one: it lets a quality score gate a value claim, so an outcome only counts when the work was also good enough. That is the join between Evaluation and ROI, and it is the strongest rule you can write.

The report

Computed over the selected window, never stored per occurrence.

Figure

Derivation

Total outcomes

Sessions that met a source's rule

Total value

Counted sessions × what each is worth

Total spend

Spend of the crediting agents, from trace data

Net value

Total value − total spend

Return on spend

Total value ÷ total spend

Verdict

Net positive, Break even or Net negative

The overall strip also carries an unmeasured spend figure — spend not attributed to any outcome. It has its own Unmeasured spend tile.

Known limitations

  1. Changing a value needs announcing — If somebody has already reported a figure, it may not reconcile after you change what a session is worth.

  2. Counting is per session, not per trace — A session where the rule matched counts once, however many turns it took.

  3. Rules read what the session carries — A rule referencing a renamed tool silently stops counting. Nothing warns you.

  4. Return on spend divides by the spend of credited agents — Agents crediting no outcome contribute cost to your bill and not to this ratio.

FAQs

Can one agent credit two outcomes?

Yes. It appears as a source on both, with a separate rule on each.

Is the count recomputed if I change a rule?

The report is computed over the window, so a changed rule changes what the window reports.

Why is my outcome showing no value?

Either no session met the rule, or the agent's What it is worth is not set. Check the count first.