research30 min studyLesson 906 in Engineering

Step accuracy alone does not determine long-horizon execution reliability

Use conditional probabilities and dependence bounds, distinguish flawless paths from recovered outcomes, and test shared failure modes across extended executions.

On this page

What you’ll understand

  • Distinguish a chain-rule identity from the iid product approximation.
  • Compare long-horizon perfect-path probabilities under different error dependence.
  • Evaluate recovery and early termination without conflating local errors with final task failures.

An agent that performs well on individual steps can still struggle on a long task, but multiplying one average accuracy by itself is only one model of that problem. Errors can share a cause, cluster after a bad observation, or be repaired by later checks. The event every local step was correct differs from the event the requested task was eventually completed within its constraints. Define both and measure conditional failure and recovery behavior before presenting a simple independence calculation as a prediction of complete execution reliability.

The chain rule is exact; equal independent step probabilities are an assumption

For a fixed horizon, the probability that every local check passes can be written as a product of conditional probabilities given all earlier passes. Replacing every conditional factor with one marginal accuracy assumes additional structure. An action changes the environment and the agent's later observations, so errors are often not independent identical events. A wrong account selection can affect every later action; a transient rate-limit response can trigger a recovery branch. An average measured only on easy successful prefixes is especially poor evidence for later difficult states.

Long-horizon benchmarks such as WebArena and AgentBench expose multi-step execution problems, but their results do not justify a universal per-step error law. Define the event unit: tool call correctness, subgoal completion, monitored property, or final outcome. A harmless exploratory action need not have a unique correct label. Fixed-horizon reasoning is easiest in controlled examples; real early termination leaves later opportunities unobserved. Do not count missing later steps as correct or estimate all conditional probabilities from the selected subset of trajectories that survived far enough.

P ⁣(⋂t=1HEt)=∏t=1HP ⁣(Et∣⋂j<tEj)P\!\left(\bigcap_{t=1}^{H}E_t\right)=\prod_{t=1}^{H}P\!\left(E_t\mid\bigcap_{j<t}E_j\right)
E_t is a specified local pass at opportunity t in a fixed positive horizon H; the empty-prefix event has probability one and conditional terms need meaningful nonzero conditioning events. This chain-rule identity is dimensionless. Replacing the factors by a constant p to obtain p^H requires additional assumptions.↔ Scroll wide equations horizontally.

The same marginal errors can produce very different execution tails

Without a dependence model, marginal error probabilities imply only bounds on the chance of some error. Perfectly shared errors can occur together in a small fraction of episodes, leaving many flawless episodes but severe failures in the affected ones. Errors spread across disjoint episodes can instead ensure that nearly every episode has at least one. Independence lies between those possibilities in many examples. Therefore positive correlation does not automatically lower every perfect-path probability relative to independence, even though common-cause failures can be especially damaging for particular tasks and risk criteria.

Linearity of expectation still gives an expected error count from valid marginal probabilities without requiring independence. That count does not determine the probability of zero errors, the severity of an error, or whether recovery succeeds. Separate local detect-and-repair behavior from irreversible effects and final constraints. A confirmation step can reduce some failures while adding work and a new potential failure mode. Evaluate the actual recovery policy and its resource budget rather than multiplying a detector's and repairer's marginal accuracies without conditional or joint evidence.

max⁡ ⁣(0,1−∑t=1Hqt)≤P(no local error)≤1−max⁡tqt\max\!\left(0,1-\sum_{t=1}^{H}q_t\right)\le P(\text{no local error})\le1-\max_t q_t
q_t are marginal probabilities of defined local errors at H fixed opportunities. These complement-of-union bounds need no independence, use dimensionless probabilities, and can be loose. They do not equate a local error with final task failure or model recovery severity.↔ Scroll wide equations horizontally.

Measure failure mechanisms, recovery, and horizon together

Stratify evaluations by task structure and opportunity count while preserving full outcomes and budgets. Inspect whether failures concentrate after shared observations, a tool-schema change, or a common policy misconception. Report time to first decisive failure and successful recovery frequency with explicit denominators. Longer traces can have more opportunities for error but also reflect harder tasks or inefficient policies, so an uncontrolled relation between length and failure is not a causal law. Use controlled interventions or matched tasks when assessing the effect of adding a verification or recovery stage.

The Markov lab supplies one explicit absorbing-failure model. Reset, explicitly set BOTH p=0.1 and q=0, predict state-one probability 0.3439 after four transitions, then Play or Step four times to t=2. Reset and re-set BOTH p=0.2 and q=0; predict 0.5904. Both start in state zero; n=min(2000000,floor(2 t)), and edits retain t. State one is absorbing only because q=0. This exact discrete chain assumes its transition law; it is not an agent, arbitrary correlated-error process, or proof that real task success follows the same hazard.

Equal marginal error rates do not fix perfect-path probability

Consider ten defined local opportunities, each with marginal error probability 0.1. Compare an iid error model with a shared-mode model in which all ten errors occur together on ten percent of episodes and none occur on the rest.

  1. Under independent errors, perfect-path probability is 0.9¹⁰≈0.3487. Expected error count is 10×0.1=1.

  2. Under the shared-mode model, perfect-path probability is 0.9, while expected error count is 0.1×10+0.9×0=1. Identical marginal rates and expected counts coexist with very different episode behavior.

  3. The dependence-free bounds are max(0,1−10×0.1)=0 and 1−0.1=0.9. A model assigning exactly one error to every episode, uniformly across ten positions, attains the lower bound. None of these perfect-path figures alone determines the final outcome when recovery is allowed.

The result

A long-horizon reliability claim needs the event definition, dependence structure, severity, and recovery policy rather than one averaged step score.

Explore the model

Interactive lab

Interactive lab · markov

An explicit absorbing model makes its hazard assumption visible

For EACH run Reset, set BOTH p and q, predict, then Play or Step four times to t=2/n=4. Starting at 0 with q=0, p=0.1 gives P(state 1)=0.3439 and p=0.2 gives 0.5904. Edits retain t; n is capped at 2000000. This discrete chain has no agent policy, variable horizon, recovery with q=0, or arbitrary correlated-error mechanism.

An explicit absorbing model makes its hazard assumption visibleExact finite-step probabilities for a two-state chain starting in state 0, not sampled trajectories. Playback advances two transitions per second. When p = q = 0 every distribution is stationary; when p = q = 1 the chain alternates forever. A single zero transition creates an absorbing state. Current readings: P(state 1) at step 0: 0%; Stationary P(state 1): 60%; Chain behavior: Monotone convergence. All parameters are adjustable with the labeled controls below.Two-state Markov distribution after 0 steps: state zero probability 1, state one probability 0.Initial distribution (1, 0) · step 0p = 0.3q = 0.201100%0%1−p1−qP(0)P(1)Monotone convergence
P(state 0)P(state 1)Stationary distribution
P(state 1) at step 0
0%
Stationary P(state 1)
60%
Chain behavior
Monotone convergence
t = 0 s

Exact finite-step probabilities for a two-state chain starting in state 0, not sampled trajectories. Playback advances two transitions per second. When p = q = 0 every distribution is stationary; when p = q = 1 the chain alternates forever. A single zero transition creates an absorbing state. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forA simple long-horizon formula is a model with explicit transition assumptions, not a consequence of marginal accuracy alone.

Check your understanding

Two fixed-horizon systems have the same marginal error rate at every step. What follows about their probability of a flawless episode?

Try it yourself

Five local opportunities each have marginal error probability 0.1. Give the dependence-free bounds on no-error probability and the iid value. Does a local error necessarily imply failure of a task with a valid repair stage?

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Use the union bound's complement and the maximum marginal error, then distinguish local checks from the final goal.

Compare with the solution

Bounds are max(0,1−0.5)=0.5 and 1−0.1=0.9. The iid value is 0.9⁵=0.59049. A local error need not imply final task failure if the defined repair stage restores the required state within constraints; that repair behavior needs its own conditional outcome evidence.

Take it with you

  • The chain rule and an iid constant-accuracy product are different levels of assumption.
  • Marginal error rates and expected counts do not determine episode-level dependence or severity.
  • Perfect-path, recovery, and final-outcome metrics need separate event definitions.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.