FC Health Index1,428.60+0.42%Novo NordiskDKK 812.4+1.10%Intuitive SurgicalUSD 546.9−0.30%EU AI Act — Art. 6in forceM+7FDA 510(k) AI clearances (YTD)312+18 w/wNHS AI Diagnostic Fund£123mcommittedKarolinska trials open48+2Reimbursement CPT codes (AI)17+1 QFC Health Index1,428.60+0.42%Novo NordiskDKK 812.4+1.10%Intuitive SurgicalUSD 546.9−0.30%EU AI Act — Art. 6in forceM+7FDA 510(k) AI clearances (YTD)312+18 w/wNHS AI Diagnostic Fund£123mcommittedKarolinska trials open48+2Reimbursement CPT codes (AI)17+1 Q
Friday, 18 September 2026 · Oslo · London · New York

Research note

Why completion rates fall faster than step counts rise

What does the arithmetic of sequential tool calls imply for agent deployments?

Aleksi Virtanen · Edited by Dr. Annika Holm, PhD · Published 2026-09-14 · Last reviewed 2026-09-16

Evidence base

Published agent benchmark literature and the elementary arithmetic of compound probability.

If each step of an agent task succeeds independently with probability p, a task requiring n steps succeeds with probability p to the power n. The consequence is unintuitive until it is written down: a per-step success rate that sounds excellent produces a poor end-to-end rate once a chain runs to twenty steps.

At a per-step rate of 0.99, a four-step task completes about 96 percent of the time and a twenty-step task about 82 percent. At 0.95 per step, the same two figures are roughly 81 percent and 36 percent. The model has not become worse. The chain has become longer.

Real failures are also correlated rather than independent, which usually makes matters worse than the arithmetic suggests. An ambiguous identifier resolved incorrectly at step three is not an isolated error; every subsequent step operates on the wrong record and does so correctly.

This is why the design advice that survives contact with production is unglamorous: shorten chains, checkpoint state so a retry does not repeat an early error, verify intermediate results where verification is cheap, and route irreversible actions through a human.

It also explains a persistent gap in perception. Demonstrations use short, clean chains, where the arithmetic is forgiving. Deployments use long, messy ones, where it is not.

What we cannot conclude

  • That any published per-step figure applies to a given organisation's systems.
  • That step count is the only driver. Tool quality, schema clarity and environment determinism all move the number.
  • That decomposition always helps; splitting a task introduces handover points that carry their own failure modes.

This note feeds into AI Agent Reliability Benchmark.