The Cascade Calculator
Drag sliders to set provider costs and success rates, then read the profit margin curve. Cascade routing beats expensive-only once the cheap model resolves more than the crossover fraction of queries.
⬢ loading artifact…
Appears in
The Inference Spread: LLM Routing Arbitrage and the Pricing Problem for Decentralized AI Markets
Inference markets charge a flat price per query. A cascade arbitrageur routes easy tasks to a cheap model and escalates only failures — capturing the spread. Olmedo, Schölkopf & Hardt (2026) show 40% net margins with no model-dev risk.
7 min read ⬢ interactive