--- title: "What is a model cascade | LLM cascade vs fallback | Len P. van der Hof" description: "A model cascade is a planned cost pattern: start at the cheapest model that can do the job, escalate on a written trigger, stop on a written rule. It is not…" image: "https://lenvanderhof.com/media/generated/blog-hero-model-cascade-v1.444b15f2b529.wide.webp" --- [AI Systems](https://lenvanderhof.com/en/blog/category/ai-systems/) Research guide # What is a model cascade? Escalate with a stop rule A cascade without a stop rule is spending until something sounds fluent. Len P. van der HofPublished 24 September 20263 min read Overflow is designed. The bottom basin is the stop, not a surprise. Direct answer A model cascade is a planned chain of models for one task: start at the cheapest tier that could do the job, escalate to a more capable model only when a written trigger says the output is insufficient, and stop when a written rule says stop. A fallback is different. A fallback is recovery after the primary model has already missed a latency, quality, or availability target. Retrying the same flagship model is neither. On this site a cascade is a routing pattern inside The Model Portfolio, which is live. It is not the CASCADE framework from The Second-Order Thinker, a different book that is still a manuscript and not for sale. ## Key takeaways - Order is cheapest-sufficient first, flagship last. - The escalation trigger and the stop rule are the design. Without them you have a spend spiral. - A cascade is planned. A fallback is recovery after an SLO miss. Keep the words apart. - Not the CASCADE framework from The Second-Order Thinker. Different book, different job. Search “LLM cascade” and you get a benchmark paper, a vendor diagram, and a framework from a different book on this site. Operators need the boring version. **A model cascade** is an ordered chain of models for one task, written before the first call. Start at the cheapest model that could do the job. Escalate only when a written trigger says the output is not good enough. Stop when the rule says stop. A **fallback** is not that. A fallback is recovery: the primary model missed its latency, quality, or availability target, so a spare path runs. You design a cascade to save money on the common case. You design a fallback so an outage does not become a blank page. Merging the two words is how a spend spiral gets renamed “resilience”. Retrying the same flagship because the first answer felt thin is neither. That is a loop with a credit card. ## Not CASCADE, not speculative decoding, not “try the big one again” On this site, **CASCADE** as a named framework belongs to The Second-Order Thinker: a personal protocol for tracing the consequences of a decision before you commit. The [CASCADE glossary entry](https://lenvanderhof.com/glossary/cascade/) holds that meaning. That book is a manuscript, not for sale, and this page does not borrow its label. Speculative decoding is a speed trick inside one serving stack. A cascade is a policy across models. “If it fails, call the expensive one” is a sketch. The missing piece is what “fails” means, in a field a machine can read. ## The four parts that make it real **Order.** Cheapest-sufficient first, flagship last. Reverse that and you have a prestige chain that pays twice. **Escalation trigger.** A signal the cheap hop produces that the policy can check: the output failed to parse against the schema, a calibrated confidence score fell under the line, a retrieval similarity score came back low. The Model Portfolio’s rule is that the trigger belongs to the task, not to the cascade, so you calibrate it on real traffic before you wire it. A trigger you cannot name means you escalate on mood. **Stop rule.** Maximum hops. Maximum spend per request. A timeout, so the chain does not add net latency. Cases that must never escalate, such as private data that may not reach a hosted model, or an irreversible action that needs a human. Write them down. **Trace.** Which hop ran, why it escalated, what it cost. Without a trace you cannot tune the chain. You can only argue about it. ## The test for this week Pick one high-volume task. Run the cheap model and the expensive model on the same requests for a few days and log where they disagree. The disagreement is the trigger you need. Then watch the escalation rate in production. If nearly everything escalates, the cheap hop is theatre and the cascade costs more than calling the flagship directly. If nothing escalates, check the trigger before you celebrate. ## Two pages [What is model routing?](https://lenvanderhof.com/en/blog/what-is-model-routing/) owns the policy. A cascade is one pattern inside it, and a fallback is another. [The Model Portfolio](https://lenvanderhof.com/books/the-model-portfolio/) is live. You do not need the hardcover to write a three-hop chain with one stop rule this week. Cite this:What is a model cascade? Escalate with a stop rule.Len P. van der Hof. [https://lenvanderhof.com/en/blog/what-is-a-model-cascade/](https://lenvanderhof.com/en/blog/what-is-a-model-cascade/) · Published 24 September 2026. ## Terminology - [ROUTE](https://lenvanderhof.com/glossary/route/) ## Sources 1. [ROUTE (glossary)](https://lenvanderhof.com/glossary/route/) 2. [CASCADE (glossary)](https://lenvanderhof.com/glossary/cascade/) 3. [What is model routing?](https://lenvanderhof.com/en/blog/what-is-model-routing/) 4. [The Model Portfolio](https://lenvanderhof.com/books/the-model-portfolio/) ## Further reading - [ROUTE](https://lenvanderhof.com/glossary/route/) - [CASCADE](https://lenvanderhof.com/glossary/cascade/) - [What is model routing?](https://lenvanderhof.com/en/blog/what-is-model-routing/) - [The Model Portfolio](https://lenvanderhof.com/books/the-model-portfolio/) About the author ## [Len P. van der Hof](https://lenvanderhof.com/en/authors/len-p-van-der-hof/) Entrepreneur, AI Innovator and Venture Builder Len P. van der Hof builds practical AI systems, digital ventures and evidence-informed tools for founders. ```json { "@context": "https://schema.org", "@graph": [ { "@type": "Person", "@id": "https://lenvanderhof.com/#person", "name": "Len P. van der Hof", "alternateName": [ "Len van der Hof", "L.P. van der Hof", "Leendert Pieter van der Hof" ], "honorificSuffix": "MSc", "url": "https://lenvanderhof.com/", "image": [ "https://lenvanderhof.com/photos/len-portrait-1.jpg", "https://lenvanderhof.com/photos/len-portrait-2.jpg", "https://lenvanderhof.com/photos/len-portrait-3.jpg", "https://lenvanderhof.com/photos/len-portrait-4.jpg", "https://lenvanderhof.com/photos/len-speaking.jpg", "https://lenvanderhof.com/photos/len-hero.jpg" ], "jobTitle": "Entrepreneur, AI Innovator and Venture Builder", "description": "Len P. van der Hof, MSc, is a Dutch entrepreneur and AI innovator in Zwijndrecht. He builds ReasonKit, MindSesh, Undominated.ai, books under his name, the fiction imprint LPH98.lifestyle, and technology ventures through LPH98.ventures. Eleven titles in Systems for the Strategic Self are available now, in English and Dutch.", "address": { "@type": "PostalAddress", "addressLocality": "Zwijndrecht", "addressCountry": "NL" }, "alumniOf": { "@type": "CollegeOrUniversity", "name": "Rotterdam School of Management, Erasmus University" }, "knowsAbout": [ "Artificial intelligence", "AI agents", "Agentic AI systems", "LLM routing", "SEO", "Generative engine optimization", "Answer engine optimization", "Venture building", "Founder performance", "Founder psychology", "Evidence-based decision-making" ], "sameAs": [ "https://www.linkedin.com/in/lenvanderhof/", "https://x.com/LenvanderHof", "https://www.youtube.com/channel/UCTG20buKqYYbitqqf7l3zJA", "https://www.instagram.com/Lenvanderhof/", "https://www.threads.com/@lenvanderhof", "https://github.com/Lenvanderhof", "https://huggingface.co/LPH98", "https://www.npmjs.com/~lenvanderhof", "https://www.goodreads.com/author/show/70983905.Len_P_van_der_Hof", "https://www.amazon.com/author/lenvanderhof", "https://www.bol.com/nl/nl/b/len-p-van-der-hof-msc/609879394/", "https://bsky.app/profile/lenvanderhof.com", "https://mastodon.social/@Lenvanderhof", "https://crates.io/users/Lenvanderhof", "https://cursor.com/@Lenvanderhof", "https://medium.com/@Lenvanderhof", "https://gitlab.com/Lenvanderhof", "https://hub.docker.com/u/lenvanderhof/", "https://dev.to/lenvanderhof", "https://www.facebook.com/Lenvanderhof", "https://soundcloud.com/Lenvanderhof" ], "affiliation": [ { "@id": "https://lenvanderhof.com/#publisher" }, { "@id": "https://lenvanderhof.com/#mindsesh" }, { "@id": "https://lenvanderhof.com/#lifestyle" } ] }, { "@type": "WebSite", "@id": "https://lenvanderhof.com/#website", "url": "https://lenvanderhof.com/", "name": "Len P. van der Hof", "description": "Len P. van der Hof, MSc, is a Dutch entrepreneur and AI innovator in Zwijndrecht. He builds ReasonKit, MindSesh, Undominated.ai, books under his name, the fiction imprint LPH98.lifestyle, and technology ventures through LPH98.ventures. Eleven titles in Systems for the Strategic Self are available now, in English and Dutch.", "inLanguage": [ "en", "nl" ], "publisher": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "Organization", "@id": "https://lenvanderhof.com/#publisher", "name": "LPH98.ventures", "url": "https://lph98.ventures", "founder": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "Organization", "@id": "https://lenvanderhof.com/#mindsesh", "name": "MindSesh", "url": "https://mindsesh.net", "founder": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "SoftwareApplication", "@id": "https://lenvanderhof.com/#reasonkit", "name": "ReasonKit", "url": "https://reasonkit.sh", "creator": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "SoftwareApplication", "@id": "https://lenvanderhof.com/#undominated", "name": "Undominated.ai", "url": "https://undominated.ai", "creator": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "Organization", "@id": "https://lenvanderhof.com/#lifestyle", "name": "LPH98.lifestyle", "url": "https://lph98.lifestyle", "founder": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "ImageObject", "@id": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/#primaryimage", "url": "https://lenvanderhof.com/media/generated/blog-hero-model-cascade-v1.444b15f2b529.wide.webp", "contentUrl": "https://lenvanderhof.com/media/generated/blog-hero-model-cascade-v1.444b15f2b529.wide.webp", "representativeOfPage": true }, { "@type": "BreadcrumbList", "@id": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/#breadcrumb", "itemListElement": [ { "@type": "ListItem", "position": 1, "name": "Home", "item": "https://lenvanderhof.com/" }, { "@type": "ListItem", "position": 2, "name": "Blog", "item": "https://lenvanderhof.com/en/blog/" }, { "@type": "ListItem", "position": 3, "name": "AI Systems", "item": "https://lenvanderhof.com/en/blog/category/ai-systems/" }, { "@type": "ListItem", "position": 4, "name": "What is a model cascade? Escalate with a stop rule", "item": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/" } ] }, { "@type": "WebPage", "@id": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/#webpage", "url": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/", "name": "What is a model cascade? Escalate with a stop rule", "description": "A model cascade is a planned cost pattern: start at the cheapest model that can do the job, escalate on a written trigger, stop on a written rule. It is not a fallback, not a retry loop, and not the CASCADE framework from The Second-Order Thinker.", "isPartOf": { "@id": "https://lenvanderhof.com/#website" }, "primaryImageOfPage": { "@id": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/#primaryimage" }, "breadcrumb": { "@id": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/#breadcrumb" }, "inLanguage": "en-GB" }, { "@type": "BlogPosting", "@id": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/#article", "mainEntityOfPage": { "@id": "https://lenvanderhof.com/en/blog/what-is-a-model-cascade/#webpage" }, "headline": "What is a model cascade? Escalate with a stop rule", "description": "A model cascade is a planned cost pattern: start at the cheapest model that can do the job, escalate on a written trigger, stop on a written rule. It is not a fallback, not a retry loop, and not the CASCADE framework from The Second-Order Thinker.", "datePublished": "2026-09-24T19:00:00.000Z", "author": { "@id": "https://lenvanderhof.com/#person" }, "publisher": { "@id": "https://lenvanderhof.com/#person" }, "image": [ "https://lenvanderhof.com/media/generated/blog-hero-model-cascade-v1.444b15f2b529.square.webp", "https://lenvanderhof.com/media/generated/blog-hero-model-cascade-v1.444b15f2b529.landscape.webp", "https://lenvanderhof.com/media/generated/blog-hero-model-cascade-v1.444b15f2b529.wide.webp" ], "articleSection": "AI Systems", "inLanguage": "en-GB" } ] } ```