--- title: "The 90% test: a ten-question quiz on overconfidence | Len P. van der Hof" description: "Ten questions, one rule: give a range you are 90% sure of. Most people's ranges are far too narrow. Take the quiz, score it, and learn to widen ranges…" image: "https://lenvanderhof.com/media/generated/blog-hero-overconfidence-90-percent-test-v1.483c725045b4.wide.webp" --- [Founder Performance](https://lenvanderhof.com/en/blog/category/founder-performance/) Research guide # The 90% test: why 'I'm sure' is right far less often than it feels A range you are 90% sure of should miss about once in ten. In one experiment it missed nearly half the time. Len P. van der HofPublished 8 October 20268 min read A narrow net feels precise. The fish does not care. Direct answer The 90% test asks you to give ranges you are 90% sure contain the true answer, then counts how many do. Most people's ranges are too narrow. In one experiment with 334 people, ranges meant to be 90% sure held the right answer only about 54% of the time. Researchers call this overprecision: being surer about your numbers than your knowledge allows. The fix: ask for the low end and the high end as two separate questions, and track how often your ranges hold. ## Key takeaways - A 90% range should miss about one time in ten. In experiments, such ranges often miss far more. - Overprecision, excess certainty in your own numbers, appears to be the most persistent form of overconfidence. - Asking for 90% instead of 50% barely changes how wide people make their ranges. - Ask for the low end and the high end as two separate questions. It widens ranges honestly. - Ten questions is a demonstration, not a verdict. Track your hit rate over many ranges. **When people say they are 90% sure a range contains the answer, it usually contains the answer far less often than nine times in ten.** In one experiment, 334 people gave 90% ranges for the years twentieth-century US presidents were first elected. Those ranges held the right year about 54% of the time. The gap has a name: overprecision, being surer about your numbers than your knowledge allows. The quiz below lets you see your own version in ten minutes. The answers are at the bottom, each with its source. ## How does the 90% test work? For each question, write down a low number and a high number. Choose them so that you are 90% sure the true answer lies between them. Do not look anything up. A 90% range is a bet. You should be willing to risk nine to win one that the answer is inside. If your ranges are honest, you will miss about one question in ten. ## The quiz: ten questions, ten ranges #QuestionMy lowMy high1In what year did the Wright brothers make the first powered airplane flights?2In what year was Isaac Newton’s Principia first published?3In what year did the United Nations officially come into existence?4In what year did the first iPhone go on sale in the United States?5How tall is the Eiffel Tower today, antennas included, in meters?6How tall is Mount Everest, in meters?7What is the average distance from the Earth to the Moon, in kilometers?8How fast does light travel in a vacuum, in kilometers per second?9How many member states does the United Nations have?10How wide is Rembrandt’s painting The Night Watch, in centimeters? Write all ten ranges before you read on. The research comes next, so the answers stay out of sight for a while. ## What has research found about overprecision? Overconfidence comes in three forms, as Don Moore and Paul Healy laid out in 2008: thinking you did better than you did, thinking you did better than others, and being too sure your beliefs are precise. Their review concluded that “Overprecision appears to be more persistent than either of the other 2 types of overconfidence.” The 90% test measures that third form. **Ranges come out far too narrow.** Jack Soll and Joshua Klayman (2004) found subjective ranges were systematically too narrow for what people actually knew, “sometimes only 40% as large as necessary to be well calibrated.” How much depended heavily on how the question was asked. **Asking for 90% barely changes the width.** Karl Halvor Teigen and Magne Jørgensen (2005) ran five experiments. Ranges that people were told to make at 90% could come with a felt confidence of 50% or less, and interval width stayed roughly the same across very different instructions. Their paper’s title sums it up: “When 90% confidence intervals are 50% certain.” **Big samples show the same tilt.** In a quiz of 50 true-or-false questions run by Andrew and Michael Mauboussin, more than 11,000 people took part. Their average confidence was 70%. Their average score was 60%. **Experts are not exempt, but method helps.** Andrew Speirs-Bridge and colleagues (2010) asked epidemiologists, public health experts and ecologists for 80% ranges. Across their three studies, those ranges held the answer 68.1% of the time: better than older studies, still short of 80%. In two of the studies, a four-step way of asking reduced overconfidence more than the usual three-point version. ## How do you score your quiz? Check your ranges against the answers below and count the hits. If every range really were a 90% range, you would score 8 or more about 93 times in 100. A score of 7 or lower would happen by bad luck only about 7 times in 100, and 6 or lower about once in 100. That is plain probability arithmetic, not a study result. So a 6 is a strong hint that your ranges are too narrow. A 9 on ten questions proves little. Ten is a small sample: treat your score as a lead to follow, not a verdict on you. ## How do you widen a range honestly? “Honestly” matters. A range from zero to a billion never misses and tells nobody anything. A useful range can still miss. It just misses about as often as you said it would. Four techniques. The first three were tested in the studies above; the fourth is a rule of thumb from The Calibrated Mind: 1. **Ask for the two ends separately.** First: “What number am I 95% sure the answer is above?” Then, as a separate act: “What number am I 95% sure it is below?” Two 95% edges make one 90% range. Teigen and Jørgensen found that separate “more than” and “less than” questions widen ranges. 2. **Guess first, rate second.** Write the low end, the high end and a best guess, and only then rate how confident you are that the answer is inside. That is the four-step method Speirs-Bridge’s team tested. 3. **Spread your chances across the whole scale.** Split the possible answers into bins, for example each decade of a century, and give every bin a probability, all adding up to 100%. In Uriel Haran, Don Moore and Carey Morewedge’s third experiment, this method held the right answer 76.91% of the time, against 54.34% for plain 90% ranges. 4. **Run the bet test.** Would you risk €9 to win €1 that the answer sits inside your range? If not, widen it until you would. ## How does CALIBRATE use the 90% test? [CALIBRATE](https://lenvanderhof.com/frameworks/calibrate/) is a nine-step system for matching how sure you are to what your evidence can carry. It comes from [The Calibrated Mind](https://lenvanderhof.com/books/the-calibrated-mind/) by Len P. van der Hof, available in English and Dutch. You do not need the book to use it. 1. **Calibrate confidence.** Turn a feeling of certainty into a number you can check later. 2. **Assess assumptions.** List the hidden premises under your judgment and test the weakest one. 3. **Lean on probabilities.** Replace words like “likely” with numbers and ranges. 4. **Investigate alternatives.** Build the strongest case against your own view. 5. **Build updating rules.** Decide in advance how much new evidence should move you. 6. **Record and review.** Keep a prediction journal and score it. 7. **Act with appropriate uncertainty.** Set a threshold for acting instead of waiting for certainty. 8. **Teach and extend.** Explain your numbers to someone else. The gaps show fast. 9. **Evolve your model.** Review on a rhythm, because calibration drifts. The quiz is step 1, Calibrate confidence, in miniature. The book’s bet test turns odds into a floor on your confidence: risking one to win one claims at least 50%, three to win one at least 75%, nine to win one 90%. If you would not take nine to one on your range, you were never at 90%. Here is step 1 on a hypothetical work estimate. Your team asks how long a website rebuild will take, and your first answer is “eight weeks.” - **Low end, asked on its own:** “I’m 95% sure it takes more than six weeks.” - **High end, asked separately:** “I’m 95% sure it takes less than sixteen weeks.” - **Bet test:** would you risk €9 to win €1 on six to sixteen weeks? You would. Write it down with today’s date. Six to sixteen weeks says far more than “eight weeks” did, and the width is the point: it is information. It tells the people planning around you how much weight the estimate can bear. Step 6, Record and review, then scores the range when the project ends. [Calibration techniques for founders](https://lenvanderhof.com/en/blog/calibration-techniques-for-founders/) shows how to turn such scores into a weekly habit, and [what calibration means](https://lenvanderhof.com/en/blog/what-calibration-means/) explains the idea underneath. ## Answers 1. **1903.** The first flights took place on 17 December 1903 at Kitty Hawk, North Carolina (Smithsonian National Air and Space Museum). 2. **1687.** The first edition of the *Principia* was printed in 1687 (The Royal Society). 3. **1945.** The United Nations officially came into existence on 24 October 1945 (United Nations). 4. **2007.** The iPhone went on sale in the US on 29 June 2007 (Apple Newsroom). 5. **About 330 meters.** The official site lists a current height of 1,083 feet, antennas included (Tour Eiffel). 6. **8,848.86 meters.** The height Nepal and China announced jointly on 8 December 2020 (The Kathmandu Post). 7. **384,400 kilometers.** The average Earth to Moon distance (NASA). 8. **299,792.458 kilometers per second.** Exact by definition of the SI units (BIPM). 9. **193.** The count since South Sudan joined in 2011 (United Nations). 10. **453.5 centimeters.** The painting is 379.5 cm high and 453.5 cm wide (Rijksmuseum). ## Try this today Give the quiz to one colleague and compare scores. It takes ten minutes, and the conversation afterward is the useful part: whose ranges missed, and on which kind of question. Then write your next three work estimates as 90% ranges using the two-question method. Put each resolution date in your calendar. When they resolve, count the hits. That small record will teach you more about your own ranges than any quiz. Cite this:The 90% test: why 'I'm sure' is right far less often than it feels.Len P. van der Hof. [https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/](https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/) · Published 8 October 2026. ## Sources 1. [A simple remedy for overprecision in judgment (Haran, Moore and Morewedge, 2010)](https://pmc.ncbi.nlm.nih.gov/articles/PMC5386407/) · Judgment and Decision Making (author manuscript on PubMed Central) 2. [The trouble with overconfidence (Moore and Healy, 2008)](https://doi.org/10.1037/0033-295X.115.2.502) · Psychological Review 3. [Overconfidence in interval estimates (Soll and Klayman, 2004)](https://doi.org/10.1037/0278-7393.30.2.299) · Journal of Experimental Psychology: Learning, Memory, and Cognition 4. [When 90% confidence intervals are 50% certain (Teigen and Jørgensen, 2005)](https://doi.org/10.1002/acp.1085) · Applied Cognitive Psychology 5. [Reducing overconfidence in the interval judgments of experts (Speirs-Bridge et al., 2010)](https://doi.org/10.1111/j.1539-6924.2009.01337.x) · Risk Analysis 6. [If You Say Something Is 'Likely,' How Likely Do People Think It Is?](https://hbr.org/2018/07/if-you-say-something-is-likely-how-likely-do-people-think-it-is) · Harvard Business Review 7. [1903 Wright Flyer](https://airandspace.si.edu/collection-objects/1903-wright-flyer/nasm_A19610048000) · Smithsonian National Air and Space Museum 8. [Principia](https://royalsociety.org/blog/2014/07/principia/) · The Royal Society 9. [History of the United Nations](https://www.un.org/en/about-us/history-of-the-un) · United Nations 10. [iPhone Premieres This Friday Night at Apple Retail Stores](https://www.apple.com/newsroom/2007/06/28iPhone-Premieres-This-Friday-Night-at-Apple-Retail-Stores/) · Apple Newsroom 11. [The Eiffel Tower: key figures](https://www.toureiffel.paris/en/the-monument/key-figures) · Société d'Exploitation de la Tour Eiffel (official site) 12. [8,848.86 metres. That's the height of Mt Everest now](https://kathmandupost.com/national/2020/12/08/it-s-official-mount-everest-is-8-848-86-metres-tall) · The Kathmandu Post 13. [Moon Facts](https://science.nasa.gov/moon/facts/) · NASA 14. [Defining constants](https://www.bipm.org/en/measurement-units/si-defining-constants) · BIPM 15. [Growth in United Nations membership](https://www.un.org/en/about-us/growth-in-un-membership) · United Nations 16. [The Night Watch Militia Company of District II under the Command of Captain Frans Banninck Cocq](https://www.rijksmuseum.nl/en/collection/SK-C-5) · Rijksmuseum 17. [The Calibrated Mind](https://lenvanderhof.com/books/the-calibrated-mind/) 18. [CALIBRATE framework](https://lenvanderhof.com/frameworks/calibrate/) ## Further reading - [What calibration means](https://lenvanderhof.com/en/blog/what-calibration-means/) - [Calibration techniques for founders](https://lenvanderhof.com/en/blog/calibration-techniques-for-founders/) - [CALIBRATE](https://lenvanderhof.com/glossary/calibrate/) - [The Calibrated Mind](https://lenvanderhof.com/books/the-calibrated-mind/) About the author ## [Len P. van der Hof](https://lenvanderhof.com/en/authors/len-p-van-der-hof/) Entrepreneur, AI Innovator and Venture Builder Len P. van der Hof builds practical AI systems, digital ventures and evidence-informed tools for founders. ```json { "@context": "https://schema.org", "@graph": [ { "@type": "Person", "@id": "https://lenvanderhof.com/#person", "name": "Len P. van der Hof", "alternateName": [ "Len van der Hof", "L.P. van der Hof", "Leendert Pieter van der Hof" ], "honorificSuffix": "MSc", "url": "https://lenvanderhof.com/", "image": [ "https://lenvanderhof.com/photos/len-portrait-1.jpg", "https://lenvanderhof.com/photos/len-portrait-2.jpg", "https://lenvanderhof.com/photos/len-portrait-3.jpg", "https://lenvanderhof.com/photos/len-portrait-4.jpg", "https://lenvanderhof.com/photos/len-speaking.jpg", "https://lenvanderhof.com/photos/len-hero.jpg" ], "jobTitle": "Entrepreneur, AI Innovator and Venture Builder", "description": "Len P. van der Hof, MSc, is a Dutch entrepreneur and AI innovator in Zwijndrecht. He builds ReasonKit, MindSesh, Undominated.ai, books under his name, the fiction imprint LPH98.lifestyle, and technology ventures through LPH98.ventures. Eleven titles in Systems for the Strategic Self are available now, in English and Dutch.", "address": { "@type": "PostalAddress", "addressLocality": "Zwijndrecht", "addressCountry": "NL" }, "alumniOf": { "@type": "CollegeOrUniversity", "name": "Rotterdam School of Management, Erasmus University" }, "knowsAbout": [ "Artificial intelligence", "AI agents", "Agentic AI systems", "LLM routing", "SEO", "Generative engine optimization", "Answer engine optimization", "Venture building", "Founder performance", "Founder psychology", "Evidence-based decision-making" ], "sameAs": [ "https://www.linkedin.com/in/lenvanderhof/", "https://x.com/LenvanderHof", "https://www.youtube.com/channel/UCTG20buKqYYbitqqf7l3zJA", "https://www.instagram.com/Lenvanderhof/", "https://www.threads.com/@lenvanderhof", "https://github.com/Lenvanderhof", "https://huggingface.co/LPH98", "https://www.npmjs.com/~lenvanderhof", "https://www.goodreads.com/author/show/70983905.Len_P_van_der_Hof", "https://www.amazon.com/author/lenvanderhof", "https://www.bol.com/nl/nl/b/len-p-van-der-hof-msc/609879394/", "https://bsky.app/profile/lenvanderhof.com", "https://mastodon.social/@Lenvanderhof", "https://crates.io/users/Lenvanderhof", "https://cursor.com/@Lenvanderhof", "https://medium.com/@Lenvanderhof", "https://gitlab.com/Lenvanderhof", "https://hub.docker.com/u/lenvanderhof/", "https://dev.to/lenvanderhof", "https://www.facebook.com/Lenvanderhof", "https://soundcloud.com/Lenvanderhof" ], "affiliation": [ { "@id": "https://lenvanderhof.com/#publisher" }, { "@id": "https://lenvanderhof.com/#mindsesh" }, { "@id": "https://lenvanderhof.com/#lifestyle" } ] }, { "@type": "WebSite", "@id": "https://lenvanderhof.com/#website", "url": "https://lenvanderhof.com/", "name": "Len P. van der Hof", "description": "Len P. van der Hof, MSc, is a Dutch entrepreneur and AI innovator in Zwijndrecht. He builds ReasonKit, MindSesh, Undominated.ai, books under his name, the fiction imprint LPH98.lifestyle, and technology ventures through LPH98.ventures. Eleven titles in Systems for the Strategic Self are available now, in English and Dutch.", "inLanguage": [ "en", "nl" ], "publisher": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "Organization", "@id": "https://lenvanderhof.com/#publisher", "name": "LPH98.ventures", "url": "https://lph98.ventures", "founder": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "Organization", "@id": "https://lenvanderhof.com/#mindsesh", "name": "MindSesh", "url": "https://mindsesh.net", "founder": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "SoftwareApplication", "@id": "https://lenvanderhof.com/#reasonkit", "name": "ReasonKit", "url": "https://reasonkit.sh", "creator": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "SoftwareApplication", "@id": "https://lenvanderhof.com/#undominated", "name": "Undominated.ai", "url": "https://undominated.ai", "creator": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "Organization", "@id": "https://lenvanderhof.com/#lifestyle", "name": "LPH98.lifestyle", "url": "https://lph98.lifestyle", "founder": { "@id": "https://lenvanderhof.com/#person" } }, { "@type": "ImageObject", "@id": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/#primaryimage", "url": "https://lenvanderhof.com/media/generated/blog-hero-overconfidence-90-percent-test-v1.483c725045b4.wide.webp", "contentUrl": "https://lenvanderhof.com/media/generated/blog-hero-overconfidence-90-percent-test-v1.483c725045b4.wide.webp", "representativeOfPage": true }, { "@type": "BreadcrumbList", "@id": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/#breadcrumb", "itemListElement": [ { "@type": "ListItem", "position": 1, "name": "Home", "item": "https://lenvanderhof.com/" }, { "@type": "ListItem", "position": 2, "name": "Blog", "item": "https://lenvanderhof.com/en/blog/" }, { "@type": "ListItem", "position": 3, "name": "Founder Performance", "item": "https://lenvanderhof.com/en/blog/category/founder-performance/" }, { "@type": "ListItem", "position": 4, "name": "The 90% test: why 'I'm sure' is right far less often than it feels", "item": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/" } ] }, { "@type": "WebPage", "@id": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/#webpage", "url": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/", "name": "The 90% test: why 'I'm sure' is right far less often than it feels", "description": "Ten questions, one rule: give a range you are 90% sure of. Most people's ranges are far too narrow. Take the quiz, score it, and learn to widen ranges honestly.", "isPartOf": { "@id": "https://lenvanderhof.com/#website" }, "primaryImageOfPage": { "@id": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/#primaryimage" }, "breadcrumb": { "@id": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/#breadcrumb" }, "inLanguage": "en-GB" }, { "@type": "BlogPosting", "@id": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/#article", "mainEntityOfPage": { "@id": "https://lenvanderhof.com/en/blog/overconfidence-90-percent-test/#webpage" }, "headline": "The 90% test: why 'I'm sure' is right far less often than it feels", "description": "Ten questions, one rule: give a range you are 90% sure of. Most people's ranges are far too narrow. Take the quiz, score it, and learn to widen ranges honestly.", "datePublished": "2026-10-08T14:00:00.000Z", "author": { "@id": "https://lenvanderhof.com/#person" }, "publisher": { "@id": "https://lenvanderhof.com/#person" }, "image": [ "https://lenvanderhof.com/media/generated/blog-hero-overconfidence-90-percent-test-v1.483c725045b4.square.webp", "https://lenvanderhof.com/media/generated/blog-hero-overconfidence-90-percent-test-v1.483c725045b4.landscape.webp", "https://lenvanderhof.com/media/generated/blog-hero-overconfidence-90-percent-test-v1.483c725045b4.wide.webp" ], "articleSection": "Founder Performance", "inLanguage": "en-GB" } ] } ```