Imagine a disease that only 1 in 1000 people actually have, and a test that is right almost every time. Test all 1000 people: the test correctly flags the 1 sick person, but it also slips up on about 10 of the 999 healthy ones. So 11 people get a scary red result, and only 1 of them is truly sick. A positive test is a nudge to look closer, not the final word. Drag the sliders in the simulator and watch the false alarms swamp the real cases.
Most people think a 99% accurate test that comes back positive means a 99% chance of being sick. In fact for a disease affecting 1 in 1000, only about 1 in 11 positives is truly ill, because false alarms drawn from the huge healthy crowd swamp the few real cases.
What's actually happening
Here is a question that fools most people, including many doctors. A disease affects 1 in 1000. A test for it is 99% accurate, meaning it correctly catches the sick and correctly clears the healthy 99% of the time. You take the test. It comes back positive. How worried should you be? The gut answer is 99% worried. The real answer is about 9%.
The trap is forgetting how few people are actually sick. Run the numbers on 1000 people. Only 1 is genuinely sick, and the test flags that person. But there are 999 healthy people, and a 1% error rate on 999 means the test falsely flags about 10 of them too. So 11 people walk away with a positive result, and only 1 is truly ill. Your real chance of being sick, given that red flag, is 1 out of 11, roughly 9%. The test did not lie about its accuracy. The rarity of the disease did the damage, because a tiny slice of a huge healthy crowd still outnumbers the genuinely sick.
The fix is Bayes’ theorem, named after the Reverend Thomas Bayes, whose work was published in 1763 after his death. It says evidence should not replace your prior belief, it should update it. Start with how common the thing is, then let the test shift that number, and the answer falls out honestly. This is why doctors confirm a rare diagnosis with a second, independent test, why a single airport scanner alarm rarely means a real threat, and why a strong-looking result on a rare claim deserves a calm second look rather than a panic. Good thinking is not about how convincing the new evidence feels. It is about where you were standing before it arrived.
Evidence should update your prior belief, not replace it, because on a rare condition even an accurate test is mostly false alarms.
- 1Draw a grid of 1000 squares. Colour 1 of them as the truly sick person (a 1-in-1000 disease).
- 2Now mark the false alarms: about 1% of the other 999, so roughly 10 healthy squares, also get flagged by the test.
- 3Count the flagged squares: 11 in total, only 1 truly sick. A positive result means about a 1-in-11 real chance. You have just done Bayes by hand.
Common questions
If a disease affects only 1 in 1000, testing 1000 people flags the 1 sick person but also about 10 healthy ones. So 11 get a positive result and only 1 is truly ill, a real chance of roughly 9%.
It is the common mistake of ignoring how rare something is and trusting the test alone. A tiny slice of a huge healthy crowd still outnumbers the genuinely sick, so forgetting the base rate badly overstates your risk.
Because a single positive on a rare condition is mostly false alarms. An independent second test shifts the odds again and separates the true cases from the false ones, which is Bayes updating in practice.