Free sample lesson · Factfulness: Ten Reasons We're Wrong About the World, and Why Things Are Better Than You Think

Why Experts Lose to Chimpanzees

12,000 people averaged 2 of 12 right. Random guessing gets 4. How do people do worse than chance?

Lesson 1 of the Wondering course Factfulness: Ten Reasons We're Wrong About the World, and Why Things Are Better Than You Think

Humans Lose to Chance

How can informed adults perform worse than guessing?

In the book's notes, Gapminder reports that in 2017, 12,000 people across 14 countries averaged 2.2 correct answers on 12 three-option questions.[[1]](https://www.gapminder.org/factfulness-book/notes/)

{{interactive:bar-chart-visualization instanceId="course-media-28690648-78aa-4c65-bdba-d5fae8cfb3dc" altText='Bar chart. Average correct answers out of 12: people tested in 2017, 2.2; random guessing, 4.' data='{"title":"Correct answers out of 12 fact questions","unit":"answers","xLabel":"Group","yLabel":"Correct answers","bars":[{"id":"people","label":"People tested (2017, 14 countries)","value":2.2},{"id":"chance","label":"Random guessing (one in three)","value":4}]}'}}

According to Gapminder's 2017 polls, people tested in 14 countries scored lower than random guessing would. · Based on free material from GAPMINDER.ORG (Factfulness detailed notes, 2018), CC-BY LICENSE · CC BY

A score here is the number of correct answers out of 12. Each question had options A, B, and C, so random guessing lands on the right one a third of the time. One-third of 12 is 4.

So the average Gapminder reports, 2.2, sits below the guessing benchmark of 4. Pure guessing would not do that, so something is pulling people toward particular wrong answers.

What Below Chance Reveals

Plain ignorance produces guesses scattered across the options. Across many answers, that should land near the random benchmark.

A below-chance score reveals a consistent pull toward wrong answers, especially dramatic and outdated ones.

Ignorance vs. Systematic Error
  • Plain ignorance
  • Below-chance score

Picture a chimpanzee picking A, B, or C at random for every question. It has no knowledge and no bias, so on average it hits the guessing benchmark: about 4 correct out of 12. That beats the 2.2 that people averaged. This is why a randomly answering chimpanzee can outguess (score higher than) teachers, journalists, Nobel laureates, and investment bankers.[[6]](https://us.macmillan.com/books/9781250123824/factfulness/)

One mistake proves little. The pattern across many people reveals the distortion.

Expertise Does Not Protect You

Top medical students at Karolinska Institutet compared child mortality in five country pairs. Hans Rosling reports that they averaged 1.8 correct answers out of 5.[[2]](https://www.ted.com/talks/hans_rosling_the_best_stats_you_ve_ever_seen/transcript?language=en)

Top Students vs. a Perfect Score
  • Medical students: Top students at Karolinska Institutet, as reported by Hans Rosling.
  • Perfect score: All five country pairs answered correctly.

As Rosling put it, the problem was preconceived ideas, not missing knowledge.

Davos audiences and young researchers at a Nobel laureate meeting also scored poorly.[[1]](https://www.gapminder.org/factfulness-book/notes/)

Education can strengthen confidence without correcting the underlying picture.

Drama Wins the Question

Gapminder's notes for the book report that yearly natural-disaster deaths fell from 325,742 in 1907–1916 to 80,386 in 2007–2016.[[1]](https://www.gapminder.org/factfulness-book/notes/)

The answer options said deaths more than doubled, stayed about the same, or decreased below half.

In a TED talk, Hans Rosling reported that only 12 percent of Swedes chose the decrease, while half thought deaths had doubled.[[3]](https://www.ted.com/talks/hans_and_ola_rosling_how_not_to_be_ignorant_about_the_world/transcript?language=en)

The Trend vs. the Guess
  • Yearly disaster deaths, 1907–1916: The starting point a century earlier.
  • Yearly disaster deaths, 2007–2016: Below half of the earlier level.
  • Swedes choosing the decrease: Half thought deaths had doubled instead.

The dramatic answer felt believable despite pointing opposite to the trend.

Build a Factfulness Habit

Factfulness means carrying opinions only when strong supporting facts exist.[[4]](https://www.gapminder.org/factfulness/)

There is too much information for anyone to process it all, so each of us has an attention filter: the mental sorting that decides which information we notice and care about. Gapminder describes this filter as hard-wired to favor dramatic information.[[4]](https://www.gapminder.org/factfulness/) The wrong picture can also come from neighborhoods, outdated school knowledge, sensational news, and intuition.[[3]](https://www.ted.com/talks/hans_and_ola_rosling_how_not_to_be_ignorant_about_the_world/transcript?language=en)

Factfulness does not mean every trend is good or every concern is false.

Can you worry without the drama?

Realize, Identify, Control

Factfulness works in three ordered steps: realize, identify, control.[[4]](https://www.gapminder.org/factfulness/)

Realize: admit that your mental picture may differ from reality.

Identify: name the dramatic instinct shaping your reaction. An instinct here is a built-in tendency that makes certain common kinds of stories grab our attention and feel true. The book lists ten of these dramatic instincts.

The next lesson applies this step to another three-option question. It asks whether most people live in low-, middle-, or high-income countries. These three groups are a way of sorting countries by average income per person: low-income countries are the poorest, high-income countries are the richest, and middle-income countries fall in between. That lesson then names the instinct behind the answer most people get wrong.

Control: pause and ask a question that tests the reaction against facts.

For uncertain global-trend questions, one calming prompt is: could things have improved? Ola Rosling's rule of thumb is that if you are unsure about a global trend, guess that things improve.[[3]](https://www.ted.com/talks/hans_and_ola_rosling_how_not_to_be_ignorant_about_the_world/transcript?language=en)

Realize, Identify, Control
  • Realize: Admit that your mental picture may differ from reality.
  • Identify: Name the dramatic instinct shaping your reaction.
  • Control: Pause and ask a question that tests the reaction against facts, such as: could things have improved?

Check yourself

When top medical students score below the benchmark from coin flipping, the best explanation is that they _____.

  • bring preconceived ideas that pull them toward wrong answers
  • lack enough education to understand any factual question

Answer: bring preconceived ideas that pull them toward wrong answers

Their education did not protect them from preconceived ideas that pulled their answers toward the wrong choices. A below-chance pattern points to systematic error, not simple lack of knowledge.

To build a Factfulness habit, first _____ that your mental picture may differ from reality. Next, _____ the dramatic instinct shaping your reaction. Finally, _____ it by asking a question that tests it against facts.

Answer: To build a Factfulness habit, first realize that your mental picture may differ from reality. Next, identify the dramatic instinct shaping your reaction. Finally, control it by asking a question that tests it against facts.

The three steps must happen in order: realize, identify, then control. This process helps replace an automatic dramatic reaction with a fact-based check.

A group answers 12 three-option questions and averages 2.2 correct answers. Random guessing would average 4. What does this below-chance score suggest?

  • The group is drawn toward certain dramatic, outdated answers.
  • The group has no information, so its guesses are completely random.
  • The questions must be impossible for everyone, including random guessers.
  • The group needs more education before it can answer any trend question.

Answer: The group is drawn toward certain dramatic, outdated answers.

The group is being pulled toward particular wrong answers, especially dramatic or outdated ones. Plain ignorance would produce scattered guesses closer to the random score.

Keep going

This is lesson 1 of 12 in Factfulness: Ten Reasons We're Wrong About the World, and Why Things Are Better Than You Think. Next up:

  1. The Gap Instinct and Four Income Levels
  2. Bad and Better at the Same Time
  3. Lines That Bend
  4. Risk Is Danger Times Exposure
  5. Lonely Numbers and the 80/20 Rule

Start this course free

Wondering turns any topic into short lessons you can read, watch, or listen to, with practice questions and an AI tutor.