Free sample lesson ยท AI Foundations for Everyone

Inside ChatGPT

How do AI chatbots like ChatGPT work?

Lesson 1 of the Wondering course AI Foundations for Everyone

The Lyrics Sheet Mystery

Imagine finding a lyric sheet for a song, but half the lyrics have been torn away.

How would you complete it?

You'd need to predict what comes next, word by word, based on what you already have.

This is exactly how chatbots like ChatGPT work.

The Prediction Machine

Think of chatbots as powerful prediction machines. You feed them incomplete text, and they guess what word should come next.

Diagram Version 1

It's not magic or thinking. It's pattern recognition on a massive scale.

The AI has learned from billions of conversations what words typically follow others in similar contexts.

Word by Word Creation

But how does this prediction machine generate responses?

Click the button to see how it works:

It's iterative autocomplete, not instant comprehension.

Chatbots build responses one word at a time based on all the words that have come before.

Diagram Version 2

First, they predict the opening word. Then they add that word to the conversation and predict the _next_ word.

They repeat this process over and over until they've constructed a complete response.

Not Really "Thinking"

When you chat with an AI, it's not sitting there pondering your question like a human would.

Diagram Version 3 Improved

There's no internal voice saying, "Hmm, what should I say?"

Instead, it's running a sophisticated text completion algorithm that predicts probable next words based on patterns it learned during training.

Keep going

This is lesson 1 of 36 in AI Foundations for Everyone. Next up:

  1. How Prompts Work
  2. Probability & Randomness
  3. Temperature
  4. Training Data Scale
  5. Generalization

Start this course free

Wondering turns any topic into short lessons you can read, watch, or listen to, with practice questions and an AI tutor.