Free sample lesson ยท AI Foundations for Everyone
Inside ChatGPT
How do AI chatbots like ChatGPT work?
Lesson 1 of the Wondering course AI Foundations for Everyone
The Lyrics Sheet Mystery
Imagine finding a lyric sheet for a song, but half the lyrics have been torn away.
How would you complete it?
You'd need to predict what comes next, word by word, based on what you already have.
This is exactly how chatbots like ChatGPT work.
The Prediction Machine
Think of chatbots as powerful prediction machines. You feed them incomplete text, and they guess what word should come next.
Diagram Version 1
It's not magic or thinking. It's pattern recognition on a massive scale.
The AI has learned from billions of conversations what words typically follow others in similar contexts.
Word by Word Creation
But how does this prediction machine generate responses?
Click the button to see how it works:
It's iterative autocomplete, not instant comprehension.
Chatbots build responses one word at a time based on all the words that have come before.
Diagram Version 2
First, they predict the opening word. Then they add that word to the conversation and predict the _next_ word.
They repeat this process over and over until they've constructed a complete response.
Not Really "Thinking"
When you chat with an AI, it's not sitting there pondering your question like a human would.
Diagram Version 3 Improved
There's no internal voice saying, "Hmm, what should I say?"
Instead, it's running a sophisticated text completion algorithm that predicts probable next words based on patterns it learned during training.
Keep going
This is lesson 1 of 36 in AI Foundations for Everyone. Next up:
- How Prompts Work
- Probability & Randomness
- Temperature
- Training Data Scale
- Generalization
Wondering turns any topic into short lessons you can read, watch, or listen to, with practice questions and an AI tutor.