Free sample lesson ยท AI Agents for SaaS

Inside ChatGPT

How do AI chatbots like ChatGPT work?

Lesson 1 of the Wondering course AI Agents for SaaS

The Lyrics Sheet Mystery

Imagine finding a lyric sheet for a song, but half the lyrics have been torn away.

How would you complete it?

You'd need to predict what comes next, word by word, based on what you already have.

This is exactly how chatbots like ChatGPT work.

The Prediction Machine

Think of chatbots as powerful prediction machines. You feed them incomplete text, and they guess what word should come next.

Diagram Version 1

It's not magic or thinking. It's pattern recognition on a massive scale.

The AI has learned from billions of conversations what words typically follow others in similar contexts.

How prediction works

Word by Word Creation

But how does this prediction machine generate responses?

Click the button to see how it works:

It's iterative autocomplete, not instant comprehension.

Chatbots build responses one word at a time based on all the words that have come before.

Diagram Version 2

First, they predict the opening word. Then they add that word to the conversation and predict the _next_ word.

They repeat this process over and over until they've constructed a complete response.

Building a response one word at a time
  • Start: The chatbot predicts the opening word from the words already provided.
  • Add: It adds that predicted word to the conversation.
  • Predict: It uses all the words so far to predict the next word.
  • Repeat: It repeats adding and predicting until a complete response is constructed.

Not Really "Thinking"

When you chat with an AI, it's not sitting there pondering your question like a human would.

Diagram Version 3 Improved

There's no internal voice saying, "Hmm, what should I say?"

Instead, it's running a sophisticated text completion algorithm that predicts probable next words based on patterns it learned during training.

Human thinking versus text completion
  • Human
  • AI chatbot

Check yourself

ChatGPT creates a response by predicting one word at a time.

  • True
  • False

Answer: True

ChatGPT generates text through word-by-word prediction. It does not create responses by human-like thinking or comprehension.

When ChatGPT generates a response, it predicts the _____, adds it to the context, predicts the _____, and repeats until it has a _____.

Answer: When ChatGPT generates a response, it predicts the opening word, adds it to the context, predicts the next word, and repeats until it has a complete response.

The response begins with an opening word. That word becomes part of the context for predicting the next word, and the process continues until a complete response is formed.

Why can ChatGPT produce a fluent response without actually thinking like a human?

  • It predicts probable next words from learned language patterns.
  • It understands the question and forms a human-like inner response.
  • It retrieves a complete answer without generating each word.
  • It chooses words randomly and connects them afterward.

Answer: It predicts probable next words from learned language patterns.

ChatGPT uses massive-scale pattern recognition to estimate probable next words. A fluent answer does not prove that the system is thinking or comprehending like a person.

Keep going

This is lesson 1 of 36 in AI Agents for SaaS. Next up:

  1. How Prompts Work
  2. Probability & Randomness
  3. Temperature
  4. Training Data Scale
  5. Generalization

Start this course free

Wondering turns any topic into short lessons you can read, watch, or listen to, with practice questions and an AI tutor.