Free sample lesson ยท AI Architecture for Visual Designers

Inside LLMs

What actually happens under the hood when a model generates a response?

Lesson 1 of the Wondering course AI Architecture for Visual Designers

A Library, Not a Calculator

An LLM is closer to a vast library of relationships than a calculator.

Its anatomy has three parts: an input layer, hidden layers of neural weights, and an output layer.

Core architecture layers
  • Input layer: Where the prompt enters the model.
  • Hidden layers: Neural weights that shape the signal.
  • Output layer: Where the prediction emerges.

Each layer passes signal inward toward the output

Information enters, gets weighted across many hidden connections, and leaves as a prediction.

That layered flow is the frame for everything else in this lesson.

Attention as Layout Priority

Inside LLMs, the relevant structure is the Transformer architecture.

Transformers use attention mechanisms to weigh the importance of different parts of a prompt.

This works much like a designer prioritizing elements in a layout. Some words carry visual hierarchy; others recede.

Attention weighting words in a prompt like a layout hierarchy

Notice that the model does not treat every word equally: heavier weighting behaves like dominant elements in a layout hierarchy.

Attention decides what dominates the composition of the answer.

Words Become Vectors

The model does not think in words.

It breaks the prompt into tokens, then processes those tokens as numerical vectors inside a latent space.

What the model actually handles
  • Words
  • Vectors

So a prompt is never read as language. It is placed as coordinates.

This single move is what makes the rest of the behaviour possible.

Latent Space as a Map

Latent space is a multi-dimensional map of relationships.

Similar concepts sit near each other spatially. Unrelated ones sit far apart.

Think of it as a vast, multi-dimensional library of visual relationships, where position carries meaning rather than a shelf label.

Latent space shown as a spatial map of clustered concepts

Watch how tightly grouped points read as related concepts while distant clusters read as unrelated, so position itself carries the meaning.

Distance is the model's version of similarity.

From Prompt to Output

The flow inside the model is traceable end to end.

Tokenization splits the prompt. Vectors place it in latent space. Attention weights what matters. A probability distribution selects the output.

The path from prompt to output
  • Tokenization: The prompt is split into tokens.
  • Vectors: Tokens become numerical vectors in latent space.
  • Attention: Attention weighs which parts of the prompt matter most.
  • Probability: A final probability distribution selects the output.

Seen as interconnected nodes and weighted paths, a text prompt becomes a complex creative output.

Nothing here is magic. It is navigation.

Where Models Excel or Fail

Understanding this flow has a practical payoff.

It lets designers architect better prompts and anticipate where the AI might hallucinate or excel in creative tasks.

Regions of latent space that are densely mapped tend to support strong creative output. Sparse or unfamiliar territory is where invention creeps in.

If it is all position, what is truth?

Prompting is really a way of steering position on that map.

Carrying the Model With You

Hold three ideas together.

The architecture is layered: input, hidden weights, output. Attention prioritizes parts of a prompt. Latent space maps meaning as position.

How the pieces connect
  • Layered architecture: Input layer, hidden weights, output layer.
  • Attention: Prioritizes parts of a prompt.
  • Latent space: Maps meaning as position.
  • Tokens as vectors: Numerical coordinates rather than words.
  • Prompt design: Prompts written as coordinates, not commands.

Every output is the end of a navigation through that map.

Design your prompts as coordinates, not commands.

Check yourself

An LLM's hidden layers contain neural weights that transform information between the input and output layers.

  • True
  • False

Answer: True

This is correct. An LLM has an input layer, hidden layers containing neural weights, and an output layer that produces a prediction.

A prompt is split into _____, represented as numerical _____, and processed within _____.

Answer: A prompt is split into tokens, represented as numerical vectors, and processed within latent space.

Tokenization breaks the prompt into tokens. The model represents those tokens as vectors and processes their relationships in latent space.

A visual designer gives an LLM a prompt containing a subject, color palette, and composition constraints. Which Transformer function helps the model prioritize the most relevant parts?

  • Attention mechanisms
  • The output layer
  • Tokenization alone
  • A calculator operation

Answer: Attention mechanisms

Attention mechanisms weigh different parts of a prompt, similar to how a designer gives visual hierarchy to important layout elements.

Keep going

This is lesson 1 of 7 in AI Architecture for Visual Designers. Next up:

  1. Token Flows
  2. Understanding RAG
  3. Building Real-World Projects with RAG
  4. Vector Spaces
  5. Autonomous Agents

Start this course free

Wondering turns any topic into short lessons you can read, watch, or listen to, with practice questions and an AI tutor.