Why did it forget what I said earlier?

Tokens, context, and memory. Given a long conversation or document, predict what the model can and cannot use, and restructure the input so the important parts survive.

1 sections ยท 2 lessons

Course outline

Tokens, context, and memory

  1. Working Memory, Not Storage
  2. The Middle Gets Lost

Start learning with Wondering