Why did it forget what I said earlier?
Tokens, context, and memory. Given a long conversation or document, predict what the model can and cannot use, and restructure the input so the important parts survive.
1 sections ยท 2 lessons
Course outline
Tokens, context, and memory
- Working Memory, Not Storage
- The Middle Gets Lost