Deep Dive into LLMs like ChatGPT
Andrej Karpathy explains how large language models move from web-scale pretraining through supervised fine-tuning and reinforcement learning to become conversational assistants, while clarifying tokenization, hallucination, tools, and model limitations.
5 sections ยท 20 lessons
Course outline
Training Pipeline
- Three Training Stages
- Internet Data Curation
- Tokenization Fundamentals
- Neural Network Training
- Base Models Explained
- Text Generation Process
Post-Training
- Supervised Fine-Tuning
- Conversation Tokenization
Limitations
- Hallucinations
- Tool Use Integration
- Computational Limits
- Tokenization Blind Spots
Reinforcement Learning
- Reinforcement Learning Basics
- RL in Math & Code
- Chain of Thought
- RLHF for Subjective Tasks
- RLHF Limitations
Using and Evaluating LLMs
- Mental Model of AI
- LLM Ecosystem
- Future Capabilities