Building LLM Applications: Architecture to Production
For software engineers shipping LLM features in real products: how to pick between workflows and agents, get typed outputs and reliable tool calls, build evals you can trust, control cost and latency, and handle failures and prompt injection in production.
5 sections ยท 10 lessons
Course outline
Choosing the Architecture
- Workflows Before Agents
- Five Workflow Patterns
- Choosing an Architecture for Email Triage
Structured Outputs and Tools
- Structured Outputs That Hold
- Designing Tools the Model Can Use
Evals You Can Trust
- Evals Built from Real Failures
- Graders and Judges That Hold Up
- Building a First Eval Suite
Cost and Latency
- Where the Token Bill Comes From
- Making Responses Feel Fast
Failure and Security
- When Calls and Answers Fail
- Prompt Injection and Write Actions
- Launch Review for an Inbox Assistant