Coming soon
How LLM Inference Works
Tokens, context windows, the KV cache and batching: why a model call costs what it costs.
Track · 8 courses
Ship product features built on language models: how inference works, retrieval, agents and tools, evals, and running it all in production.
Who it’s for: Software engineers adding LLM features to a real product. No machine learning background needed.
Coming soon
Tokens, context windows, the KV cache and batching: why a model call costs what it costs.
Coming soon
Prompts, structured output, streaming, retries and token budgets, from one API call to a feature you can ship.
Coming soon
Embeddings, chunking, hybrid search and reranking, plus the freshness and access problems demos skip.
Coming soon
Tool calling and the agent loop in plain code: tools, stop conditions, errors and memory.
Coming soon
Give an agent your own tools and data with a Model Context Protocol server.
Coming soon
Golden sets, regression suites and LLM judges, so a prompt change never ships blind.
Coming soon
How untrusted text takes over a model with tools, and the defenses that actually help.
Coming soon
Routing, fallbacks, caching, rate limits and cost tracking in front of every model call.
Every course stands alone and teaches what it needs. Take them in this order, or start with the one you need today.
Vote on what’s next