Attention is a specific matrix operation. Not a metaphor. Understanding it at the implementation level changes everything that comes after. Build something small in PyTorch before reading another architecture paper. The confusion clears faster than expected.
Core Concepts
Self-attention mechanism (Q, K, V matrices)
Multi-head attention and why multiple heads matter
Could you derive why decoder-only architectures won, on a whiteboard, without notes?
02ComputingGPU / Computing Economics1–2 wks+
Why This Layer Exists
Every model release, every capability claim, every "it surprised us" moment traces back to a compute budget. FLOPs and dollars before business intuition. Handwaving about scale is not the same as reasoning about it.
Core Concepts
FLOPs and what they actually measure
Memory bandwidth as the real bottleneck, not raw compute
Model FLOP Utilization (MFU) in practice
H100 vs A100 vs TPU v5 architecture differences
Tensor, pipeline, and data parallelism tradeoffs
Training cost estimation from parameter count
Inference cost structure: a different problem than training
CapEx vs OpEx and the rent-vs-own calculus
Price-performance trends across hardware generations
Power, cooling, and the energy constraint on frontier models
Given a parameter count, can you ballpark training cost within 2x and explain why inference, not training, is what actually breaks margins at scale?
03SystemsAI Infrastructure2–3 wks+
Why This Layer Exists
Training a model is a project. Running it in production is a system. These require different skills and produce different failures. Most of the industry learns this the hard way because nobody treats infrastructure as a study subject.
Could you design a serving stack for a 70B model that holds a real latency SLA under load?
04FrontierAgent Systems2–3 wks+
Why This Layer Exists
Single-turn Q&A is largely solved. The hard problem is sequential decisions with tool access, real consequences, and compounding context. Agents are where LLMs become economically transformative and technically demanding at the same time.
Core Concepts
ReAct: reasoning and acting in a loop
Chain-of-Thought and Tree-of-Thought prompting
Tool use and function calling
Memory: episodic, semantic, working, procedural
Multi-agent architectures: supervisor and specialist patterns
In a 10-step agent pipeline, where would you bet the first failure happens, and how would you catch it before a user does?
05RigorModel Evaluation1–2 wks+
Why This Layer Exists
Vibes are not a measurement system. A model that "feels better" is not an insight. Trustworthy evaluation is domain-specific, contamination-resistant, and tied to metrics that hold up under pressure. That is what separates a production deployment from a demo.
How would you design an eval suite for an agent, knowing standard benchmarks will tell you what you want to hear?
06EcosystemOpen-Source Ecosystem1–2 wks+
Why This Layer Exists
The frontier does not live only inside labs. Recent open models match closed ones from 18 months ago. Knowing which ones, why, and how to run and adapt them changes your build-vs-buy calculus in a material way.
Core Concepts
Major open model lineages: Llama, Mistral, Qwen, DeepSeek, Falcon
GGUF and GGML quantization formats for local inference
Given a fine-tuning task and a real budget, what is your stack, and when does calling an API actually make more sense?
07EconomicsAI Business Models1–2 wks+
Why This Layer Exists
Inference margins are thin and compress as models commoditize. Most "AI businesses" are distribution plays. Getting the unit economics wrong at the product strategy stage is expensive to unwind.
Core Concepts
Token economics and inference margin structure
Why API gross margins compress at scale
Vertical AI vs horizontal AI platform strategy
Data moats, network effects, and workflow lock-in
Build vs buy vs fine-tune from the vendor perspective
Open vs closed source as a strategic business choice
AI-native SaaS vs AI features bolted onto legacy SaaS
Most enterprise AI projects work technically. They fail organizationally. The pilot-to-production gap is a people and process problem, not a model problem. This layer is where technical leaders create business value that engineers alone cannot.
Core Concepts
AI maturity models and organizational readiness assessment
Build vs buy vs partner from the buyer's perspective
The pilot-to-production gap and why POCs stall
Change management for AI-disrupted workflows
Aligning IT, legal, compliance, and leadership on one rollout
AI governance structures inside organizations
Measuring and communicating ROI on AI investments
The last-mile problem: user adoption and behavioral change
Could you tell a CFO, in their language, why an 80%-accurate model might still be a bad investment?
09DesignHuman-Computer Interaction1–2 wks+
Why This Layer Exists
Streaming output, probabilistic responses, and variable latency break every interaction pattern designed for deterministic software. The conventions of HCI are being rewritten in real time. Most products are not paying attention.
Core Concepts
Trust calibration: when confidence should and should not show
Latency perception and progressive disclosure
Prompt UX as product design, not just engineering
Agentic UI: when to interrupt vs proceed autonomously
Designing for graceful failure and uncertainty
Cognitive load in AI-augmented workflows
Streaming output and how it rewrites UX conventions
Explainability UX: what users actually need to know
How would you design an agent that asks for clarification at exactly the right moments, not too often, not too rarely?
10EmbodimentRobotics + Multimodal AI2–3 wks+
Why This Layer Exists
Text is a compressed channel. Physical manipulation, visual reasoning, and spatial understanding are harder problems with more impact. The bottleneck in robotics is data, not architecture or compute. Knowing why changes how you read every progress claim in this space.
Core Concepts
Vision Transformers (ViT) and CLIP architecture
Vision-language-action (VLA) models for robotics
Sim-to-real transfer and why it is harder than it looks
The data bottleneck: why robotics lags language AI
Open X-Embodiment and cross-robot transfer
Hierarchical planning in embodied agents
Multimodal fusion strategies across modalities
World models as the path from perception to planning
What is the actual bottleneck preventing robot generalization today, and why is the answer not compute?
11ContextAI Geopolitics & Governance1 wk+
Why This Layer Exists
Chip export controls have direct technical consequences. The EU AI Act has direct deployment consequences. These are not abstract policy debates. They are constraints shaping what can be built and where. Literacy here takes one week and compounds across everything else.
Core Concepts
US export controls on chips (BIS rules) and their actual effects
Semiconductor supply chain: TSMC, ASML, and chokepoints