AI Product & Strategy
AIAtlas
Sequential layers for the AI stack.
11 modules. One builds into the next.
0 / 11
01Foundation Transformers & LLM Fundamentals 3–4 wks+
Why This Layer Exists

Attention is a specific matrix operation. Not a metaphor. Understanding it at the implementation level changes everything that comes after. Build something small in PyTorch before reading another architecture paper. The confusion clears faster than expected.

Core Concepts
  • Self-attention mechanism (Q, K, V matrices)
  • Multi-head attention and why multiple heads matter
  • Positional encoding: sinusoidal, learned, RoPE
  • Tokenization: BPE, WordPiece, SentencePiece
  • Decoder-only vs encoder-decoder vs encoder-only
  • Pretraining objectives: next-token prediction, masked LM
  • Alignment: RLHF, PPO, DPO, Constitutional AI
  • Scaling laws: Kaplan 2020, Chinchilla 2022
  • KV cache mechanics and context window limits
  • Hallucination causes, not just symptoms
Litmus

Could you derive why decoder-only architectures won, on a whiteboard, without notes?

02Computing GPU / Computing Economics 1–2 wks+
Why This Layer Exists

Every model release, every capability claim, every "it surprised us" moment traces back to a compute budget. FLOPs and dollars before business intuition. Handwaving about scale is not the same as reasoning about it.

Core Concepts
  • FLOPs and what they actually measure
  • Memory bandwidth as the real bottleneck, not raw compute
  • Model FLOP Utilization (MFU) in practice
  • H100 vs A100 vs TPU v5 architecture differences
  • Tensor, pipeline, and data parallelism tradeoffs
  • Training cost estimation from parameter count
  • Inference cost structure: a different problem than training
  • CapEx vs OpEx and the rent-vs-own calculus
  • Price-performance trends across hardware generations
  • Power, cooling, and the energy constraint on frontier models
Litmus

Given a parameter count, can you ballpark training cost within 2x and explain why inference, not training, is what actually breaks margins at scale?

03Systems AI Infrastructure 2–3 wks+
Why This Layer Exists

Training a model is a project. Running it in production is a system. These require different skills and produce different failures. Most of the industry learns this the hard way because nobody treats infrastructure as a study subject.

Core Concepts
  • Distributed training: data, tensor, pipeline parallelism
  • FSDP (Fully Sharded Data Parallel) and ZeRO stages
  • Megatron-LM and hybrid parallelism at scale
  • Inference serving: vLLM, TensorRT-LLM, continuous batching
  • PagedAttention and why it changed serving economics
  • Quantization: INT8, GPTQ, AWQ, bitsandbytes
  • Speculative decoding
  • RAG architecture and vector database integration
  • Kubernetes, GPU Operator, and cluster orchestration
  • RDMA and InfiniBand networking for multi-node training
Litmus

Could you design a serving stack for a 70B model that holds a real latency SLA under load?

04Frontier Agent Systems 2–3 wks+
Why This Layer Exists

Single-turn Q&A is largely solved. The hard problem is sequential decisions with tool access, real consequences, and compounding context. Agents are where LLMs become economically transformative and technically demanding at the same time.

Core Concepts
  • ReAct: reasoning and acting in a loop
  • Chain-of-Thought and Tree-of-Thought prompting
  • Tool use and function calling
  • Memory: episodic, semantic, working, procedural
  • Multi-agent architectures: supervisor and specialist patterns
  • LangGraph state machines for agent control flow
  • Human-in-the-loop design
  • Guardrails and error recovery strategies
  • Failure taxonomy: loops, drift, silent wrong answers
  • Evaluation frameworks built for agentic behavior
Litmus

In a 10-step agent pipeline, where would you bet the first failure happens, and how would you catch it before a user does?

05Rigor Model Evaluation 1–2 wks+
Why This Layer Exists

Vibes are not a measurement system. A model that "feels better" is not an insight. Trustworthy evaluation is domain-specific, contamination-resistant, and tied to metrics that hold up under pressure. That is what separates a production deployment from a demo.

Core Concepts
  • Benchmark design and Goodhart's Law in AI
  • MMLU, GPQA, HumanEval, LiveCodeBench
  • HELM: holistic, multi-metric evaluation framework
  • LLM-as-judge methodology and its failure modes
  • Human preference evaluation: ELO and Arena-style
  • Training data contamination and leakage detection
  • Domain-specific eval harness construction
  • Safety evaluation and red-teaming methods
  • Hallucination measurement techniques
  • Robustness and distribution shift testing
Litmus

How would you design an eval suite for an agent, knowing standard benchmarks will tell you what you want to hear?

06Ecosystem Open-Source Ecosystem 1–2 wks+
Why This Layer Exists

The frontier does not live only inside labs. Recent open models match closed ones from 18 months ago. Knowing which ones, why, and how to run and adapt them changes your build-vs-buy calculus in a material way.

Core Concepts
  • Major open model lineages: Llama, Mistral, Qwen, DeepSeek, Falcon
  • GGUF and GGML quantization formats for local inference
  • LoRA (Low-Rank Adaptation) mechanics
  • QLoRA: quantization combined with LoRA
  • DoRA variant and when it outperforms LoRA
  • HuggingFace Hub structure: models, datasets, Spaces
  • PEFT and TRL library training loops
  • Licensing realities: Apache 2.0, Llama community license, CC-BY
  • Power-law dynamics in model downloads and usage
Litmus

Given a fine-tuning task and a real budget, what is your stack, and when does calling an API actually make more sense?

07Economics AI Business Models 1–2 wks+
Why This Layer Exists

Inference margins are thin and compress as models commoditize. Most "AI businesses" are distribution plays. Getting the unit economics wrong at the product strategy stage is expensive to unwind.

Core Concepts
  • Token economics and inference margin structure
  • Why API gross margins compress at scale
  • Vertical AI vs horizontal AI platform strategy
  • Data moats, network effects, and workflow lock-in
  • Build vs buy vs fine-tune from the vendor perspective
  • Open vs closed source as a strategic business choice
  • AI-native SaaS vs AI features bolted onto legacy SaaS
  • The wrapper trap and viable paths out of it
  • Enterprise AI sales motion and procurement cycles
Litmus

Why is sub-60% gross margin a red flag for a pure LLM API wrapper, and what structural change would fix it?

08Strategy AI Strategy & Organizational Adoption 1–2 wks+
Why This Layer Exists

Most enterprise AI projects work technically. They fail organizationally. The pilot-to-production gap is a people and process problem, not a model problem. This layer is where technical leaders create business value that engineers alone cannot.

Core Concepts
  • AI maturity models and organizational readiness assessment
  • Build vs buy vs partner from the buyer's perspective
  • The pilot-to-production gap and why POCs stall
  • Change management for AI-disrupted workflows
  • Aligning IT, legal, compliance, and leadership on one rollout
  • AI governance structures inside organizations
  • Measuring and communicating ROI on AI investments
  • The last-mile problem: user adoption and behavioral change
  • Risk frameworks for enterprise AI deployment
Litmus

Could you tell a CFO, in their language, why an 80%-accurate model might still be a bad investment?

09Design Human-Computer Interaction 1–2 wks+
Why This Layer Exists

Streaming output, probabilistic responses, and variable latency break every interaction pattern designed for deterministic software. The conventions of HCI are being rewritten in real time. Most products are not paying attention.

Core Concepts
  • Trust calibration: when confidence should and should not show
  • Latency perception and progressive disclosure
  • Prompt UX as product design, not just engineering
  • Agentic UI: when to interrupt vs proceed autonomously
  • Designing for graceful failure and uncertainty
  • Cognitive load in AI-augmented workflows
  • Streaming output and how it rewrites UX conventions
  • Explainability UX: what users actually need to know
Litmus

How would you design an agent that asks for clarification at exactly the right moments, not too often, not too rarely?

10Embodiment Robotics + Multimodal AI 2–3 wks+
Why This Layer Exists

Text is a compressed channel. Physical manipulation, visual reasoning, and spatial understanding are harder problems with more impact. The bottleneck in robotics is data, not architecture or compute. Knowing why changes how you read every progress claim in this space.

Core Concepts
  • Vision Transformers (ViT) and CLIP architecture
  • Vision-language-action (VLA) models for robotics
  • Sim-to-real transfer and why it is harder than it looks
  • The data bottleneck: why robotics lags language AI
  • Open X-Embodiment and cross-robot transfer
  • Hierarchical planning in embodied agents
  • Multimodal fusion strategies across modalities
  • World models as the path from perception to planning
Litmus

What is the actual bottleneck preventing robot generalization today, and why is the answer not compute?

11Context AI Geopolitics & Governance 1 wk+
Why This Layer Exists

Chip export controls have direct technical consequences. The EU AI Act has direct deployment consequences. These are not abstract policy debates. They are constraints shaping what can be built and where. Literacy here takes one week and compounds across everything else.

Core Concepts
  • US export controls on chips (BIS rules) and their actual effects
  • Semiconductor supply chain: TSMC, ASML, and chokepoints
  • Sovereign AI strategies: EU, India, UAE, China
  • EU AI Act: key obligations and risk tiers
  • Open-source models as geopolitical equalizers
  • Military AI applications and deterrence dynamics
  • Talent, energy, and data as strategic resources
Litmus

Can you read a chip-export headline and immediately know who it affects, without stopping to look anything up?