If You Only Pick Five
The shortest path
Start-here sequence
- 3Blue1Brown β Neural Networks series β the visual intuition for how models work (Phase 1)
- Karpathy β βDeep Dive into LLMs like ChatGPTβ β one video, the whole mental model (Phase 1)
- mlabonne/llm-course β your working roadmap with notebooks (Phases 2β4)
- anthropics/courses + openai/openai-cookbook β prompting, tool use, evals, hands-on (Phases 2β5)
- DataTalksClub/llm-zoomcamp β a structured course that ends with a real project (Phases 3β5)
GitHub
The repos worth starring
These are the most-used free curricula and example collections in the field β not a random awesome-list dump.
mlabonne / llm-course
The de-facto LLM learning roadmap: Fundamentals, LLM Scientist, and LLM Engineer tracks with free Colab notebooks.
Best for: Phases 2β4 β your main map
microsoft / generative-ai-for-beginners
Microsoft's 21-lesson GenAI curriculum β prompting, RAG, agents, fine-tuning β with Python and TypeScript samples.
Best for: Phases 1β3 β structured basics
microsoft / ai-agents-for-beginners
18 lessons taking you from agent basics through planning, multi-agent patterns, security, and deployment.
Best for: Phase 4 β agents, end to end
Shubhamsaboo / awesome-llm-apps
100+ working open-source AI agents and RAG apps you can run, read, and rebuild. Apache-2.0 licensed.
Best for: Phases 3β4 β learn by dissecting
anthropics / claude-cookbooks
Anthropic's official notebooks: RAG, tool use, vision, sub-agents, and evaluation patterns with Claude.
Best for: Phases 2β5 β production patterns
openai / openai-cookbook
OpenAI's example gallery for the API β structured outputs, embeddings, evals β also browsable at cookbook.openai.com.
Best for: Phases 2β5 β production patterns
DataTalksClub / llm-zoomcamp
A free 10-week course on real-life LLM applications β 7 modules plus a capstone project, run as a cohort every year.
Best for: Phases 3β5 β structure + deadline
rasbt / LLMs-from-scratch
Implement a ChatGPT-like model in PyTorch, step by step β the companion code to Raschka's book.
Best for: After Phase 5 β understand the internals
chiphuyen / aie-book
Resources for Chip Huyen's AI Engineering (2025) β the book that defined this role. Chapter notes, prompts, case studies.
Best for: All phases β the reference book
microsoft / AI-For-Beginners
12-week classic-AI curriculum (neural nets, CV, NLP) with quizzes and labs β if you want broader foundations first.
Best for: Phase 1 β optional deeper base
YouTube
Videos that are actually worth the hours
Karpathy β Deep Dive into LLMs like ChatGPT
The single best explanation of the full LLM pipeline: pretraining, fine-tuning, RLHF, hallucinations, and how to use models well.
Best for: Phase 1 β watch this first
Karpathy β Intro to Large Language Models
The famous "busy person's intro" β what LLMs are, scaling, tool use, and security, in one lecture.
Best for: Phase 1 β the short version
Karpathy β Neural Networks: Zero to Hero
Build neural nets and a GPT from scratch, in code, from backprop up. Pairs with the nn-zero-to-hero repo.
Best for: Phase 1β2 β if you like learning by building
3Blue1Brown β Neural Networks
The most beautiful visual explanations of neural nets, gradient descent, and how transformers/attention work.
Best for: Phase 1 β intuition before code
StatQuest with Josh Starmer
~300 short videos that demystify the stats and ML concepts everyone else assumes you know. BAM.
Best for: Phase 1 β fill any gap fast
freeCodeCamp.org
Free full-length courses β search the channel for RAG, LangChain, or "LLM course" for multi-hour hands-on builds.
Best for: Phases 2β4 β long-form practice
AI Engineer (conference)
Talks from the AI Engineer Summit/World's Fair β how real teams build agents, evals, and RAG in production.
Best for: Phases 4β5 β how the industry does it
Courses & Roadmaps
Structured, free, certificate-friendly
roadmap.sh β AI Engineer
A clickable skill tree for the role β track your progress topic by topic. From the team behind the famous developer roadmaps.
Best for: All phases β progress tracking
Hugging Face Learn
12 free community courses β the LLM Course and the Agents Course (free certificate) are the standouts.
Best for: Phases 2 & 4
DeepLearning.AI courses
Andrew Ng's 1β2 hour short courses with practitioners from OpenAI, Anthropic, and LangChain β RAG, agents, evals, and more.
Best for: Phases 2β5 β one topic per lunch break
fast.ai β Practical Deep Learning
The legendary top-down course: train real models in lesson one, understand the theory later. Free book included.
Best for: Phase 1 β optional ML depth
Anthropic Academy
Free certificate courses on AI fluency, the Claude API, MCP, and Claude Code β plus the hands-on anthropics/courses notebooks.
Best for: Phases 2, 4, 5 β API, tools, evals
Blogs & Newsletters
Stay current without drowning
The field moves weekly. These six keep you sharp with signal, not noise.
Lil'Log β Lilian Weng
The most-cited technical explainers on agents, hallucination, and RLHF β written by an OpenAI research leader.
Chip Huyen
Essays on real-world AI engineering β her "Agents" and "Building a Generative AI Platform" posts are required reading.
Simon Willison's Weblog
Near-daily, hype-free tracking of every model release, price change, and security issue that matters.
The Illustrated Transformer
Jay Alammar's visual walkthrough of the transformer β used in courses at Stanford, MIT, Harvard, and CMU.
Latent Space
The newsletter/podcast for AI engineers β swyx coined the role. Interviews with the people building the tools you use.
Ahead of AI β Sebastian Raschka
Research digested into readable engineering takeaways β what actually changed this month and why it matters.