← 🤖 AI Programming

Let's build GPT: from scratch, in code, spelled out

Andrej Karpathy builds a GPT language model from scratch, explaining every concept along the way.

Up Next
Intro to Large Language Models

Playlist (6)

Let's build GPT: from scratch, in code, spelled out
Let's build GPT: from scratch, in code, spelled out
123:00
Intro to Large Language Models
Intro to Large Language Models
60:00
Let's build the GPT Tokenizer
Let's build the GPT Tokenizer
132:00
How I Use AI Coding Agents (as a Staff Engineer)
How I Use AI Coding Agents (as a Staff Engineer)
20:00
Stanford CS229 — Machine Learning (Andrew Ng)
Stanford CS229 — Machine Learning (Andrew Ng)
75:00
Attention is All You Need — Paper Explained
Attention is All You Need — Paper Explained
45:00