← 🤖 AI Programming

Let's build GPT: from scratch, in code, spelled out

Andrej Karpathy builds a GPT language model from scratch, explaining every concept along the way.

Up Next
Intro to Large Language Models

Up Next in AI Programming

Intro to Large Language Models
Intro to Large Language Models
Let's build the GPT Tokenizer
Let's build the GPT Tokenizer
How I Use AI Coding Agents (as a Staff Engineer)
How I Use AI Coding Agents (as a Staff Engineer)
Stanford CS229 — Machine Learning (Andrew Ng)
Stanford CS229 — Machine Learning (Andrew Ng)
Attention is All You Need — Paper Explained
Attention is All You Need — Paper Explained