WED · NOV 13 · 09:42
Welcome back, Sai.
You left off in the middle of a derivation. Let's finish it.
STREAK
23 days
SOLVED
147 problems
§ YOUR PATH · IMPLEMENTATIONest. 9 weeks remaining
MOD 05✓ done→
Backprop by Hand
MOD 06✓ done→
CNNs from Conv2d up
MOD 0734%→
Attention & Transformers
MOD 08queued→
Diffusion Models
§ NOTEBOOKS · RECENT
nb8 cells
attention.heatmap
edited 12 min ago
nb5 cells
softmax.stability
edited 2 hr ago
nb11 cells
kv-cache.memory
edited yesterday
§ PROBLEM QUEUE4 due
14.2.A→
Scaled dot-product attention
medin progress
14.2.B→
Implement masked attention
med
13.4.C→
Layer norm vs batch norm
easyreview
14.3.A→
Multi-head from scratch
hard
§ ACTIVITY · LAST 12 WEEKS
less
more
NEXT MILESTONE
Finish Module 07 — earn the "Wrote a transformer" badge.
5 of 16 chapters~ 11 days