AI by Hand ✍️

AI by Hand ✍️

Freezing Layers

Fine-Tuning series: 4 of 8

Prof. Tom Yeh's avatar
Prof. Tom Yeh
Apr 24, 2026
∙ Paid

Fine-Tuning Series:

  1. Weight Update

  2. Pretrain vs Fine-Tune

  3. Full Fine-Tuning

  4. Freezing Layers

  5. Linear Probe

  6. Feature Extraction + Head

  7. Adapter Layers

  8. LoRA

In the previous lesson, full fine-tuning reviewed every prerequisite — Linear Algebra, Probability, Advanced ML — to refresh each subject with the latest topics. Effective, but exhausting.

Paid members: open the interactive diagram below ↓

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2026 Tom Yeh · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture