Freezing Layers

Fine-Tuning series: 4 of 9

Library › Fine-Tuning

1. Weight Update

2. Pretrain vs Fine-Tune

3. Full Fine-Tuning

4. Freezing Layers

5. Linear Probe

6. Feature Extraction + Head

7. Adapter Layers

8. LoRA

9. Full Fine-Tuning vs LoRA

In the previous lesson, full fine-tuning reviewed every prerequisite (Linear Algebra, Probability, Advanced ML) to refresh each subject with the latest topics. Effective, but exhausting.

Paid members: the full breakdown continues below ↓