Weight Update

Fine-Tuning series: 1 of 8

Library › Fine-Tuning

1. Weight Update

2. Pretrain vs Fine-Tune

3. Full Fine-Tuning

4. Freezing Layers

5. Linear Probe

6. Feature Extraction + Head

7. Adapter Layers

8. LoRA

When a neural network learns, what actually changes? Not the architecture: the shape of the network stays fixed. Not the inputs: those come from outside. What moves is the weights.

Paid members: the full breakdown continues below ↓