Attention: the series
11 interactive diagrams
Attention Series:
1. QKV Projection
2. Attention Computation
3. Self Attention
4. Cross Attention
5. Self Attention vs Cross Attention
6. Self Attention (Shared KV)
7. Multi-Head Attention
8. Fused QKV (Multi-Head)
9. Single vs Multi-Head Attention
10. Multi-Query Attention
11. Grouped-Query Attention
