Archive - AI by Hand ✍️

QLoRA, DoRA, BitFit, NF4 vs INT4

Frontier Model Math by hand ✍️

9 hrs ago •

This Week’s AI by Hand ✍️ Events

18th AI by Hand ✍️ Workshops (8/27)

Aug 25 •

17th AI by Hand ✍️ Workshops

Aug 20 •

Intro to Gen AI Mini Course

Aug 18 •

and

Larissa Schwartz

LoRA, Fine-Tune, Pre-Train

Frontier Model Math by hand ✍️

Aug 18 •

MXFP4, FP4, FP8

Frontier Model Math by hand ✍️

Aug 14 •

Special Lecture: Scaling LLMs in JAX (sponsored by Google)

When Google’s JAX team first approached me to sponsor a special lecture, I told them, “You asked the wrong person.

Aug 13 •

16th AI by Hand ✍️ Workshops

Aug 13 •

MHA, MQA, GQA, MoE-A: More Attention!

Frontier Model Math by hand ✍️

Aug 11 •

New GPT-OSS Trick to Ignore Tokens

Frontier Model Math by hand ✍️

Aug 9 •

NN to Transformer by Hand ✍️

Thank you to the 900+ people who registered my special lecture yesterday—and especially to the 300+ who showed up live!

Aug 8 •

"Expert Choice" Mixture of Experts (MoE)

Frontier Model Math by hand ✍️

Aug 5 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts