Complexity

Matrix Multiplication: 2 of 16

Library › Matrix Multiplication

1. Calculate

2. Complexity

3. Shape

4. Identity

5. Scale

6. Shift

7. Combine Rows

8. Combine Columns

9. Not Commutative

10. Associative

11. Distributive

12. Chain

13. Transpose

14. Inverse

15. Linear Equations

16. Tiled Algorithm

In this chapter you will practice counting the cost of a matrix product by hand. You will tally the compute, meaning how many dot products you run, and the memory, meaning how many numbers A, B, and C take up. These are the same two costs that decide how big a model can be and how fast it runs.

---

---

---

---

---

The rest of the chapter (Page 39 ~ 46) and the solutions are available to AI by Hand Academy members. You can become a member via a paid Substack subscription.