In this chapter you will practice counting the cost of a matrix product by hand. You will tally the compute, meaning how many dot products you run, and the memory, meaning how many numbers A, B, and C take up. These are the same two costs that decide how big a model can be and how fast it runs.
Next:
3. Shape
Yes, looking into memory is very important ! Thank you for great visualizations.