One of the key ingredients of the deep learning revolution is the ability to perform matrix multiplications at incredible speed and scale.