Self-attention is what enables LLMs to understand context.
Hi professor,
I think there's a typo. q2 should be [1,1,2] instead of [1,1,1].
Thank you!
Carlos
It would be great if we can pose the video to think about what is going on, and if the explanation are next to the video not down . Thanks for your effort
hi professor, i think there is a typo that Wq[3, 2] should be 2 instead of 1.
last line of first calculated matrix should be 3 2 2 1 instead of 3 1 2 1
Hi professor,
I think there's a typo. q2 should be [1,1,2] instead of [1,1,1].
Thank you!
Carlos
It would be great if we can pose the video to think about what is going on, and if the explanation are next to the video not down . Thanks for your effort
hi professor, i think there is a typo that Wq[3, 2] should be 2 instead of 1.
last line of first calculated matrix should be 3 2 2 1 instead of 3 1 2 1