← LectureMoment
Transformers & Attention · Advanced
Transformers & Attention — Advanced
20 practice questions on Transformers & Attention. Every question is written from a specific moment in a real lecture, and after you answer it links to that exact timestamp so you can check it yourself.
What this pack asks
The free questions in this pack. Answer choices and explanations appear as you play.
One learned query matrix is multiplied by every token's embedding, yet each token can pose a different "question". Why?
Answer this one →
Written from lectures by 3Blue1Brown. Not affiliated with or endorsed by any university, channel, creator or certification program.