← LectureMoment
Transformers & Attention · Intermediate
Transformers & Attention — Intermediate
20 practice questions on Transformers & Attention. Every question is written from a specific moment in a real lecture, and after you answer it links to that exact timestamp so you can check it yourself.
What this pack asks
The free questions in this pack. Answer choices and explanations appear as you play.
In a transformer, what happens to a token's vector as it passes through successive blocks?
Answer this one →A query vector for one word is compared to another word's key vector by multiplying paired numbers and summing them. What does a large positive result indicate?
Answer this one →
Written from lectures by 3Blue1Brown, StatQuest with Josh Starmer. Not affiliated with or endorsed by any university, channel, creator or certification program.