← LectureMoment
Transformers & Attention · Basics
Transformers & Attention — Basics
20 practice questions on Transformers & Attention. Every question is written from a specific moment in a real lecture, and after you answer it links to that exact timestamp so you can check it yourself.
What this pack asks
The free questions in this pack. Answer choices and explanations appear as you play.
What is "multi-head attention" in a Transformer?
Answer this one →As a word's embedding vector passes through the blocks of a transformer, what is it meant to become?
Answer this one →How does a Transformer arrive at the weight values used in its word-embedding and other layers?
Answer this one →
Written from lectures by StatQuest with Josh Starmer, 3Blue1Brown. Not affiliated with or endorsed by any university, channel, creator or certification program.