← LectureMoment
Retrieval-Augmented Generation · Advanced
Retrieval-Augmented Generation — University Lecture
20 practice questions on Retrieval-Augmented Generation. Every question is written from a specific moment in a real lecture, and after you answer it links to that exact timestamp so you can check it yourself.
What this pack asks
The free questions in this pack. Answer choices and explanations appear as you play.
A transformer with ordinary bidirectional self-attention is trained to predict the next token at every position. Why does this setup fail?
Answer this one →When sampling next tokens, each low-probability "tail" word is individually unlikely. Why is the tail still a serious failure risk?
Answer this one →
Written from lectures by MIT OpenCourseWare. Not affiliated with or endorsed by any university, channel, creator or certification program.