This is the second video on attention mechanisms. In the previous video we introduced self attention and in this video we're going to expand the idea by introducing keys, queries and values.

We're going at it step by step, but if you're interested in immediately reading all about it in full detail then we might recommend these online documents:

http://www.peterbloem.nl/blog/transfo...
http://jalammar.github.io/illustrated...
http://d2l.ai/chapter_attentionmecha...

The general github repo for this playlist can be found here: https://github.com/RasaHQ/algorithmw....