AI Engineering #1: Attention is All You Need

Video Description

In this class, we will look at the attention mechanism used by transformers to enhance input context. We will pick some example text inputs, see how the transformer parses and manipulates the string into tokens, to finally output a text sequence token by token. 1. How are texts parsed into tokens 2. How context is added using the attention mechanism 3. Why the attention mechanism works so well 00:00 Agenda 00:40 Example - 1 04:04 Word Features 12:00 Attention Mechanism 24:11 Result of Attention 27:35 Example - 2 29:56 Visual Understanding 33:40 QnA For more live class updates, subscribe to the channel! You can find me at: Website: https://interviewready.io/ Twitter: http://x.com/gkcs_ LinkedIn: https://www.linkedin.com/in/gkcs/ #AI #ResearchPaper