Visualizing transformers and attention | Talk for TNG Big Tech Day '24
Grant Sanderson
•
November 20, 2024
Grant Sanderson
@grantsandersonAbout
Sister channel to 3Blue1Brown for side projects.
Latest Posts
Video Description
An overview of transforms, as used in LLMs, and the attention mechanism within them. Based on the 3blue1brown deep learning series: https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi
Essential AI Tools Now
AI-recommended products based on this video
Loading...
Skytech Archangel Gaming PC Desktop – AMD Ryzen 5 3600 3.6 GHz, NVIDIA RTX 3060, 1TB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit
(31)
$2,657.01$2,656.90
FREE delivery Feb 24 - Mar 3
Loading...
Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit
(786)
$1,414.11
FREE delivery Thu, Feb 19Only 4 left in stock.
Loading...
MSI NVIDIA GeForce RTX 3050 Ventus 2X XS 8G OC Graphics Card - 8 GB GDDR6, 1807 MHz, PCI Express Gen 4, 128 Bits, DP v 1.4a, DL DVI-D, HDMI 2.1 (Supports 4K at 120Hz)
(760)
$1,020.45
Loading...
Asus Dual NVIDIA GeForce RTX 3050 6GB OC Edition Gaming Graphics Card - PCIe 4.0, 6GB GDDR6 Memory, HDMI 2.1, DisplayPort 1.4a, 2-Slot Design, Axial-tech Fan Design, 0dB Technology, Steel Bracket
(903)
$248.98
FREE delivery Sat, Jan 3
300+ bought in past month
Loading...
8000mAh Hand Warmers Rechargeable 2 Pack, AI Smart Chip Long Safe Heat, Quick Charge Electric Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories
(9)
$20.99
FREE delivery Sat, Jun 14 on your first order
Loading...
Hand Warmers Rechargeable 2 Pack, AI Smart Chip 20Hrs Long Safe Heat, 2s Fast Heating Up to 140℉, Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories
(6)
$20.29
FREE delivery Sat, Jun 14 on your first order
Loading...
Flotstiga AI Hand Warmers Rechargeable 2 Pack,6000mAh Electric Hand Warmers,AI Smart Chips 20Hrs Long Safe Heat Pocket Size Heater Great Warm,Gifts for Christmas, Golf, Hunting, Camping Accessories
(29)
$18.99
FREE delivery Sat, Jun 14 on your first order
Loading...
8000mAh Hand Warmers Rechargeable 2 Pack, AI Smart Chip Long Safe Heat, Quick Charge Electric Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories
(9)
$20.99
FREE delivery Sat, Jun 14 on your first order
Loading...
Hand Warmers Rechargeable 2 Pack, AI Smart Chip 20Hrs Long Safe Heat, 2s Fast Heating Up to 140℉, Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories
(6)
$20.29
FREE delivery Sat, Jun 14 on your first order
Loading...
soundcore by Anker P20i True Wireless Earbuds, 10mm Drivers with Big Bass, Bluetooth 5.3, 30H Long Playtime, IPX5 Water-Resistant, 2 Mics for AI Clear Calls, 22 Preset EQs, Customization via App
(61,759)
$29.99
FREE delivery Sat, Jun 14 on your first order
4K+ bought in past month
Loading...
Tablet Latest Android Tablets with 10 Inch Incell Display, 24GB+256GB ROM /2TB TF, Gemini AI, T606 Octa-Core 8MP Camera Tablette Android, Widevine L1, 2 in 1 Tablets with Keyboard Mouse Stylus
(241)
$149.99
FREE delivery Wed, Aug 27
100+ bought in past month
Loading...
Amazon's Choice
LG 55-Inch C4 OLED evo 4K Smart TV - α9 AI Processor 4K, Alexa Built-in, 144Hz Refresh Rate, HDMI 2.1, G-Sync, FreeSync, VRR, WebOS 24, Dolby Vision, Dolby Atmos (OLED55C4PUA, 2024)
(83)
1,496.98
PrimeFREE delivery Saturday, June 14