I Talked with Rich Sutton
Edan Meyer
@edanmeyerAbout
I like to talk about AI, Machine Learning, and especially a lot of Reinforcement Learning! Most of my content is educational and focused on research that I find interesting.
Latest Posts
Video Description
After a year of anticipation, I finally got to talk with Rich Sutton for the channel! Rich wrote the book on reinforcement learning, has contributed vastly to the literature, and has a unique perspective on AI. We talk about topics like reinforcement learning, the OpenMind Research Institute (OMRI), Keen Technologies, how to do good research, the problem of scale, superintelligence, and so much more. Outline 0:00 - Intro 1:33 - Interview start 2:04 - OpenMind Research Institute 4:32 - History of AI 7:13 - Is scaling easy? 10:49 - The problem with backprop & representations 21:22 - Rant on tunnel vision 23:43 - New exciting things 32:00 - Memory 35:34 - Coming up with ideas 43:47 - STOMP 45:30 - Keen Technologies 50:39 - The next stage of humanity & emotions 1:06:25 - Extraterrestrial AI 1:08:00 - A different approach to research 1:21:30 - Rich's advice 1:26:00 - Beef with RL 1:27:07 - Bringing it all together Amii's website: https://www.amii.ca/ Rich's website: http://www.incompleteideas.net/ Social Media YouTube - https://youtube.com/c/EdanMeyer Twitter/X - https://twitter.com/ejmejm1
Upgrade Your Gaming Setup
AI-recommended products based on this video

Skytech Archangel Gaming PC Desktop – AMD Ryzen 5 3600 3.6 GHz, NVIDIA RTX 3060, 1TB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

ASUS TUF Gaming A15 Gaming Laptop, 15.6” 144Hz FHD Display, AMD Ryzen 5 7535HS Processor, GeForce RTX 2050, 8GB DDR5 RAM, 512GB PCIe SSD Gen 4, Wi-Fi 6, Windows 11, FA506NF-AS51-CA

BOSGAME E4 Mini PC, Ryzen 5 3550H Mini Computers, 16GB DDR4 1TB PCIe SSD, Dual RJ45 LAN, 4K Triple Display, USB-C & USB 3.2, Wi-Fi 5 & BT 5.0, Desktop Computers for Office, Home, Streaming

EZDIY-FAB RTX 3000 Series 12 Pin to Dual 8 Pin PCIe Sleeved Extension Cable 300 MM- Connector for NVIDIA Ampere GEFORCE RTX 3060ti 3070 3080 FE Funder Edition- White

MSI MPG X870E Carbon WiFi Gaming Motherboard (AMD Ryzen 9000/8000/7000 Series Processors, AM5, DDR5, PCIe 5.0, SATA 6Gb/s, M.2, USB 3.2 Gen 2, Wi-Fi 6E, Bluetooth 5.3, LAN 2.5Gbps, HDMI/DP, ATX)

MSI MPG Z790 Carbon WiFi II Gaming Motherboard (Supports 12th/13th/14th Gen Intel Processors, LGA 1700, DDR5, PCIe 5.0, M.2, 2.5Gbps LAN, USB 3.2 Gen2, Wi-Fi 7, ATX)

MSI MPG X870E Edge TI WiFi Gaming Motherboard (AMD Ryzen 9000/8000/7000 Series Processors, AM5, DDR5, PCIe 4.0, M.2, SATA 6Gb/s, USB 3.2 Gen 2, HDMI/DP, Wi-Fi 7, Bluetooth 5.3, 2.5Gbps LAN, ATX)

MSI MPG A1000GS PCIE5, Fully Modular Gaming 1000W Power Supply, 80+ Gold, Dual 12V-2x6 Cables, Server-Grade, ATX 3.1 & PCIe 5.1, Low-Noise, Semi Digital, Embossed Jacket Cables, 10 Year Warranty

Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)
![SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]](https://m.media-amazon.com/images/I/71lzXt4djxL._AC_UY654_FMwebp_QL65_.jpg)
SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]
![Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]](https://m.media-amazon.com/images/I/71gQWJ9ufdL._AC_UL960_FMwebp_QL65_.jpg)
Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]
![SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]](https://m.media-amazon.com/images/I/911ujeCkGfL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

Corsair CP-9020140-UK HX1200 1200 W 80+ Platinum Fully Modular Power Supply Unit - Black

Corsair RM1000e Fully Modular Low-Noise ATX Power Supply - Dual EPS12V Connectors - 105°C-Rated Capacitors - 80 Plus Gold Efficiency - Modern Standby Support - Black

Corsair SF1000 (2024) Fully Modular Low Noise 80 Plus Platinum ATX Power Supply – ATX 3.1 Compliant – PCIe 5.1 Ready – SFX-to-ATX Bracket Included – Black

Corsair HX1200i (2025) Fully Modular Ultra-Low Noise ATX Power Supply with 12V-2x6 Cable – ATX 3.1 & PCIe 5.1 Compliant, Cybenetics Platinum Efficiency, Fluid Dynamic Bearing Fan – Black

CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intel® LGA 1700, AMD® AM5 and Older - White

CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black






