The Most Important Algorithm in Machine Learning
Artem Kirsanov
@artemkirsanovAbout
Exploring how neural systems learn and compute — at the intersection of neuroscience, computer science, and mathematics. Created by a Harvard neuroscience researcher.
Latest Posts
Video Description
Shortform link: https://shortform.com/artem In this video we will talk about backpropagation – an algorithm powering the entire field of machine learning and try to derive it from first principles. OUTLINE: 00:00 Introduction 01:28 Historical background 02:50 Curve Fitting problem 06:26 Random vs guided adjustments 09:43 Derivatives 14:34 Gradient Descent 16:23 Higher dimensions 21:36 Chain Rule Intuition 27:01 Computational Graph and Autodiff 36:24 Summary 38:16 Shortform 39:20 Outro USEFUL RESOURCES: Andrej Karpathy's playlist: https://youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ&si=zBUZW5kufVPLVy9E Jürgen Schmidhuber's blog on the history of backprop: https://people.idsia.ch/~juergen/who-invented-backpropagation.html CREDITS: Icons by https://www.freepik.com/
You May Also Like
Boost Your ML Skills Today
AI-recommended products based on this video
10ft Rolling Library Ladder Hardware Kit, Sliding Track Kit with Floor Rollers, Loft Hardware for Home Bookshelf Warehouse (No Ladder)
Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code
12.3 Inch Secondary Monitor, IPS Stretched Bar LCD Travel Display 1920 * 720 HDMI USBC, Mini Portable Monitor Metal Material for Laptop Computer Windows Aida64 GPU CPU RAM Monitoring,Built-in Speaker
12.3 Inch Touchscreen Secondary Monitor, IPS Stretched Bar LCD Travel Touch Display 1920 * 720 HDMI USBC, Portable Touch Screen for Laptop Computer Windows Aida64 GPU CPU RAM Monitoring
10.3'' Small Touchscreen Monitor, 400cd/m², VESA, IPS Stretched Bar LCD Mini Travel Touch Display 1920 * 720 HDMI USBC, Portable Touch Screen for Laptop Computer Windows Aida64 GPU CPU RAM Monitoring
Laptop Parts 3Pcs/Set GA82S2H DIY GPU Fan Graphics Card Cooling for ZOTAC RTX 3060 12GD for GE PRO 2060 6G 3060Ti 8G GTX 1660 Super
Portable Carpet & Upholstery Spot Cleaner,15Kpa Powerful Suction and Spot Remover, Deep Stain Cleaning for Carpet, Pets, Stairs, Car Seat, Couch, with Dual Size BrushHead and Cleaning Solutions
Ailltopd Portable Carpet & Upholstery Spot Cleaner, Powerful Suction and Spot Remover, Deep Stain Cleaning for Carpet, Pets, Stairs, Car Seat, Couch, with Dual Size BrushHead and Cleaning Solutions
Handheld Steam Cleaner for Home - Pressurized Handheld Steamer for Cleaning with High Pressure, Chemical-Free Multi-Purpose Portable Deep Steam Cleaner for Cleaning Windows, Couch(White)
Quiet Ear Plugs – Ultra-Comfy Reusable Noise-Reducing Earplugs for Sleep, Concerts, Deep Focus, Travel, Noise Sensitivity | Flexible Hearing Protection | Customizable Fit | 30dB (SNR) Noise Reduction
VASAGLE Nightstand, Side Table with Drawer and Shelf, Bedside Table, End Table with Open Compartment, for Bedroom, Living Room, Cloud White ULET619T14
Buffalo LinkStation 210 4TB 1-Bay NAS Network Attached Storage with HDD Hard Drives Included NAS Storage That Works as Home Cloud or Network Storage Device for Home
ESR for iPhone 16 Pro Max Case, Silicone Case with Stand, Compatible with MagSafe, Built-in Camera Stash Stand, Magnetic Phone Case for iPhone 16 Pro Max, Cloud Series, Light Blue
