A Brain-Inspired Algorithm For Memory

Artem Kirsanov July 3, 2024
Video Thumbnail
Artem Kirsanov Logo

Artem Kirsanov

@artemkirsanov

About

Exploring how neural systems learn and compute — at the intersection of neuroscience, computer science, and mathematics. Created by a Harvard neuroscience researcher.

Video Description

Get 20% off at https://shortform.com/artem In this video we will explore the concept of Hopfield networks – a foundational model of associative memory that underlies many important ideas in neuroscience and machine learning, such as Boltzmann machines and Dense associative memory. Socials: X/Twitter: https://x.com/ArtemKRSV Patreon: https://www.patreon.com/artemkirsanov OUTLINE: 00:00 Introduction 02:17 Protein folding paradox 04:23 Energy definition 08:25 Hopfield network architecture 14:03 Inference 18:40 Learning 22:48 Limitations & Perspective 24:43 Shortform 25:54 Outro References: 1) Downing, K.L., 2023. Gradient expectations: structure, origins, and synthesis of predictive neural networks. The MIT Press, Cambridge, Massachusetts. 2) https://towardsdatascience.com/hopfield-networks-neural-memory-machines-4c94be821073 3) https://ml-jku.github.io/hopfield-layers/ Special thanks to Crimson Ghoul for providing English subtitles! Credits: Protein folding: https://www.youtube.com/shorts/fvBO3TqJ6FE 🎵 Music licensed from Lickd. The biggest mainstream and stock music platform for content creators Viva La Vida by Coldplay, https://lickd.lnk.to/4aEPvoID License ID: RXj082JWjbA Try Lickd FREE for 14 days for unlimited stock music and get 50% off your first mainstream track: https://app.lickd.co/r/47462149f85b4b6e9660bbe6d9b0f944

Boost Your Memory Today

AI-recommended products based on this video

Loading...
NEW SteelSeries Arctis Nova 3 Multi-Platform Gaming Headset - Signature Arctis Sound - ClearCast Gen 2 Mic - PC, PS5/PS4, Xbox Series X|S, Switch, Mobile

NEW SteelSeries Arctis Nova 3 Multi-Platform Gaming Headset - Signature Arctis Sound - ClearCast Gen 2 Mic - PC, PS5/PS4, Xbox Series X|S, Switch, Mobile

(9,500)
$99.98$67.37
PrimeFREE delivery Sat, Jun 14
100+ bought in past month
Loading...
Razer BlackShark V2 X Gaming Headset: 50mm Drivers - Cardioid Mic - Memory Foam Cushion - Lightweight- Comfortable, Noise Isolating Earcups - for PC, PS4, PS5, Switch - 3.5mm Audio Jack - Black ECOLOGO

Razer BlackShark V2 X Gaming Headset: 50mm Drivers - Cardioid Mic - Memory Foam Cushion - Lightweight- Comfortable, Noise Isolating Earcups - for PC, PS4, PS5, Switch - 3.5mm Audio Jack - Black ECOLOGO

(17,449)
$54.98$48.21
FREE delivery Mon, Jan 26
3K+ bought in past month
Loading...
Meta Quest Carrying Case for Meta Quest 3/3S - Premium Style and Protection - Fits Headset, Touch Plus Controller, Head Strap, Active Straps, Charging Cable and Adapter 24.2 cm x 32.8 cm x 12.8 cm

Meta Quest Carrying Case for Meta Quest 3/3S - Premium Style and Protection - Fits Headset, Touch Plus Controller, Head Strap, Active Straps, Charging Cable and Adapter 24.2 cm x 32.8 cm x 12.8 cm

(175)
$76.00$73.64
FREE delivery Tue, Jun 17
Loading...
Automatic Cooling Fan and Charger Station Accessories for Xbox Series X Console&Controller, Temperature Control Fan System and Charging Dock with 11 RGB Lights, 2 Rechargeable Batteries, Headset Stand
Best Seller

Automatic Cooling Fan and Charger Station Accessories for Xbox Series X Console&Controller, Temperature Control Fan System and Charging Dock with 11 RGB Lights, 2 Rechargeable Batteries, Headset Stand

(81)
$69.99
PrimeFREE delivery Sat, Jun 14
Loading...
Apple Watch SE (2nd Gen) [GPS 44mm] Smartwatch with Midnight Aluminium Case with Midnight Sport Band. Fitness and Sleep Trackers, Crash Detection, Heart Rate Monitor, Water-Resistant

Apple Watch SE (2nd Gen) [GPS 44mm] Smartwatch with Midnight Aluminium Case with Midnight Sport Band. Fitness and Sleep Trackers, Crash Detection, Heart Rate Monitor, Water-Resistant

(48)
$299.00$224.25
FREE delivery Tue, Jul 1
300+ bought in past month
Loading...
Apple Watch SE (2nd Gen) [GPS 40mm] Smartwatch with Starlight Aluminium Case with Starlight Sport Band. Fitness and Sleep Trackers, Crash Detection, Heart Rate Monitor, Water-Resistant

Apple Watch SE (2nd Gen) [GPS 40mm] Smartwatch with Starlight Aluminium Case with Starlight Sport Band. Fitness and Sleep Trackers, Crash Detection, Heart Rate Monitor, Water-Resistant

(55)
$259.00$194.25
PrimeFREE delivery Sat, Jun 14
200+ bought in past month
Loading...
Apple Watch SE (2nd Gen) [GPS 40mm] Smartwatch with Starlight Aluminium Case with Starlight Sport Band. Fitness and Sleep Trackers, Crash Detection, Heart Rate Monitor, Water-Resistant

Apple Watch SE (2nd Gen) [GPS 40mm] Smartwatch with Starlight Aluminium Case with Starlight Sport Band. Fitness and Sleep Trackers, Crash Detection, Heart Rate Monitor, Water-Resistant

(81)
$259.00
FREE delivery Thu, Jun 19
500+ bought in past month
Loading...
Sperax 4 in 1 Walking Vibration Pad Treadmill, Walking Treadmill Pad for Home with Remote Control and APP Global Recycled Standard

Sperax 4 in 1 Walking Vibration Pad Treadmill, Walking Treadmill Pad for Home with Remote Control and APP Global Recycled Standard

(9,887)
$239.99$220.79
FREE delivery Fri, Mar 13
5K+ bought in past month
Loading...
Large Labyrinth 3D Puzzles Maze Cube with Rolling Ball, Challenging Brain Teaser Puzzles for Adults & Kids, High-Difficulty Cube Logic Game for Spatial Awareness Focus Training Stress Relief (Blue)

Large Labyrinth 3D Puzzles Maze Cube with Rolling Ball, Challenging Brain Teaser Puzzles for Adults & Kids, High-Difficulty Cube Logic Game for Spatial Awareness Focus Training Stress Relief (Blue)

(3)
$16.99
$5.99 delivery Dec 19 - 29
400+ bought in past month
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

(2,409)
$181.38
FREE delivery Mon, Aug 11
Loading...
【DDR3 RAM】 GIGASTONE 16GB Kit (2x8GB) DDR3/DDR3L 1600MHz (1333MHz) PC3-12800 (PC3-10600) CL11 1.35V/1.5V 2Rx8 UDIMM 240 Pin Unbuffered Non ECC High Performance PC Desktop Memory Upgrade

【DDR3 RAM】 GIGASTONE 16GB Kit (2x8GB) DDR3/DDR3L 1600MHz (1333MHz) PC3-12800 (PC3-10600) CL11 1.35V/1.5V 2Rx8 UDIMM 240 Pin Unbuffered Non ECC High Performance PC Desktop Memory Upgrade

(1,385)
$32.99
FREE delivery Sun, Jun 15 on your first order
Loading...
【DDR3 RAM】 GIGASTONE 32GB Kit (4x8GB) DDR3/DDR3L 1600MHz (1333MHz) PC3-12800 (PC3-10600) CL11 1.35V/1.5V 2Rx8 UDIMM 240 Pin Unbuffered Non ECC High Performance PC Desktop Memory Upgrade

【DDR3 RAM】 GIGASTONE 32GB Kit (4x8GB) DDR3/DDR3L 1600MHz (1333MHz) PC3-12800 (PC3-10600) CL11 1.35V/1.5V 2Rx8 UDIMM 240 Pin Unbuffered Non ECC High Performance PC Desktop Memory Upgrade

(1,330)
$55.99
FREE delivery Sun, Jun 15
Loading...
【DDR3 RAM Laptop Only】 GIGASTONE 16GB Kit (2x8GB) DDR3/DDR3L 1600MHz (1333MHz) PC3-12800 (PC3-10600) CL11 1.35V/1.5V 2Rx8 SODIMM 204 Pin Unbuffered Non ECC High Performance Notebook Memory Upgrade

【DDR3 RAM Laptop Only】 GIGASTONE 16GB Kit (2x8GB) DDR3/DDR3L 1600MHz (1333MHz) PC3-12800 (PC3-10600) CL11 1.35V/1.5V 2Rx8 SODIMM 204 Pin Unbuffered Non ECC High Performance Notebook Memory Upgrade

(1,599)
$32.99
FREE delivery Sun, Jun 15 on your first order
50+ bought in past month
Loading...
High Potency NMN Supplement Canada – 600mg NMN | Pure NAD+ Booster for Energy, Longevity, Brain & Metabolism | NAD Supplement, Non-GMO, Vegan, 60 Capsules

High Potency NMN Supplement Canada – 600mg NMN | Pure NAD+ Booster for Energy, Longevity, Brain & Metabolism | NAD Supplement, Non-GMO, Vegan, 60 Capsules

(8)
$18.99
FREE delivery Sat, Sep 20 on your first order
700+ bought in past month