#59 JEFF HAWKINS - Thousand Brains Theory

Video Description

Patreon: https://www.patreon.com/mlst The ultimate goal of neuroscience is to learn how the human brain gives rise to human intelligence and what it means to be intelligent. Understanding how the brain works is considered one of humanity’s greatest challenges. Jeff Hawkins thinks that the reality we perceive is a kind of simulation, a hallucination, a confabulation. He thinks that our brains are a model reality based on thousands of information streams originating from the sensors in our body. Critically - Hawkins doesn’t think there is just one model but rather; thousands. Jeff has just released his new book, A thousand brains: a new theory of intelligence. It’s an inspiring and well-written book and I hope after watching this show; you will be inspired to read it too. Pod version: https://anchor.fm/machinelearningstreettalk/episodes/59---Jeff-Hawkins-Thousand-Brains-Theory-e16sb64 https://numenta.com/a-thousand-brains-by-jeff-hawkins/ https://numenta.com/blog/2019/01/16/the-thousand-brains-theory-of-intelligence/ https://numenta.com/assets/pdf/research-publications/papers/Sparsity-Enables-50x-Performance-Acceleration-Deep-Learning-Networks.pdf https://numenta.com/neuroscience-research/research-publications/papers/a-framework-for-intelligence-and-cortical-function-based-on-grid-cells-in-the-neocortex/ Your Brain Is Not an Onion With a Tiny Reptile Inside https://journals.sagepub.com/doi/full/10.1177/0963721420917687 Pruning Neural Networks at Initialization: Why are We Missing the Mark? https://arxiv.org/abs/2009.08576 Panel: Dr. Tim Scarfe Dr. Keith Duggar https://twitter.com/DoctorDuggar Connor Leahy https://twitter.com/npcollapse Our thanks to: Numenta Matthieu Thiboust (https://www.insightsfromthebrain.com/ + https://twitter.com/mthiboust) Shwetha Bharadwaj (show research https://www.linkedin.com/in/shwetha-bharadwaj-2b926a1b2/) Andreas Koepf (show research https://twitter.com/neurosp1ke?lang=en) Lex Fridman, we used a few clips from his Jeffv2 interview -- https://www.youtube.com/watch?v=Z1KwkpTUbkg -- remember to check Lex's channel out! ❤ [00:00:00] Introduction [00:03:03] The Neocortex [00:09:58] Triune Brain [00:12:24] Grid and place cells [00:14:54] Reference frames [00:21:03] Mountcastle [00:25:46] Thousand brains theory of intelligence [00:32:40] HTM [00:41:12] Sparsity [00:52:57] Main show kick off [00:54:36] Tribalism in the ML Community [00:57:14] Variation in approaches to the same goal [00:59:43] Hawkins ideas validated, cortical uniformity [01:02:25] Sparse distributed representations (SDRs) [01:06:08] Reference frames as generalization [01:10:29] Reference frame remapping [01:14:14] Reference frames can generalize beyond three dimensions [01:17:26] And generalize beyond spatial topology [01:20:12] Intuitions behind why SDRs work well [01:24:03] Are their capacity concerns with the SDR model [01:27:11] At what level between GOFAI and Connectionism should focus our effort? [01:31:33] The brain reasons by abstract movement through reference frames [01:35:34] Human's don't know Universal Truth (if there is even such a thing) [01:37:34] Learning elsewhere in the brain besides the neocortex [01:40:44] Stochastic backpropagation in the human brain [01:44:04] What's missing from artificial neural networks? Numenta's roadmap [01:48:59] AGI Risk - the alignment problem [01:54:07] AGI risk - the neocortex can thwart the old brain [01:57:47] AGI risk - artificial evolution [02:01:18] AGI risk - yes we need to think on and develop adequate control systems [02:03:48] A balance of knowledge: innate, experiential, taught, or deduced [02:16:09] post-show wrap-up [02:16:59] Advancements in direction at Numenta [02:19:50] AGI risk recap [02:23:56] Ought did evolve from Is, humans are the proof [02:26:29] When AGI overcomes our weaknesses [02:28:54] Who doesn't like forking?! [02:30:29] Coherent synchronization as a measure of identity #machinelearning #artificialintelligence Music credit; https://soundcloud.com/calicry/nolightwithoutdark https://soundcloud.com/sibewest/sibewest-nero https://soundcloud.com/immnnt/skeler-kensho https://soundcloud.com/hypeerbeats/s-o-l-a-r-i-s https://soundcloud.com/vskymusic/empty https://soundcloud.com/zeitfall/moment https://soundcloud.com/prodjai/reticent https://soundcloud.com/blazingbeatzz/velvet https://soundcloud.com/sekai-collective/c-a-l-i-c-r-y-lalala https://soundcloud.com/mattlange/sets/ephemera https://soundcloud.com/mrsuicidesheep/elo-method-subranger-solace https://soundcloud.com/ukowens1 https://soundcloud.com/vskymusic/sets/nightwalk https://soundcloud.com/calicry/be-here https://soundcloud.com/xxxxzomb/divine