Backpropagation, intuitively | Deep Learning Chapter 3

3Blue1Brown November 3, 2017
Video Thumbnail
3Blue1Brown Logo

3Blue1Brown

@3blue1brown

About

My name is Grant Sanderson. Videos here cover a variety of topics in math, or adjacent fields like physics and CS, all with an emphasis on visualizing the core ideas. The goal is to use animation to help elucidate and motivate otherwise tricky topics, and for difficult problems to be made simple with changes in perspective. For more information, other projects, FAQs, and inquiries see the website: https://www.3blue1brown.com

Video Description

What's actually happening to a neural network as it learns? Help fund future projects: https://www.patreon.com/3blue1brown An equally valuable form of support is to simply share some of the videos. Special thanks to these supporters: http://3b1b.co/nn3-thanks Written/interactive form of this series: https://www.3blue1brown.com/topics/neural-networks And by CrowdFlower: http://3b1b.co/crowdflower Home page: https://www.3blue1brown.com/ The following video is sort of an appendix to this one. The main goal with the follow-on video is to show the connection between the visual walkthrough here, and the representation of these "nudges" in terms of partial derivatives that you will find when reading about backpropagation in other resources, like Michael Nielsen's book or Chis Olah's blog. Video timeline: 0:00 - Introduction 0:23 - Recap 3:07 - Intuitive walkthrough example 9:33 - Stochastic gradient descent 12:28 - Final words Thanks to these viewers for their contributions to translations Звуковая дорожка на русском языке: Влад Бурмистров. Italian: @teobucci Vietnamese: CyanGuy111