But what is a Neural Network? | Deep learning, chapter 1
Home page: www.3blue1brown.com/
Brought to you by you: 3b1b.co/nn1-thanks
Additional funding provided by Amplify Partners
Full playlist: 3b1b.co/neural-networks
Typo correction: At 14 minutes 45 seconds, the last index on the bias vector is n, when it's supposed to in fact be a k. Thanks for the sharp eyes that caught that!
For those who want to learn more, I highly recommend the book by Michael Nielsen introducing neural networks and deep learning: goo.gl/Zmczdy
There are two neat things about this book. First, it's available for free, so consider joining me in making a donation Nielsen's way if you get something out of it. And second, it's centered around walking through some code and data which you can download yourself, and which covers the same example that I introduce in this video. Yay for active learning! github.com/mnielsen/neural-networks-and-deep-learning
I also highly recommend Chris Olah's blog: colah.github.io/
For more videos, Welch Labs also has some great series on machine learning: youtu.be/i8D90DkCLhI youtu.be/bxe2T-V8XRs
For those of you looking to go *even* deeper, check out the text «Deep Learning» by Goodfellow, Bengio, and Courville.
Also, the publication Distill is just utterly beautiful: distill.pub/
Lion photo by Kevin Pluck
— Timeline:
0:00 — Introduction example
1:07 — Series preview
2:42 — What are neurons?
3:35 — Introducing layers
5:31 — Why layers?
8:38 — Edge detection example
11:34 — Counting weights and biases
12:30 — How learning relates
13:26 — Notation and linear algebra
15:17 — Recap
16:27 — Some final words
17:03 — ReLU vs Sigmoid
— Animations largely made using manim, a scrappy open source python library. github.com/3b1b/manim
If you want to check it out, I feel compelled to warn you that it's not the most well-documented tool, and has many other quirks you might expect in a library someone wrote with only their own use in mind.
Music by Vincent Rubinetti.
Download the music on Bandcamp: vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
Stream the music on Spotify: open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u
If you want to contribute translated subtitles or to help review those that have already been made by others and need approval, you can click the gear icon in the video and go to subtitles/cc, then «add subtitles/cc». I really appreciate those who do this, as it helps make the lessons accessible to more people.
— 3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe, and click the bell to receive notifications (if you're into that).
If you are new to this channel and want to see more, a good place to start is this playlist: 3b1b.co/recommended
Various social media stuffs:
Website: www.3blue1brown.com
Twitter: twitter.com/3Blue1Brown
Patreon: patreon.com/3blue1brown
Facebook: www.facebook.com/3blue1brown
Reddit: www.reddit.com/r/3Blue1Brown
The astonishingly real virtual baby that laughs, cries — and learns | Mark Sagar | TEDxChristchurch
This talk was given at a local TEDx event, produced independently of the TED Conferences. In this jaw-dropping talk, Academy Award winner Dr. Mark Sagar demonstrates his Baby X: a virtual baby that laughs, cries, and learns, driven by a complex series of brain, neural and somatosensory models.
Academy Award winner Dr. Mark Sagar is the director of the Laboratory for Animate Technologies at the Auckland Bioengineering Institute, where his interest is in bringing digital characters to life using artificial nervous systems to empower the next generation of human computer interaction. His laboratory is pioneering neurobehavioral animation that combines biologically based models of faces and neural systems to create live, naturally intelligent, and highly expressive interactive systems. Mark previously worked as the Special Projects Supervisor at Weta Digital and Sony Pictures Imageworks and developed technology for the characters in blockbusters such as Avatar, King Kong, and Spiderman 2. His pioneering work in computer-generated faces was recognized with two consecutive Scientific and Engineering Oscars in 2010 and 2011. Dr. Sagar holds a Ph.D. in Bioengineering and is a recipient of the University of Auckland’s 2012 Distinguished Alumni Award.
About TEDx, x = independently organized event In the spirit of ideas worth spreading, TEDx is a program of local, self-organized events that bring people together to share a TED-like experience. At a TEDx event, TEDTalks video and live speakers combine to spark deep discussion and connection in a small group. These local, self-organized events are branded TEDx, where x = independently organized TED event. The TED Conference provides general guidance for the TEDx program, but individual TEDx events are self-organized.* (*Subject to certain rules and regulations)
Lenovo X1 Fold: World's First Foldable Computer is the Future
If you've ever wondered what computers will look like in the future, take a look at the X1 Fold. This premium business computer is the world's first foldable computer and a true game-changer.
Apple is building its own Mac CPUs, does this mean ARM has won? | Upscaled
After almost 15 years of using Intel chips in its laptops and desktops, Apple announced it will be transitioning its computers over to use chips based on the designs in the iPhone and iPad.
This will mark the first time in years we'll see high-performance designs based on RISC designs. RISC was a design philosophy developed in the early 80s to fix a lot of the problems in early CPUS. It was revolutionary, but in recent years RISC has been relegated to low-powered and battery bound devices while CISC chips like those from Intel and AMD dominate the high-end of computing.
But as smartphone chips have gotten more powerful, a debate has started over whether RISC is an inherently superior design. Apple sure seems to think it can use ARM-based RISC chips to make some truly powerful processors, but like everything in computing, it's a bit more complicated than that.
Check out our sources and some other great videos on this topic below
The Evolution Of CPU Processing Power Part 1: The Mechanics Of A CPU www.youtube.com/watch?v=sK-49uz3lGg
Programming Like It's 1979: 6502 Assembly language on the Apple ][ www.youtube.com/watch?v=PNOj6GTzfGY
Ken Thompson and Dennis Ritchie Explain UNIX (Bell Labs) www.youtube.com/watch?v=JoVQTPbD6UY
Processing Integrated Circuits at Bell Labs (1979) — AT&T Archives www.youtube.com/watch?v=uLReXtpNlbw
The Computer Chronicles — Reduced Instruction Set Computer (RISC) (1986) www.youtube.com/watch?v=DIccm7H3OA0
UNIX: Making Computers Easier To Use — AT&T Archives film from 1982, Bell Laboratories www.youtube.com/watch?v=XvDZLjaCJuw&list=PLDB8B8220DEE96FD9&index=31&
The Computer Chronicles — PowerPC and PowerMac (1994) www.youtube.com/watch?v=Ic0dkf1iFOY
How Computer Chips are made — Commodore Computer Factory Tour www.youtube.com/watch?v=xu8Fi0tC9IA
ACM A.M. Turing Award 2017: David Patterson and John Hennessy www.youtube.com/watch?v=4OmnybxvTzA
IBM RISC System/6000 Introduction www.youtube.com/watch?v=VQSTg2nA65M&t
SGI Indy UNIX Workstation Review (1993) — Silicon Classics #7 www.youtube.com/watch?v=Qk_JjfeChQA&t=373s
Silicon Graphics — Onyx Infinite Reality 50FPS www.youtube.com/watch?v=kY1mi0809BQ
How To Make Bread | Jamie Oliver — AD www.youtube.com/watch?v=VrUdtzXquWk
Apple October Event 2018 www.youtube.com/watch?v=bfHEnw6Rm-4&t=23s
ztarkm