Let’s talk about what mathematical optimization is, how gradient descent can solve simpler optimization problems, and Google DeepMind’s proposed algorithm that automatically learn optimization algorithms.
The paper “Learning to learn by gradient descent
by gradient descent” is available here:
Source code:
______________________________
Recommended for you:
Gradients, Poisson’s Equation and Light Transport –
WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE:
David Jaenisch, Sunil Kim, Julian Josephs, Daniel John Benton.
We also thank Experiment for sponsoring our series. –
Subscribe if you would like to see more of these! –
The chihuahua vs muffin image is a courtesy of teenybiscuit –
More fun stuff here:
The thumbnail background image was created by Alan Levine –
Splash screen/thumbnail design: Felícia Fehér –
Károly Zsolnai-Fehér’s links:
Facebook →
Twitter →
Web →
source