Learn how to use the idea of Momentum to accelerate Gradient Descent.



References:
Lectures on Convex Optimization by Yuri Nesterov: https://link.springer.com/book/10.100...
Convex Optimization: Algorithms and Complexity by Sébastien Bubeck: https://arxiv.org/pdf/1405.4980.pdf
MIT Lecture by Gilbert Strang:    • 23. Accelerating Gradient Descent (Us...  



Timestamps:
0:00 Intro
1:00 Momentum Gradient Descent
1:44 Nesterov's Accelerated Gradient Descent
2:23 First Interpretation
2:35 Second Interpretation



Credit:
Manim and Python : https://github.com/3b1b/manim
Blender3D: https://www.blender.org/
Emacs: https://www.gnu.org/software/emacs/
Music: www.bensound.com

This video would not have been possible without the help of Gökçe Dayanıklı.