Visual and intuitive overview of the Gradient Descent algorithm. This simple algorithm is the backbone of most machine learning applications.



References:
AI plays hide and seek: https://openai.com/blog/emergenttool...
AI plays Dota 2: https://openai.com/five/
InterFaceGAN:    • InterFaceGAN Demo (CVPR 2020)  
Boyd and Vandenberghe's book on Convex Optimization (Sections 9.2 and 9.3): https://web.stanford.edu/class/ee364a...

https://web.stanford.edu/~boyd/cvxboo...

Timestamps:
0:00 Intro
0:18 Problem Formulation
1:10 Gradient Descent
2:12 Flavors of Gradient Descent



Music: www.bensound.com

This video would not have been possible without the help of Gökçe Dayanıklı.