Lecture 8: Gradient Descent (and Beyond)

4. Beyond Gradient Descent - Fundamentals of Deep Learning [Book]

Lecture Notes in Pattern Recognition: Episode 21 - Gradient Descent and Back-tracking Line Search - Pattern Recognition Lab

Gradient Descent Algorithm and Its Variants, by Imad Dabbura

An overview of gradient descent optimization algorithms

Gradient descent with linear regression from scratch in Python - Dmitrijs Kass' blog

Gradient Descent Algorithm and Its Variants, by Imad Dabbura

3Blue1Brown - Gradient descent, how neural networks learn

Descent carefully on a gradient!. In machine learning, gradient descent…, by Snehal Nair

Gradient descent (article)

Lecture 8: Progress Towards Understanding Generalization in Deep Learning (English)