TLDR
This is a follow-up to my previous post on optimization algorithms. Learn how tensorflow or pytorch implement optimization algorithms by using numpy and create beautiful animations using matplotlib. Learn how to implement different variants of gradient descent optimization technique and also visualize the working of the update rule for these variants using Matplotlib. This is one of the most commonly used optimization techniques to optimize neural networks. The algorithm updates the parameters by moving in the direction opposite to the gradient of the objective function with respect to network parameters.via the TL;DR App
no story
Written by NKumar | DeepLearning Enthusiast. Data Science Writer @marktechpost.com
