Gradient Descent Algorithm Table Of Contents: What Is Gradient Descent? Algorithm Requirements. What Is Gradient? How Gradient Descent Algorithm Works? (1) What Is Gradient Descent? Gradient descent (GD) is an iterative first-order optimisation algorithm, used to find a local minimum/maximum of a given function. This method is commonly used in machine learning (ML) and deep learning (DL) to minimise a cost/loss function (e.g. in a linear regression). Gradient Descent algorithm is the backbone of Machine Learning because whatever the loss function you give, it will find out its local minimum value. (2) Algorithm Requirements. The Gradient Descent algorithm does not work for all functions. There

Read More