What are optimization algorithms in Machine Learning?
<a href=" removed link " target="true">Machine Learning Algorithms
The most important optimization algorithm used in Machine Learning is of Stochastic Gradient Descent. This Stochastic Gradient Descent algorithm is used to find the parameters or weights that minimize the cost function. The cost function defines the goodness of the model in predicting the target variable for those particular parameters. In this optimization algorithm, we randomly initialize the values of parameters and slowly moves towards the steepest descent until the convergence point. We should initialize the hyperparameter learning rate to define the size of steps This hyperparameter should not be too large (can result in not meeting convergence point) or too small (takes a lot of time to meet convergence point).