Technion-Israeli Institute of Technology
When Optimization is Suboptimal: How gradient descent can sometimes lead to model bias
Bias arises in machine learning when we fit an overly simple function to a more complex problem. A theoretical study shows that gradient descent itself may introduce such bias and render algorithms unable to fit data properly.