Technion-Israeli Institute of Technology
When Optimization is Suboptimal
Bias arises in machine learning when we fit an overly simple function to a more complex problem. A theoretical study shows that gradient descent itself may introduce such bias and render algorithms unable to fit data properly.