Technion-Israeli Institute of Technology

1 Post

Series of images with graphs and data related to optimization algorithms
Technion-Israeli Institute of Technology

When Optimization is Suboptimal: How gradient descent can sometimes lead to model bias

Bias arises in machine learning when we fit an overly simple function to a more complex problem. A theoretical study shows that gradient descent itself may introduce such bias and render algorithms unable to fit data properly.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox