Variance-Invariance-Covariance Regularization (VICReg)

1 Post

Information about a new unsupervised pretraining method called VICReg
Variance-Invariance-Covariance Regularization (VICReg)

More Reliable Pretraining: Pretraining Method Helps AI Learn Useful Representations

Pretraining methods generate basic representations for later fine-tuning, but they’re prone to certain issues that can throw them off-kilter. New work proposes a solution.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox