Contrastive Learning

7 Posts

Animated chart shows how AI can avoid mistaking an image's subject for its context.
Contrastive Learning

Taming Spurious Correlations: New Technique Helps AI Avoid Classification Mistakes

When a neural network learns image labels, it may confuse a background item for the labeled object. New research avoids such mistakes.
2 min read
Flowcharts show how a new contrastive learning approach uses metadata to improve AI image classifiers.
Contrastive Learning

Learning From Metadata: Descriptive Text Improves Performance for AI Image Classification Systems

Images in the wild may not come with labels, but they often include metadata. A new training method takes advantage of this information to improve contrastive learning.
2 min read
Information about a new unsupervised pretraining method called VICReg
Contrastive Learning

More Reliable Pretraining: Pretraining Method Helps AI Learn Useful Representations

Pretraining methods generate basic representations for later fine-tuning, but they’re prone to certain issues that can throw them off-kilter. New work proposes a solution.
2 min read
Examples of contrastive learning
Contrastive Learning

Learning From Words and Pictures

It’s expensive to pay doctors to label medical images, and the relative scarcity of high-quality training examples can make it hard for neural networks to learn features that make for accurate diagnoses.
2 min read
Electroencephalogram (EEG) and data related to contrastive predictive coding (CPC)
Contrastive Learning

Unlabeled Brainwaves Spill Secrets

For people with neurological disorders like epilepsy, attaching sensors to the scalp to measure electrical currents within the brain is benign. But interpreting the resulting electroencephalogram (EEG) graphs can give doctors a headache.
2 min read
Data and information related to Contrastive Unsupervised Representations for Reinforcement Learning (CURL)
Contrastive Learning

RL and Feature Extraction Combined

Which comes first, training a reinforcement learning model or extracting high-quality features? New work avoids this chicken-or-egg dilemma by doing both simultaneously.
1 min read
Graph related to imple Contrastive Learning (SimCLR)
Contrastive Learning

Self-Supervised Simplicity

A simple linear classifier paired with a self-supervised feature extractor outperformed a supervised deep learning model on ImageNet, according to new research.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox