Graph related to imple Contrastive Learning (SimCLR)
ResNet

Self-Supervised Simplicity

A simple linear classifier paired with a self-supervised feature extractor outperformed a supervised deep learning model on ImageNet, according to new research.
Information related to a test powered by deep learning that diagnoses tumor samples in only a few minutes
ResNet

Surgical Speed-Up

Every second counts when a patient’s skull is open in the operating room. A new technique based on deep learning can shorten some brain surgeries. During brain cancer operations, surgeons must stop in mid-operation for up to a half hour while a pathologist analyzes the tumor tissue.
OctConv example
ResNet

Convolution Revolution

Looking at images, people see outlines before the details within them. A replacement for the traditional convolutional layer decomposes images based on this distinction between coarse and fine features.
An illustration of filter pruning
ResNet

High Accuracy, Low Compute

As neural networks have become more accurate, they’ve also ballooned in size and computational cost. That makes many state-of-the-art models impractical to run on phones and potentially smaller, less powerful devices.
Illustration of Facebook AI Research method to compress neural networks
ResNet

Honey, I Shrunk the Network!

Deep learning models can be unwieldy and often impractical to run on smaller devices without major modification. Researchers at Facebook AI Research found a way to compress neural networks with minimal sacrifice in accuracy.
Calibration plot for ImageNet
ResNet

Scaling Bayes

Neural networks are good at making predictions, but they’re not so good at estimating how certain they are. If the training data set is small and many sets of model parameters fit the data well, for instance, the network may not realize this explicitly, leading to overly confident predictions.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox