Machine Learning Research

Why Active Learning Fails: Pairing active learning with visual question answering.

Where labeled training data is scarce, an algorithm can learn to request labels for key examples. While this practice, known as active learning, can supply labeled examples that improve performance in some tasks, it fails in others.
Tax planning model AI Economist
Machine Learning Research

Tax Relief the AI Way: AI Economist creates optimal tax rate.

Nothing is certain except death and taxes, the saying goes — but how to make taxes fair and beneficial remains an open question. New research aims to answer it.
Equivariant subsampling on 1D feature maps with a scale factor c = 2.
Machine Learning Research

Image Transformations Unmasked: CNNs for vision that aren't fooled by changing backgrounds.

If you change an image by moving its subject within the frame, a well trained convolutional neural network may not recognize the fundamental similarity between the two versions. New research aims to make CNN wise to such alterations.
Two images showing RETRO Architecture and Gopher (280B) vs State of the Art
Machine Learning Research

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.
Google's Decision Transformer
Machine Learning Research

Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.

Transformers have matched or exceeded earlier architectures in language modeling and image classification. New work shows they can achieve state-of-the-art results in some reinforcement learning tasks as well.
Standalone predictive performance of ACoR
Machine Learning Research

Recognizing Autism: AI research can help identify autism early in children.

Classical machine learning techniques could help children with autism receive treatment earlier in life. Researchers led by Ishanu Chattopadhyay at University of Chicago developed a system that classified autism in young children based on data collected during routine checkups.
Animated illustration shows the model architecture of a graph neural network.
Machine Learning Research

A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers

New research shows that drastically increasing the number of layers in a graph neural networks improves its performance on large datasets.
A conversation between a human and an open-domain chatbot.
Machine Learning Research

Long-Haul Chatbot: Facebook Chatbot is Able to Carry on Long Conversations

Facebook released a chatbot that summarizes dialog on the fly and uses the summary to generate further repartee.
Example comparing a nonaugmented model (left) to a model with internet-augmentation (right)
Machine Learning Research

This Chatbot Does Its Research: Facebook Chatbot Uses the Internet to Inform its Answers

Chatbots often respond to human input with incorrect or nonsensical answers. Why not enable them to search for helpful information?
Animated chart shows how AI can help robots locate key spatial coordinates.
Machine Learning Research

Finding Useful Points in Space: Keypoint3D Helps Robots Locate Spatial Coordinates

A new machine learning method aims to improve a machine’s ability to determine and locate points of interest.
Animation showing how MERLOT is able to match contextualized captions with their corresponding video frames
Machine Learning Research

Richer Video Representations: Pretraining Method Improves AI's Ability to Understand Video

To understand a movie scene, viewers often must remember or infer previous events and extrapolate potential consequences. New work improved a model’s ability to do the same.
Animated video showing an image generator imitating brush strokes
Machine Learning Research

Different Strokes for Robot Folks: Transformer-Based Image Generator Imitates Painters

A neural network can make a photo resemble a painting via neural style transfer, but it can also learn to reproduce an image by applying brush strokes. A new method taught a system this painterly skill without any training data.
Series of example of accurate and inaccurate matching images to text
Machine Learning Research

Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data

The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.
Animated image showing the transformer architecture of processing an image
Machine Learning Research

Transformer Speed-Up Sped Up: How to Speed Up Image Transformers

The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces
Animation showing Hierarchical Outlier Detection (HOD)
Machine Learning Research

Oddball Recognition: New Method Identifies Outliers in AI Training Data

Models trained using supervised learning struggle to classify inputs that differ substantially from most of their training data. A new method helps them recognize such outliers.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox