Information related to a model that predicts a chemical's smell
Machine Learning Research

Nose Job

Predicting a molecule’s aroma is hard because slight changes in structure lead to huge shifts in perception. Good thing deep learning is developing a sense of smell.
Word vectors
Machine Learning Research

Finer Tuning

A word-embedding model typically learns vector representations from a large, general-purpose corpus like Google News. But to make the resulting vectors useful in a specialized domain, they must be fine-tuned on a smaller, domain-specific dataset. Researchers offer a more accurate method.
OctConv example
Machine Learning Research

Convolution Revolution

Looking at images, people see outlines before the details within them. A replacement for the traditional convolutional layer decomposes images based on this distinction between coarse and fine features.
Examples of finished virtual pencil sketches (shoe and headshot)
Machine Learning Research

Unfinished Artwork? No More

Generative networks can embroider sentences into stories and melodies into full-fledged arrangements. A new model does something similar with drawings.
Robot cooking, controlled by a person
Machine Learning Research

Robotic Control, Easy as Apple Pie

Robots designed to assist people with disabilities have become more capable, but they’ve also become harder to control. New research offers a way to operate such complex mechanical systems more intuitively.
Schematic of the architecture used in experiments related to systematic reasoning in deep reinforcement learning
Machine Learning Research

How Neural Networks Generalize

Humans understand the world by abstraction: If you grasp the concept of grabbing a stick, then you’ll also comprehend grabbing a ball. New work explores deep learning agents’ ability to do the same thing — an important aspect of their ability to generalize.
Process of labeling doctors' notes
Machine Learning Research

Cracking Open Doctors’ Notes

Weak supervision is the practice of assigning likely labels to unlabeled data using a variety of simple labeling functions. Then supervised methods can be used on top of the now-labeled data.
An illustration of filter pruning
Machine Learning Research

High Accuracy, Low Compute

As neural networks have become more accurate, they’ve also ballooned in size and computational cost. That makes many state-of-the-art models impractical to run on phones and potentially smaller, less powerful devices.
Proposed model for abstractive summarization of a scientific article
Machine Learning Research

Two Steps to Better Summaries

Summarizing a document using original words is a longstanding problem for natural language processing. Researchers recently took a step toward human-level performance in this task, known as abstractive summarization, as opposed to extractive summarization.
Pipeline for identifying sentences containing evidence of SDIs and SSIs
Machine Learning Research

Hidden Findings Revealed

Drugs undergo rigorous experimentation and clinical trials to gain regulatory approval, while dietary supplements get less scrutiny. Even when a drug study reveals an interaction with supplements, the discovery tends to receive little attention.
DeepPrivacy results on a diverse set of images
Machine Learning Research

Anonymous Faces

A number of countries restrict commercial use of personal data without consent unless they’re fully anonymized. A new paper proposes a way to anonymize images of faces, purportedly without degrading their usefulness in applications that rely on face recognition.
GPT-2 text generator
Machine Learning Research

Putting Text Generators on a Leash

Despite dramatic recent progress, natural language generation remains an iffy proposition. Even users of the muscular GPT-2 text generator have to press the button a number of times to get sensible output. But researchers are figuring out how to exert greater control over generated text.
 Proportion of examples covered by number of annotators (sorted by number of annotations)
Machine Learning Research

AI Knows Who Labeled the Data

The latest language models are great at answering questions about a given text passage. However, these models are also powerful enough to recognize an individual writer’s style, which can clue them in to the right answers. New research measures such annotator bias in several data sets.
Google text-to-speech logo
Machine Learning Research

The Long and Short of It

Not long ago, text-to-speech systems could read only a sentence at a time, and they were ranked according to their ability to accomplish that limited task. Now that they can orate entire books, we need new benchmarks.
Average Relative WER improvement as a function of the amount of training data
Machine Learning Research

Speech Recognition With an Accent

Models that achieve state-of-the-art performance in automatic speech recognition (ASR) often perform poorly on nonstandard speech. New research offers methods to make ASR more useful to users with heavy accents or speech impairment.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox