False information about Covid-19 on Facebook posts
Facebook

Information Warfare: Covid Edition

Facebook’s AI can’t spot Covid-19 disinformation on its own. But with human help, it can slow the spread. Facebook uses a combination of humans and neural nets to crack down on messages that make false claims about Covid-19, which may have deadly consequences.
1 min read
Data and graphs related to batch normalization
Facebook

Outside the Norm

Batch normalization is a technique that normalizes layer outputs to accelerate neural network training. But new research shows that it has other effects that may be more important.
2 min read
Info about radioactive data
Facebook

X Marks the Dataset

Which dataset was used to train a given model? A new method makes it possible to see traces of the training corpus in a model’s output.
2 min read
Association for the Advancement of Artificial Intelligence conference in New York
Facebook

Meeting of the Minds

Geoffrey Hinton, Yoshua Bengio, and Yann LeCun presented their latest thinking about deep learning’s limitations and how to overcome them.
2 min read
Information related to the kNN-LM algorithm
Facebook

Helpful Neighbors

School teachers may not like to hear this, but sometimes you get the best answer by peeking at your neighbor’s paper. A new language model framework peeks at the training data for context when making a prediction.
2 min read
Math equations represented as trees
Facebook

Neural Networks Study Math

In tasks that involve generating natural language, neural networks often map an input sequence of words to an output sequence of words. Facebook researchers used a similar technique on sequences of mathematical symbols, training a model to map math problems to math solutions.
2 min read
AI-generated face
Facebook

Facebook vs Deepfakes

Facebook announced a ban on deepfake videos, on the heels of a crackdown on counterfeit profiles that used AI-generated faces. Facebook declared this week that it will remove deepfake videos it deems deliberately misleading.
1 min read
Yann LeCun
Facebook

Yann LeCun: Learning From Observation

How is it that many people learn to drive a car fairly safely in 20 hours of practice, while current imitation learning algorithms take hundreds of thousands of hours, and reinforcement learning algorithms take millions of hours? Clearly we’re missing something big.
2 min read
Illustration of a fireplace with "Happy holidays" cards in English, Spanish and French
Facebook

Language Models Get Literate

Earlier language models powered by Word2Vec and GloVe embeddings yielded confused chatbots, grammar tools with middle-school reading comprehension, and not-half-bad translations. The latest generation is so good, some people consider it dangerous.
2 min read
Illustration of three identical reindeers
Facebook

Deepfakes Go Mainstream

Society awakened to the delight, threat, and sheer weirdness of realistic images and other media dreamed up by computers.
2 min read
Sesame Street characters together
Facebook

Inside AI’s Muppet Empire

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.
1 min read
Information about a model for multi-document summarization and question answering
Facebook

Bigger Corpora, Better Answers

Models that summarize documents and answer questions work pretty well with limited source material, but they can slip into incoherence when they draw from a sizeable corpus. Recent work addresses this problem.
2 min read
Word vectors
Facebook

Finer Tuning

A word-embedding model typically learns vector representations from a large, general-purpose corpus like Google News. But to make the resulting vectors useful in a specialized domain, they must be fine-tuned on a smaller, domain-specific dataset. Researchers offer a more accurate method.
2 min read
OctConv example
Facebook

Convolution Revolution

Looking at images, people see outlines before the details within them. A replacement for the traditional convolutional layer decomposes images based on this distinction between coarse and fine features.
2 min read
Chart with number of AI startup acquisitions from 2010 to 2019
Facebook

AI Startups in Demand

AI startups are being scooped up at an accelerating pace, many by companies outside the tech sphere. A report by CB Insights shows that, as of August, 2019 was on track to surpass last year’s record number of AI startup acquisitions.
1 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox