A living room made out of cups of coffee: the people, the seats, the chimney, the lamp, all gather around a cozy fire.
Meta

One Architecture to Do Them All: Transformer: The AI architecture that can do it all.

The transformer architecture extended its reach to a variety of new domains.What happened: Originally developed for natural language processing, transformers are becoming the Swiss Army Knife of deep learning.
Illustration of a woman riding a sled
Meta

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL-E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
Meta

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
A conversation between a human and an open-domain chatbot.
Meta

Long-Haul Chatbot: Facebook Chatbot is Able to Carry on Long Conversations

Facebook released a chatbot that summarizes dialog on the fly and uses the summary to generate further repartee.
Example comparing a nonaugmented model (left) to a model with internet-augmentation (right)
Meta

This Chatbot Does Its Research: Facebook Chatbot Uses the Internet to Inform its Answers

Chatbots often respond to human input with incorrect or nonsensical answers. Why not enable them to search for helpful information?
Animation showing how the Facebook algorithm awards points to a post
Meta

How Facebook Fills the Feed: Leaked Documents Show How Facebook's Algorithm Works

Facebook’s recommendation algorithm is a closely guarded secret. Newly leaked documents shed light on the company’s formula for prioritizing posts in an individual user’s feed.
Illustration of Thumbzilla destroying a city and shooting lightning from its mouth (T-Rex with Facebook thumbs up)
Meta

Don’t Be Evil: What if AI Enables Corporations to Become Truly Evil?

Tech companies generally try to be (or to appear to be) socially responsible. Would some rather let AI’s negative impacts slide?
Charts showing the impact of Instagram in different topics
Meta

The Social Nightmare: Facebook Whistleblower Exposes How Company Harms Users

Scrutiny of Facebook intensified after a whistleblower leaked internal research showing the company has known that its ongoing drive to engage users has harmed individuals and society at large.
Information about a new unsupervised pretraining method called VICReg
Meta

More Reliable Pretraining: Pretraining Method Helps AI Learn Useful Representations

Pretraining methods generate basic representations for later fine-tuning, but they’re prone to certain issues that can throw them off-kilter. New work proposes a solution.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox