Dec 22, 2021

8 Posts

A living room made out of cups of coffee: the people, the seats, the chimney, the lamp, all gather around a cozy fire.
Dec 22, 2021

One Architecture to Do Them All: Transformer: The AI architecture that can do it all.

The transformer architecture extended its reach to a variety of new domains.What happened: Originally developed for natural language processing, transformers are becoming the Swiss Army Knife of deep learning.
A chorus of reindeers singing carols from a Reindeer Holiday Songbook on a snowy night
Dec 22, 2021

Voices for the Voiceless: Generative AI models are creating voices for Hollywood and video games.

Musicians and filmmakers adopted AI as a standard part of the audio-production toolbox. What happened: Professional media makers embraced neural networks that generate new sounds and modify old ones. Voice actors bristled.
Sleigh made of gift boxes
Dec 22, 2021

The Batch: Top AI Stories of 2021: Transformers Take Over, Models Balloon, Multimodal AI Takes Off, Governments Crack Down

As we approach the end of 2021, you may be winding down work and gearing up for the winter holiday. I’m looking forward to taking a break from work and hope you are too.
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
Dec 22, 2021

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Illustration of a woman riding a sled
Dec 22, 2021

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL-E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive
Sleigh made of gift boxes
Dec 22, 2021

The Spirit of Giving in AI and Beyond

As we approach the end of 2021, you may be winding down work and gearing up for the winter holiday. I’m looking forward to taking a break from work and hope you are too.
Giant snowman taking over the city while helicopters try to take it down
Dec 22, 2021

Governments Lay Down the Law: Governments around the world increasingly regulate AI.

Legislators worldwide wrote new laws — some proposed, some enacted — to rein in societal impacts of automation.What happened: Authorities at all levels ratcheted up regulatory pressure as
Illustration of giant Christmas tree in a town plaza
Dec 22, 2021

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox