Dec 22, 2021

7 Posts

A living room made out of cups of coffee: the people, the seats, the chimney, the lamp, all gather around a cozy fire.
Dec 22, 2021

One Architecture to Do Them All: Transformer: The AI Architecture That Can Do It All

The transformer architecture extended its reach to a variety of new domains.What happened: Originally developed for natural language processing, transformers are becoming the Swiss Army Knife of deep learning.
2 min read
A chorus of reindeers singing carols from a Reindeer Holiday Songbook on a snowy night
Dec 22, 2021

Voices for the Voiceless: Generative AI Models Are Creating Voices for Hollywood and Video Games

Musicians and filmmakers adopted AI as a standard part of the audio-production toolbox. What happened: Professional media makers embraced neural networks that generate new sounds and modify old ones. Voice actors bristled.
2 min read
Top AI Stories of 2021: Transformers Take Over, Models Balloon, Multimodal AI Takes Off, Governments Crack Down
Dec 22, 2021

Top AI Stories of 2021: Transformers Take Over, Models Balloon, Multimodal AI Takes Off, Governments Crack Down

As we approach the end of 2021, you may be winding down work and gearing up for the winter holiday. I’m looking forward to taking a break from work and hope you are too.
11 min read
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
Dec 22, 2021

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
2 min read
Multimodal AI Takes Off: Multimodal Models, such as CLIP and Dall-E, Are Taking Over AI
Dec 22, 2021

Multimodal AI Takes Off: Multimodal Models, such as CLIP and Dall-E, Are Taking Over AI

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive
1 min read
Giant snowman taking over the city while helicopters try to take it down
Dec 22, 2021

Governments Lay Down the Law: Governments Around The World Increasingly Regulate AI

Legislators worldwide wrote new laws — some proposed, some enacted — to rein in societal impacts of automation.What happened: Authorities at all levels ratcheted up regulatory pressure as
2 min read
smaller town bigger tree
Dec 22, 2021

Trillions of Parameters: Are AI Models With Trillions of Parameters the New Normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox