Graphs with data related to Microsoft's library DeepSpeed
Language

Toward 1 Trillion Parameters

An open source library could spawn trillion-parameter neural networks and help small-time developers build big-league models. Microsoft upgraded DeepSpeed, a library that accelerates the PyTorch deep learning framework.
2 min read
Bert (muppet) and information related to BERT (transformer-based machine learning technique)
Language

Do Muppets Have Common Sense?

Two years after it pointed a new direction for language models, Bert still hovers near the top of several natural language processing leaderboards. A new study considers whether Bert simply excels at tracking word order or or learns something closer to common sense.
2 min read
Series of pictures of people smiling
Language

Deepfakes for Good

A strategy manifesto from one of China’s biggest tech companies declares, amid familiar visions of ubiquitous AI, that deepfakes are more boon than bane.
2 min read
Graphs and data related to language models and image processing
Language

Transforming Pixels

Language models like Bert, Ernie, and Elmo have achieved spectacular results based on clever pre-training approaches. New research applies some of those Sesame Street lessons into image processing.
2 min read
Information related to OpenAI's model GPT-3
Language

Generation Text

People granted early access to OpenAI’s latest language model are raving about its way with words — and more. Beta testers of GPT-3 are showing off the model’s ability to write business memos, craft blogs, pen tweets, and even generate computer code.
2 min read
Map of China pointing specific places in red
Language

AI Against Covid: Progress Report

A new report details the role of AI in China’s effort to fight the coronavirus. Researchers at Synced, a China-based AI publication, describe how nearly 90 machine learning products have contributed to the country’s pandemic response.
1 min read
Photorealistic talking head generated by Synthesia
Language

Deepfakes Go Corporate

The same technology that has bedeviled Hollywood stars and roiled politics is easing corporate communications. Synthesia generates training and sales videos featuring photorealistic, synthetic talking heads that read personalized scripts in any of 34 languages.
2 min read
Examples of clothes image-text combo search
Language

That Online Boutique, But Smarter

Why search for “a cotton dress shirt with button-down collar, breast pockets, barrel cuffs, scooped hem, and tortoise shell buttons in grey” when a photo and the words “that shirt, but grey” will do the trick? A new network understands the image-text combo.
2 min read
Examples and explanation of an automatic headline generation
Language

AI Makes Headlines

Which headline was written by a computer? A: FIFA to Decide on 2022 World Cup in March B: Decision in March on 48-team 2022 World Cup, Says Infantino
2 min read
Virtual bot speaking
Language

Bots Don’t Need Social Distancing

A chatbot is providing companionship for the locked-down and lonely. Downloads of Replika, a chatbot designed to be a virtual friend, have spiked during the coronavirus pandemic, reports the New York Times.
1 min read
Apple watch with countdown
Language

The AI of Small Things

Some tech companies boast that their AI will change the world. Apple’s latest just aims to make your life a little easier. Apple unveiled a flock of modest conveniences powered by machine learning at its annual developer conference.
1 min read
Illustration of a broken heart with a smirk in the middle
Language

Outing Hidden Hatred

Facebook uses automated systems to block hate speech, but hateful posts can slip through when seemingly benign words and pictures combine to create a nasty message. The social network is tackling this problem by enhancing AI’s ability to recognize context.
2 min read
Illustration of two translators on a scale
Language

Choosing Words Carefully

The words “big” and “large” have similar meanings, but they aren’t always interchangeable: You wouldn’t refer to an older, male sibling as your “large brother” (unless you meant to be cheeky). Choosing among words with similar meanings is critical in language tasks like translation.
2 min read
Illustration of a doctor and a nurse
Language

Gender Bender

AI learns human biases: In word vector space, “man is to computer programmer as woman is to homemaker,” as one paper put it. New research helps language models unlearn such prejudices.
2 min read
Talking bubbles inside talking bubbles
Language

Bigger is Better

Natural language processing lately has come to resemble an arms race, as the big AI companies build models that encompass ever larger numbers of parameters. Microsoft recently held the record — but not for long.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox