Bert (muppet) and information related to BERT (transformer-based machine learning technique)
Language

Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.

Two years after it pointed a new direction for language models, Bert still hovers near the top of several natural language processing leaderboards. A new study considers whether Bert simply excels at tracking word order or or learns something closer to common sense.
Series of pictures of people smiling
Language

Deepfakes for Good: Tencent on the commercial value of deepfakes

A strategy manifesto from one of China’s biggest tech companies declares, amid familiar visions of ubiquitous AI, that deepfakes are more boon than bane.
Graphs and data related to language models and image processing
Language

Transforming Pixels: An image generation model using the GPT architecture

Language models like Bert, Ernie, and Elmo have achieved spectacular results based on clever pre-training approaches. New research applies some of those Sesame Street lessons into image processing.
Information related to OpenAI's model GPT-3
Language

Generation Text: How beta testers reacted to GPT-3

People granted early access to OpenAI’s latest language model are raving about its way with words — and more. Beta testers of GPT-3 are showing off the model’s ability to write business memos, craft blogs, pen tweets, and even generate computer code.
Map of China pointing specific places in red
Language

AI Against Covid Progress Report: How Chinese authorities used AI to fight Covid

A new report details the role of AI in China’s effort to fight the coronavirus. Researchers at Synced, a China-based AI publication, describe how nearly 90 machine learning products have contributed to the country’s pandemic response.
Photorealistic talking head generated by Synthesia
Language

Deepfakes Go Corporate: Syntheisa offers AI generated videos in 34 languages.

The same technology that has bedeviled Hollywood stars and roiled politics is easing corporate communications. Synthesia generates training and sales videos featuring photorealistic, synthetic talking heads that read personalized scripts in any of 34 languages.
Examples of clothes image-text combo search
Language

That Online Boutique, But Smarter: A summary of Amazon's Visiolinguistic Attention Learning

Why search for “a cotton dress shirt with button-down collar, breast pockets, barrel cuffs, scooped hem, and tortoise shell buttons in grey” when a photo and the words “that shirt, but grey” will do the trick? A new network understands the image-text combo.
Examples and explanation of an automatic headline generation
Language

AI Makes Headlines: Primer introduces an automated headline generator.

Which headline was written by a computer? A: FIFA to Decide on 2022 World Cup in March B: Decision in March on 48-team 2022 World Cup, Says Infantino
Virtual bot speaking
Language

Bots Don’t Need Social Distancing: Covid-19 drove demand for Replika, an AI chatbot.

A chatbot is providing companionship for the locked-down and lonely. Downloads of Replika, a chatbot designed to be a virtual friend, have spiked during the coronavirus pandemic, reports the New York Times.
Apple watch with countdown
Language

The AI of Small Things: Apple aims to simplify minor tasks with machine learning.

Some tech companies boast that their AI will change the world. Apple’s latest just aims to make your life a little easier. Apple unveiled a flock of modest conveniences powered by machine learning at its annual developer conference.
Illustration of a broken heart with a smirk in the middle
Language

Outing Hidden Hatred: How Facebook built a hate speech detector

Facebook uses automated systems to block hate speech, but hateful posts can slip through when seemingly benign words and pictures combine to create a nasty message. The social network is tackling this problem by enhancing AI’s ability to recognize context.
Illustration of two translators on a scale
Language

Choosing Words Carefully: BLUERT trains language models to be better translators.

The words “big” and “large” have similar meanings, but they aren’t always interchangeable: You wouldn’t refer to an older, male sibling as your “large brother” (unless you meant to be cheeky). Choosing among words with similar meanings is critical in language tasks like translation.
Illustration of a doctor and a nurse
Language

Gender Bender: Double-Hard Debias helps lessen gender bias in NLP models.

AI learns human biases: In word vector space, “man is to computer programmer as woman is to homemaker,” as one paper put it. New research helps language models unlearn such prejudices.
Talking bubbles inside talking bubbles
Language

Bigger is Better: A research summary of Microsoft's Turing-NLG language model.

Natural language processing lately has come to resemble an arms race, as the big AI companies build models that encompass ever larger numbers of parameters. Microsoft recently held the record — but not for long.
Illustration of two people talking with a typo
Language

Found in Translation: Apple's method to identify a language from a few words

Language models can’t correct your misspellings or suggest the next word in a text without knowing what language you’re using. For instance, if you type “tac-,” are you aiming for “taco,” a hand-held meal in Spanish, or “taca,” a crown in Turkish?

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox