Jun 17, 2020

8 Posts

NLP Special Issue! Powerful techniques from Amazon, Apple, Facebook, Google, Microsoft, Salesforce
Jun 17, 2020

NLP Special Issue! Powerful techniques from Amazon, Apple, Facebook, Google, Microsoft, Salesforce

I’m thrilled to announce our new Natural Language Processing Specialization! Courses 1 and 2 are available on Coursera. We expect to release Courses 3 and 4 soon.
16 min read
Illustration of Noam Shazeer
Jun 17, 2020

AI Transformed

Noam Shazeer helped spark the latest NLP revolution. He developed the multi-headed self-attention mechanism described in “Attention Is All You Need,” the 2017 paper that introduced the transformer network.
3 min read
Illustration of a broken heart with a smirk in the middle
Jun 17, 2020

Outing Hidden Hatred

Facebook uses automated systems to block hate speech, but hateful posts can slip through when seemingly benign words and pictures combine to create a nasty message. The social network is tackling this problem by enhancing AI’s ability to recognize context.
2 min read
Illustration of Amazon Alexa with a question mark inside of a thought bubble
Jun 17, 2020

What Were We Talking About?

Conversational agents have a tough job following the zigs and zags of human conversation. They’re getting better at it — thanks to yesterday’s technology. Amazon recently improved the Alexa chatbot’s ability to identify the current topic of conversation.
1 min read
Illustration of two translators on a scale
Jun 17, 2020

Choosing Words Carefully

The words “big” and “large” have similar meanings, but they aren’t always interchangeable: You wouldn’t refer to an older, male sibling as your “large brother” (unless you meant to be cheeky). Choosing among words with similar meanings is critical in language tasks like translation.
2 min read
Illustration of a doctor and a nurse
Jun 17, 2020

Gender Bender

AI learns human biases: In word vector space, “man is to computer programmer as woman is to homemaker,” as one paper put it. New research helps language models unlearn such prejudices.
2 min read
Talking bubbles inside talking bubbles
Jun 17, 2020

Bigger is Better

Natural language processing lately has come to resemble an arms race, as the big AI companies build models that encompass ever larger numbers of parameters. Microsoft recently held the record — but not for long.
2 min read
Illustration of two people talking with a typo
Jun 17, 2020

Found in Translation

Language models can’t correct your misspellings or suggest the next word in a text without knowing what language you’re using. For instance, if you type “tac-,” are you aiming for “taco,” a hand-held meal in Spanish, or “taca,” a crown in Turkish?
1 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox