ELMo

5 Posts

Data showing how new pretrained language models might learn facts like weight and cost
ELMo

The Measure of a Muppet

The latest pretrained language models have shown a remarkable ability to learn facts. A new study drills down on issues of scale, showing that such models might learn the approximate weight of a dog or cost of an apple, at least to the right order of magnitude.
2 min read
Graphs and data related to language models and image processing
ELMo

Transforming Pixels

Language models like Bert, Ernie, and Elmo have achieved spectacular results based on clever pre-training approaches. New research applies some of those Sesame Street lessons into image processing.
2 min read
Illustration of a fireplace with "Happy holidays" cards in English, Spanish and French
ELMo

Language Models Get Literate

Earlier language models powered by Word2Vec and GloVe embeddings yielded confused chatbots, grammar tools with middle-school reading comprehension, and not-half-bad translations. The latest generation is so good, some people consider it dangerous.
2 min read
Sesame Street characters together
ELMo

Inside AI’s Muppet Empire

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.
1 min read
Graph related to Language Model Analysis (LAMA)
ELMo

What Language Models Know

Watson set a high bar for language understanding in 2011, when it famously whipped human competitors in the televised trivia game show Jeopardy! IBM’s special-purpose AI required around $1 billion. Research suggests that today’s best language models can accomplish similar tasks right off the shelf.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox