OpenAI

21 Posts

Large Language Models Unbound.
OpenAI

Large Language Models Unbound.

A worldwide collaboration produced the biggest open source language model to date.What’s new: BLOOM is a family of language models built by the BigScience Research Workshop, a collective of over 1,000 researchers from 250 institutions
2 min read
More Realistic Pictures From Text
OpenAI

More Realistic Pictures From Text

OpenAI’s DALL·E got an upgrade that takes in text descriptions and produces images in styles from hand-drawn to photorealistic. The new version is a rewrite from the ground up. It uses the earlier CLIP zero-shot image classifier to represent
2 min read
Learning After Overfitting
OpenAI

Learning After Overfitting

When a model trains too much, it can overfit, or memorize, the training data, which reduces its ability to analyze similar-but-different inputs. But what if training continues? New work found that overfitting isn’t the end of the line.
2 min read
A Kinder, Gentler Language Model
OpenAI

A Kinder, Gentler Language Model

OpenAI unveiled a more reliable successor to its GPT-3 natural language model.What’s new: InstructGPT is a version of GPT-3 fine-tuned to minimize harmful, untruthful, and biased output. It's available via an application programming
2 min read
Animation showing GPT-3 in full action
OpenAI

GPT-3 for All: GPT-3 is Available for Select Azure Users

Microsoft is making GPT-3 available to selected customers through its Azure cloud service.
2 min read
Results of survey about how AI Engineers vs US public feel about ethical issues
OpenAI

AI Engineers Weigh In on AI Ethics: Survey Shows How AI Engineers Feel About Ethical Issues

Machine learning researchers tend to trust international organizations, distrust military forces, and disagree on how much disclosure is necessary when describing new models, a new study found.
2 min read
AI-generated images with the model DALL-E
OpenAI

Tell Me a Picture

Two new models show a surprisingly sharp sense of the relationship between words and images. OpenAI, the for-profit research lab, announced a pair of models that have produced impressive results in multimodal learning: DALL·E.
2 min read
Ilya Sutskever
OpenAI

Ilya Sutskever: Fusion of Language and Vision

The past year was the first in which general-purpose models became economically useful. GPT-3, in particular, demonstrated that large language models have surprising linguistic competence and the ability to perform a wide variety of useful tasks.
2 min read
Bookstack and wrapping paper
OpenAI

Writer’s Unblock

Neural networks for natural language processing got bigger, more prolific, and more fun to play with. Language models, which already had grown to gargantuan size, continued to swell, yielding chatbots that mimic AI luminaries and have very strange ideas about horses.
1 min read
Information related to OpenAI's model GPT-3
OpenAI

Generation Text

People granted early access to OpenAI’s latest language model are raving about its way with words — and more. Beta testers of GPT-3 are showing off the model’s ability to write business memos, craft blogs, pen tweets, and even generate computer code.
2 min read
Virtual bot speaking
OpenAI

Bots Don’t Need Social Distancing

A chatbot is providing companionship for the locked-down and lonely. Downloads of Replika, a chatbot designed to be a virtual friend, have spiked during the coronavirus pandemic, reports the New York Times.
1 min read
Animated drawing of hardware related to AI
OpenAI

Horsepower for Next-Gen Networks

The for-profit research organization OpenAI has a new supercomputer to help achieve its dream of building the world’s most sophisticated AI. Microsoft engineered the new hardware network to train immense models on thousands of images, texts, and videos simultaneously.
1 min read
Series of images related to Jukebox, a deep learning system by OpenAI
OpenAI

Roll Over, Beyoncé

A new generative model croons like Elvis and raps like Eminem. It might even make you think you’re listening to a lost demo by the Beatles. OpenAI released Jukebox, a deep learning system that has generated thousands of songs in styles from country to metal and soul.
2 min read
Road sign with the word "trust"
OpenAI

Toward AI We Can Count On

A consortium of top AI experts proposed concrete steps to help machine learning engineers secure the public’s trust. Dozens of researchers and technologists recommended actions to counter public skepticism toward artificial intelligence, fueled by issues like data privacy.
1 min read
Data and graphs related to equations that optimize some training parameters.
OpenAI

Optimize Your Training Parameters

Last week we reported on a formula to determine model width and dataset size for optimal performance. A new paper contributes equations that optimize some training parameters.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox