Proof Search Tree

The Proof Is in the Network: A transformer model that generates mathematical proofs

OpenAI’s Generative Pre-Trained Transformer (GPT) architecture has created coherent essays, images, and code. Now it generates mathematical proofs as well.
Information related to OpenAI's model GPT-3

Generation Text: How beta testers reacted to GPT-3

People granted early access to OpenAI’s latest language model are raving about its way with words — and more. Beta testers of GPT-3 are showing off the model’s ability to write business memos, craft blogs, pen tweets, and even generate computer code.
Virtual bot speaking

Bots Don’t Need Social Distancing: Covid-19 drove demand for Replika, an AI chatbot.

A chatbot is providing companionship for the locked-down and lonely. Downloads of Replika, a chatbot designed to be a virtual friend, have spiked during the coronavirus pandemic, reports the New York Times.
Animated drawing of hardware related to AI

Horsepower for Next-Gen Networks: Microsoft built OpenAI a custom AI supercomputer.

The for-profit research organization OpenAI has a new supercomputer to help achieve its dream of building the world’s most sophisticated AI. Microsoft engineered the new hardware network to train immense models on thousands of images, texts, and videos simultaneously.
Series of images related to Jukebox, a deep learning system by OpenAI

Roll Over, Beyoncé: How OpenAI's Jukebox generates synthetic music

A new generative model croons like Elvis and raps like Eminem. It might even make you think you’re listening to a lost demo by the Beatles. OpenAI released Jukebox, a deep learning system that has generated thousands of songs in styles from country to metal and soul.
Road sign with the word "trust"

Toward AI We Can Count On: Public trust recommendations from AI researchers

A consortium of top AI experts proposed concrete steps to help machine learning engineers secure the public’s trust. Dozens of researchers and technologists recommended actions to counter public skepticism toward artificial intelligence, fueled by issues like data privacy.
Data and graphs related to equations that optimize some training parameters.

Optimize Your Training Parameters: Research on finding a neural net's optimal batch size

Last week we reported on a formula to determine model width and dataset size for optimal performance. A new paper contributes equations that optimize some training parameters.
Rendering of simulated environment

OpenAI Under Fire: Critics claim OpenAI lost its founding ideals.

An icon of idealism in AI stands accused of letting its ambition eclipse its principles. Founded in 2015 to develop artificial general intelligence for the good of humankind, OpenAI swapped its ideals for cash.
Illustration of a crystal snowball

Simulation Substitutes for Data: When simulation works wonders with deep learning

The future of machine learning may depend less on amassing ground-truth data than simulating the environment in which a model will operate. Deep learning works like magic with enough high-quality data. When examples are scarce, though, researchers are using simulation to fill the gap.
Illustration of a fireplace with "Happy holidays" cards in English, Spanish and French

Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP

Earlier language models powered by Word2Vec and GloVe embeddings yielded confused chatbots, grammar tools with middle-school reading comprehension, and not-half-bad translations. The latest generation is so good, some people consider it dangerous.
Mechanical hand unscrambling a Rubik's Cube

Cube Controversy

OpenAI trained a five-fingered robotic hand to unscramble the Rubik’s Cube puzzle, bringing both acclaim and criticism. The AI research lab OpenAI trained a mechanical hand to balance, twist, and turn the cube.
Simulated hide-and-seek environment

Ready or Not

Independent research lab OpenAI designed virtual agents to play hide-and-seek. They evolved increasingly clever strategies, eventually hacking the game world’s physics to gain advantage.
OpenAI's GPT-2 results

How to Share Dangerous AI

OpenAI raised eyebrows in February when it announced — and withheld — the full version of its groundbreaking language model, GPT-2. Six months later, the company has re-examined the decision.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox