AI generated images with different descriptions
Generative Modeling

More Realistic Pictures From Text: How the Glide Diffusion Model Generates Images from Text

OpenAI’s DALL·E got an upgrade that takes in text descriptions and produces images in styles from hand-drawn to photorealistic. The new version is a rewrite from the ground up. It uses the earlier CLIP zero-shot image classifier to represent text descriptions.
Jurassic-X's software infrastructure
Generative Modeling

Neural Nets + Rules = Truer Text: Jurassic-X NLP Can Solve Math, Check Facts, and More

A new approach aims to cure text generators of their tendency to produce nonsense. AI21 Labs launched Jurassic-X, a natural language processing system that combines neural networks and rule-based programs.
Deep Symbolic Regression
Generative Modeling

From Sequences to Symbols: Transformers Extend AI's Mathematical Capabilities

Given a sequence of numbers, neural networks have proven adept at discovering a mathematical expression that generates it. New work uses transformers to extend that success to a further class of expressions.
Skeletal formula of the (S) enantiomer of VX
Generative Modeling

AI Designs Chemical Weapons: Drug Design AI Creates Poisons

It’s surprisingly easy to turn a well-intended machine learning model to the dark side. In an experiment, Fabio Urbina and colleagues at Collaborations Pharmaceuticals, who had built a drug-discovery model to design useful compounds and avoid toxic ones, retrained it to generate poisons.
No-code AI platform
Generative Modeling

Who Needs Programming? Behind the rise of no-code AI.

The next killer AI application may be developed by someone who has never heard of gradient descent. A rising generation of software development platforms serves users who aren’t familiar with AI — and even programming.
AI-generated video of Yoon Suk-yeol
Generative Modeling

AI for President: How South Korean president's campaign used deepfakes

A deepfake of South Korea’s new president helped propel him into office. Yoon Suk-yeol, who won the country’s March 9 election, campaigned using videos that featured an AI-generated likeness of himself answering voters’ questions.
Fake face diagram - FaceSynthetics
Generative Modeling

Fake Faces Are Good Training Data: Synthetic data improves face recognition performance.

Collecting and annotating a dataset of facial portraits is a big job. New research shows that synthetic data can work just as well.
Photograph of Yale Song
Generative Modeling

Yale Song: Foundation models for vision

Large models pretrained on immense quantities of text have been proven to provide strong foundations for solving specialized language tasks. My biggest hope for AI in 2022 is...
A living room made out of cups of coffee: the people, the seats, the chimney, the lamp, all gather around a cozy fire.
Generative Modeling

One Architecture to Do Them All: Transformer: The AI architecture that can do it all.

The transformer architecture extended its reach to a variety of new domains.What happened: Originally developed for natural language processing, transformers are becoming the Swiss Army Knife of deep learning.
A chorus of reindeers singing carols from a Reindeer Holiday Songbook on a snowy night
Generative Modeling

Voices for the Voiceless: Generative AI models are creating voices for Hollywood and video games.

Musicians and filmmakers adopted AI as a standard part of the audio-production toolbox. What happened: Professional media makers embraced neural networks that generate new sounds and modify old ones. Voice actors bristled.
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
Generative Modeling

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Illustration of a woman riding a sled
Generative Modeling

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive
Illustration showing a witch cooking a copy of the Mona Lisa wearing a witch hat)
Generative Modeling

Artistry Is Obsolete: Is AI Making Human Artists Obsolete?

Is human creativity being replaced by the synthetic equivalent? The fear: AI is cranking out increasingly sophisticated visual, musical, and literary works. AI-generated media will flood the market, squeezing out human artists and depriving the world of their creativity.
GIF showing an orchestra playing music
Generative Modeling

Roll Over, Beethoven: AI Completes Beethoven's 10th Symphony

Ludwig van Beethoven died before he completed what would have been his tenth and final symphony. A team of computer scientists and music scholars approximated the music that might have been.
Animation showing image-to-image style transfer — mapping process
Generative Modeling

AI With a Sense of Style: Style Transfer Method Produces Consistent Output in Successive Frames

The process known as image-to-image style transfer — mapping, say, the character of a painting’s brushstrokes onto a photo — can render inconsistent results. When they apply the styles of different artists to the same target

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox