Examples of Dall-E searches
Generative Modeling

DALL·E 2’s Emergent Vocabulary: DALL-E 2 Invents its Own Words and Concepts

OpenAI’s text-to-image generator DALL·E 2 produces pictures with uncanny creativity on demand. Has it invented its own language as well? Ask DALL·E 2 to generate an image that includes text, and often its output will include seemingly random characters.
Variational Neural Cellular Automata (VNCA) overview
Generative Modeling

Tech Imitates Life, Life Imitates Art: Image Generation Technique Works Pixel By Pixel

The computational systems known as cellular automata reproduce patterns of pixels by iteratively applying simple rules based loosely on the behavior of biological cells. New work extends their utility from reproducing images to generating new ones.
Didactic diagram of a hypothetical embedded-model architecture
Generative Modeling

Image Generation + Probabilities: New Method Boosts Performance for Normalizing Flow

If you want to both synthesize data and find the probability of any given example — say, generate images of manufacturing defects to train a defect detector and identify the highest-probability defects — you may use the architecture known as a normalizing flow.
AI generated images with different descriptions
Generative Modeling

More Realistic Pictures From Text: How the Glide Diffusion Model Generates Images from Text

OpenAI’s DALL·E got an upgrade that takes in text descriptions and produces images in styles from hand-drawn to photorealistic. The new version is a rewrite from the ground up. It uses the earlier CLIP zero-shot image classifier to represent text descriptions.
Jurassic-X's software infrastructure
Generative Modeling

Neural Nets + Rules = Truer Text: Jurassic-X NLP Can Solve Math, Check Facts, and More

A new approach aims to cure text generators of their tendency to produce nonsense. AI21 Labs launched Jurassic-X, a natural language processing system that combines neural networks and rule-based programs.
Deep Symbolic Regression
Generative Modeling

From Sequences to Symbols: Transformers Extend AI's Mathematical Capabilities

Given a sequence of numbers, neural networks have proven adept at discovering a mathematical expression that generates it. New work uses transformers to extend that success to a further class of expressions.
Skeletal formula of the (S) enantiomer of VX
Generative Modeling

AI Designs Chemical Weapons: Drug Design AI Creates Poisons

It’s surprisingly easy to turn a well-intended machine learning model to the dark side. In an experiment, Fabio Urbina and colleagues at Collaborations Pharmaceuticals, who had built a drug-discovery model to design useful compounds and avoid toxic ones, retrained it to generate poisons.
No-code AI platform
Generative Modeling

Who Needs Programming? Behind the rise of no-code AI.

The next killer AI application may be developed by someone who has never heard of gradient descent. A rising generation of software development platforms serves users who aren’t familiar with AI — and even programming.
AI-generated video of Yoon Suk-yeol
Generative Modeling

AI for President: How South Korean president's campaign used deepfakes.

A deepfake of South Korea’s new president helped propel him into office. Yoon Suk-yeol, who won the country’s March 9 election, campaigned using videos that featured an AI-generated likeness of himself answering voters’ questions.
Fake face diagram - FaceSynthetics
Generative Modeling

Fake Faces Are Good Training Data: Synthetic data improves face recognition performance.

Collecting and annotating a dataset of facial portraits is a big job. New research shows that synthetic data can work just as well.
Photograph of Yale Song
Generative Modeling

Yale Song: Foundation models for vision.

Large models pretrained on immense quantities of text have been proven to provide strong foundations for solving specialized language tasks. My biggest hope for AI in 2022 is...
A living room made out of cups of coffee: the people, the seats, the chimney, the lamp, all gather around a cozy fire.
Generative Modeling

One Architecture to Do Them All: Transformer: The AI architecture that can do it all.

The transformer architecture extended its reach to a variety of new domains.What happened: Originally developed for natural language processing, transformers are becoming the Swiss Army Knife of deep learning.
A chorus of reindeers singing carols from a Reindeer Holiday Songbook on a snowy night
Generative Modeling

Voices for the Voiceless: Generative AI models are creating voices for Hollywood and video games.

Musicians and filmmakers adopted AI as a standard part of the audio-production toolbox. What happened: Professional media makers embraced neural networks that generate new sounds and modify old ones. Voice actors bristled.
Illustration of a woman riding a sled
Generative Modeling

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL-E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
Generative Modeling

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox