Protein structures
Machine Learning Research

What AI Knows About Proteins

Transformer models trained on sequences of amino acids that form proteins have had success classifying and generating viable sequences. New research shows that they also capture information about protein structure.
2 min read
A new metod for compressing images and yielding better classification
Machine Learning Research

What Machines Want to See

Researchers typically downsize images for vision networks to accommodate limited memory and accelerate processing. A new method not only compresses images but yields better classification.
1 min read
FastNeRF accelerates the photorealistic 3D rendering method
Machine Learning Research

Virtual Reality in Real Time

Ideally, real-time 3D applications such as virtual and augmented reality transition smoothly between different viewpoints of a scene — but generating a fresh perspective can take time. New research speeds the process.
2 min read
Minecraft video capture
Machine Learning Research

3D Object Factory

In the open-ended video game Minecraft, players extract blocks of virtual materials from a 3D environment to assemble objects of their own design, from trees to cathedrals. Researchers trained neural networks to generate these structures.
2 min read
Up for Debate
Machine Learning Research

Up for Debate

IBM’s Watson question-answering system stunned the world in 2011 when it bested human champions of the TV trivia game show Jeopardy! Although the Watson brand has fallen on hard times, the company’s language-processing
2 min read
Diagram showing how Project Debater works
Machine Learning Research

Up for Debate

IBM’s Watson question-answering system stunned the world in 2011 when it bested human champions of the TV trivia game show Jeopardy! Although the Watson brand has fallen on hard times, the company’s language-processing prowess continues to develop.
2 min read
Semantic Similarity Video Retrieval (SVR) working
Machine Learning Research

Toward Better Video Search

Researchers at the University of Bristol led by Michael Wray propose a new benchmark, Semantic Similarity Video Retrieval (SVR), that evaluates video retrieval systems by their ability to rank many similar videos. They also built a system that performed well on it.
2 min read
System designed to isolate changes in the pose of a two-dimensional figure
Machine Learning Research

Motion Mapper

In some animated games, different characters can perform the same actions — say, walking, jumping, or casting spells. A new system learned from unlabeled data to transfer such motions from one character to another.
2 min read
A generative adversarial network (GAN)
Machine Learning Research

Image Generation Transformed

A recent generative adversarial network (GAN) produced more coherent images using modified transformers that replaced fully connected layers with convolutional layers. A new GAN achieved a similar end using transformers in their original form.
2 min read
Data related to SElf-supERvised (SEER), an image classifier pretrained on uncurated, unlabeled images
Machine Learning Research

Pretraining on Uncurated Data

It’s well established that pretraining a model on a large dataset improves performance on fine-tuned tasks. In sufficient quantity and paired with a big model, even data scraped from the internet at random can contribute to the performance boost.
2 min read
Examples of image generators using GANsformer
Machine Learning Research

Attention for Image Generation

Attention quantifies how each part of one input affects the various parts of another. Researchers added a step that reverses this comparison to produce more convincing images.
2 min read
Sequence showing a training step that uses different perspectives of the same patient to enhance unsupervised pretraining
Machine Learning Research

Same Patient, Different Views

When you lack labeled training data, pretraining a model on unlabeled data can compensate. New research pretrained a model three times to boost performance on a medical imaging task.
2 min read
Sequence related to image processing
Machine Learning Research

Vision Models Get Some Attention

Self-attention is a key element in state-of-the-art language models, but it struggles to process images because its memory requirement rises rapidly with the size of the input. New research addresses the issue with a simple twist on a convolutional neural network.
2 min read
Tag-Retrieve-Compose-Synthesize (TReCS)
Machine Learning Research

Pictures From Words and Gestures

A new system combines verbal descriptions and crude lines to visualize complex scenes. Google researchers led by Jing Yu Koh proposed Tag-Retrieve-Compose-Synthesize (TReCS), a system that generates photorealistic images by describing what they want to see while mousing around on a blank screen.
2 min read
Images generated by a network designed to visualize what goes on in peoples’ brains while they watch Doctor Who
Machine Learning Research

What the Brain Sees

What’s creepier than images from the sci-fi TV series Doctor Who? Images generated by a network designed to visualize what goes on in peoples’ brains while they watch Doctor Who.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox