UC Berkeley

27 Posts

Model that defeats KataGo, an open source Go-playing system
UC Berkeley

Champion Model Is No Go: Adversarial AI Beats Master KataGo Algorithm

A new algorithm defeated a championship-winning Go model using moves that even a middling human player could counter. Researchers trained a model to defeat KataGo, an open source Go-playing system that has beaten top human players.
Technical components of No Language Left Behind and how they fit together
UC Berkeley

Massively Multilingual Translation: NLP Model Translates 200 Different Languages

Sentence pairs that have equivalent meanings in different languages — typically used to train machine translation systems — have been available in sufficient quantities for only around 100 languages. New work doubled that number and produced a more capable model.
Man sitting on a tree with a monkey and a gorilla
UC Berkeley

Decision Trees: From Root to Leaves — Decision Trees for Machine Learning Explained

What kind of beast was Aristotle? The philosopher's follower Porphyry, who lived in Syria during the third century, came up with a logical way to answer the question...
RobocallGuard system architecture
UC Berkeley

Scam Definitely: AI tools to block spam phone calls.

Robocalls slip through smartphone spam filters, but a new generation of deep learning tools promises to tighten the net. Research proposed fresh approaches to thwarting robocalls. Such innovations soon could be deployed in apps.
Alexei Efros
UC Berkeley

Alexei Efros: Learning from the ground up.

Things are really starting to get going in the field of AI. After many years (decades?!) of focusing on algorithms, the AI community is finally ready to accept the central role of data and the high-capacity models that are capable of taking advantage of this data.
A living room made out of cups of coffee: the people, the seats, the chimney, the lamp, all gather around a cozy fire.
UC Berkeley

One Architecture to Do Them All: Transformer: The AI architecture that can do it all.

The transformer architecture extended its reach to a variety of new domains.What happened: Originally developed for natural language processing, transformers are becoming the Swiss Army Knife of deep learning.
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
UC Berkeley

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Google's Decision Transformer
UC Berkeley

Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.

Transformers have matched or exceeded earlier architectures in language modeling and image classification. New work shows they can achieve state-of-the-art results in some reinforcement learning tasks as well.
Detection of a digitally altered image of a frog holding a violin
UC Berkeley

Fighting Fakes

A supergroup of machine learning models flags manipulated photos. Jigsaw, a tech incubator owned by Alphabet, released a system that detects digitally altered images.
Frozen Pretrained Transformer (FPT) explained
UC Berkeley

Transformers: Smarter Than You Think

The transformer architecture has shown an uncanny ability to model not only language but also images and proteins. New research found that it can apply what it learns from the first domain to the others.
Animated video showing a system to interpret electrical impulses from the brain as words
UC Berkeley

Listening to the Brain: NLP System Translates a Man's Brain Activity Into Words

Neural networks translated a paralyzed man’s brainwaves into conversational phrases. Researchers trained a system to interpret electrical impulses from the brain of a man who had lost the ability to speak 15 years ago, and displayed them as words on a video screen.
A four-legged robot walking over difficult and changing terrain
UC Berkeley

Walking the Dog

A reinforcement learning system enabled a four-legged robot to amble over unfamiliar, rapidly changing terrain.
Surgical robots performing different actions
UC Berkeley

Medical AI Gets a Grip

Surgical robots perform millions of delicate operations annually under human control. Now they’re getting ready to operate on their own.
Animation showing a AI's metaphorical transition to using green energy.
UC Berkeley

Greener Machine Learning: Techniques for Reducing the Carbon Footprint of NLP Models

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...
Sequence related to image processing
UC Berkeley

Vision Models Get Some Attention

Self-attention is a key element in state-of-the-art language models, but it struggles to process images because its memory requirement rises rapidly with the size of the input. New research addresses the issue with a simple twist on a convolutional neural network.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox