UC Berkeley

28 Posts

ChatGPT Ain’t What It Used to Be: ChatGPT's behavior change over time
UC Berkeley

ChatGPT Ain’t What It Used to Be: ChatGPT's behavior change over time

It wasn’t your imagination: OpenAI’s large language models have changed. Researchers at Stanford and UC Berkeley found that the performance of GPT-4 and GPT-3.5 has drifted in recent months. In a limited selection of tasks, some prompts yielded better results than before, some worse.
Examples of learned gaits acquired on a variety of real-world terrains
UC Berkeley

Real-World Training on the Double: A new method rapidly trains robots in the real world.

Roboticists often train their machines in simulation, where the controller model can learn from millions of hours of experience. A new method trained robots in the real world in 20 minutes.
Model that defeats KataGo, an open source Go-playing system
UC Berkeley

Champion Model Is No Go: Adversarial AI Beats Master KataGo Algorithm

A new algorithm defeated a championship-winning Go model using moves that even a middling human player could counter. Researchers trained a model to defeat KataGo, an open source Go-playing system that has beaten top human players.
Technical components of No Language Left Behind and how they fit together
UC Berkeley

The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages

Sentence pairs that have equivalent meanings in different languages — typically used to train machine translation systems — have been available in sufficient quantities for only around 100 languages. New work doubled that number and produced a more capable model.
Man sitting on a tree with a monkey and a gorilla
UC Berkeley

Decision Trees: From Root to Leaves — Decision Trees for Machine Learning Explained

What kind of beast was Aristotle? The philosopher's follower Porphyry, who lived in Syria during the third century, came up with a logical way to answer the question...
RobocallGuard system architecture
UC Berkeley

Scam Definitely: AI tools to block spam phone calls.

Robocalls slip through smartphone spam filters, but a new generation of deep learning tools promises to tighten the net. Research proposed fresh approaches to thwarting robocalls. Such innovations soon could be deployed in apps.
Alexei Efros
UC Berkeley

Alexei Efros: Learning from the ground up

Things are really starting to get going in the field of AI. After many years (decades?!) of focusing on algorithms, the AI community is finally ready to accept the central role of data and the high-capacity models that are capable of taking advantage of this data.
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
UC Berkeley

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Google's Decision Transformer
UC Berkeley

Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.

Transformers have matched or exceeded earlier architectures in language modeling and image classification. New work shows they can achieve state-of-the-art results in some reinforcement learning tasks as well.
Frozen Pretrained Transformer (FPT) explained
UC Berkeley

Transformers Are Smarter Than You Think: Language transformers can do math, vision, and logic.

The transformer architecture has shown an uncanny ability to model not only language but also images and proteins. New research found that it can apply what it learns from the first domain to the others.
Animated video showing a system to interpret electrical impulses from the brain as words
UC Berkeley

Listening to the Brain: NLP System Translates a Man's Brain Activity Into Words

Neural networks translated a paralyzed man’s brainwaves into conversational phrases. Researchers trained a system to interpret electrical impulses from the brain of a man who had lost the ability to speak 15 years ago, and displayed them as words on a video screen.
A four-legged robot walking over difficult and changing terrain
UC Berkeley

Walking the Dog: Training a robot to walk over unsteady terrain with RL.

A reinforcement learning system enabled a four-legged robot to amble over unfamiliar, rapidly changing terrain.
Surgical robots performing different actions
UC Berkeley

Medical AI Gets a Grip: An AI System controlled DaVinci surgical robots.

Surgical robots perform millions of delicate operations annually under human control. Now they’re getting ready to operate on their own.
Animation showing a AI's metaphorical transition to using green energy.
UC Berkeley

Greener Machine Learning: Here's how AI models can shrink their carbon footprints.

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...
Taxonomy of deep learning architectures using self-attention for visual recognition and images from the COCO dataset
UC Berkeley

Vision Models Get Some Attention: Researchers add self-attention to convolutional neural nets.

Self-attention is a key element in state-of-the-art language models, but it struggles to process images because its memory requirement rises rapidly with the size of the input. New research addresses the issue with a simple twist on a convolutional neural network.
Load More

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox