An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
Google

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
2 min read
smaller town bigger tree
Google

Trillions of Parameters: Are AI Models With Trillions of Parameters the New Normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
2 min read
Two images showing RETRO Architecture and Gopher (280B) vs State of the Art
Google

Large Language Models Shrink: Gopher and RETRO Prove Lean Language Models Can Push Boundaries

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.
2 min read
Animated graphics from Google demonstrate Project Relate, a tool for recognizing impaired speech. .
Google

Everyone Has a Voice: Project Relate Offers Synthesized Speech that Works in Real Time

An Android app offers speech recognition model for speech impaired by cerebral palsy, Down syndrome, Parkinson’s disease, stroke, or traumatic brain injury.
2 min read
Animated image that shows highlights of the U.S. AI Strategy.
Google

U.S. AI Strategy In Gear: National Security Commision Influences U.S. Military AI Policy

Recommendations from the National Security Commission on AI were enshrined in over 190 laws in 2021.
2 min read
An animation of a protein modeled by AlphaFold 2.
Google

DeepMind Doubles Down on AlphaFold: DeepMind Launches Company to Commercialize AlphaFold 2

Isomorphic aims to build its business on AlphaFold 2, an ensemble of neural networks that finds the shapes of protein molecules.
1 min read
First image showing the Google Tensor chip. Second image showing the Google Pixel 6 phone
Google

Competition Heats Up in Mobile AI: Google Designed Its Own Tensor AI Chip for Smartphones

Google designed its own AI chip for its new smartphone — a snub to Qualcomm, the dominant chip vendor in Android phones. What’s new: Google debuted the Tensor chip last week
2 min read
Illustration of Thumbzilla destroying a city and shooting lightning from its mouth (T-Rex with Facebook thumbs up)
Google

Don’t Be Evil: What if AI Enables Corporations to Become Truly Evil?

Tech companies generally try to be (or to appear to be) socially responsible. Would some rather let AI’s negative impacts slide?
2 min read
Animations that shows how the Google Search Algorithm works with Multimodal AI
Google

Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.
2 min read
Animated image showing the transformer architecture of processing an image
Google

Transformer Speed-Up Sped Up: How to Speed Up Image Transformers

The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces
1 min read
Animation showing Hierarchical Outlier Detection (HOD)
Google

Oddball Recognition: New Method Identifies Outliers in AI Training Data

Models trained using supervised learning struggle to classify inputs that differ substantially from most of their training data. A new method helps them recognize such outliers.
2 min read
Results of survey about how AI Engineers vs US public feel about ethical issues
Google

AI Engineers Weigh In on AI Ethics: Survey Shows How AI Engineers Feel About Ethical Issues

Machine learning researchers tend to trust international organizations, distrust military forces, and disagree on how much disclosure is necessary when describing new models, a new study found.
2 min read
Animation showing gMLP, a simple architecture that performed some language and vision tasks as well as transformers
Google

Perceptrons Are All You Need: Google Brain's Multi-Layer Perceptron Rivals Transformers

The paper that introduced the transformer famously declared, “Attention is all you need.” To the contrary, new work shows you may not need transformer-style attention at all.What’s new: Hanxiao Liu and colleagues at Google
2 min read
A new framework that helps models “unlearn” information selectively and incrementally
Google

Deep Unlearning: AI Researchers Teach Models to Unlearn Data

Privacy advocates want deep learning systems to forget what they’ve learned. What’s new: Researchers are seeking ways to remove the influence of particular training examples, such as an individual’s personal information, from a trained model without affecting its performance, Wired reported.
1 min read
Apple's CEO Tim Cook discussing privacy with a Privacy sign above him
Google

User Privacy Versus Child Safety

Apple, which has made a point of its commitment to user privacy, announced that it will scan iPhones for evidence of child abuse. The tech giant will include a machine learning model on the device.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox