AI-driven balloon reaching high altitude
Efficiency

How to Drive a Balloon

Helium balloons that beam internet service to hard-to-serve areas are using AI to navigate amid high-altitude winds. Loon, the Alphabet division that provides wireless internet via polyethylene blimps.
2 min read
Illustration of a neighborhood haunted by an evil pumpkin and a black cat
Efficiency

Giant Models Bankrupt Research

What if AI requires so much computation that it becomes unaffordable?The fear: Training ever more capable models will become too pricey for all but the richest corporations and government agencies. Rising costs will
2 min read
Illustration of two witches with half a pumpkin each and the moon behind them
Efficiency

The AI Community Splinters

Will international rivalries fragment international cooperation in machine learning? Countries competing for AI dominance will lash out at competitors.
2 min read
Information and components of a battery
Efficiency

Getting a Charge From AI

Machine learning is helping to design energy cells that charge faster and last longer. Battery developers are using ML algorithms to devise new chemicals, components, and charging techniques faster than traditional techniques allow.
1 min read
Graphs related to different attention mechanisms
Efficiency

More Efficient Transformers

As transformer networks move to the fore in applications from language to vision, the time it takes them to crunch longer sequences becomes a more pressing issue. A new method lightens the computational load using sparse attention.
2 min read
Graphs with data related to Microsoft's library DeepSpeed
Efficiency

Toward 1 Trillion Parameters

An open source library could spawn trillion-parameter neural networks and help small-time developers build big-league models. Microsoft upgraded DeepSpeed, a library that accelerates the PyTorch deep learning framework.
2 min read
Data and information related to dropout
Efficiency

Dropout With a Difference

The technique known as dropout discourages neural networks from overfitting by deterring them from reliance on particular features. A new approach reorganizes the process to run efficiently on the chips that typically run neural network calculations.
2 min read
Graphs and data related to transformer networks
Efficiency

The Transformation Continues

Transformer networks are gaining popularity as a high-accuracy alternative to recurrent neural networks. But they can run slowly when they’re applied to long sequences.
2 min read
Data related to experience replay
Efficiency

Experience Counts

If the world changes every second and you take a picture every 10 seconds, you won’t have enough pictures to observe the changes clearly, and storing a series of pictures won’t help. On the other hand, if you take a picture every tenth of a second, then storing a history will help model the world.
2 min read
Graphs and data related to semi-supervised learning
Efficiency

All Examples Are Not Equal

Semi-supervised learning — a set of training techniques that use a small number of labeled examples and a large number of unlabeled examples — typically treats all unlabeled examples the same way. But some examples are more useful for learning than others.
2 min read
Information related to the Once-for-All (OFA) method
Efficiency

Build Once, Run Anywhere

From server to smartphone, devices with less processing speed and memory require smaller networks. Instead of building and training separate models to run on a variety of hardware, a new approach trains a single network that can be adapted to any device.
2 min read
Excerpt from study about models that learn to predict task-specific distance metrics
Efficiency

Misleading Metrics

A growing body of literature shows that some steps in AI’s forward march may actually move sideways. A new study questions advances in metric learning.
2 min read
Talking bubbles inside talking bubbles
Efficiency

Bigger is Better

Natural language processing lately has come to resemble an arms race, as the big AI companies build models that encompass ever larger numbers of parameters. Microsoft recently held the record — but not for long.
2 min read
Hamster running in a hamster ball
Efficiency

Running Fast, Standing Still

Machine learning researchers report better and better results, but some of that progress may be illusory. Some models that appear to set a new state of the art haven’t been compared properly to their predecessors, Science News reports based on several published surveys.
1 min read
Graphs and data related to Plan2Vec
Efficiency

Visual Strategies for RL

Reinforcement learning can beat humans at video games, but humans are better at coming up with strategies to master more complex tasks. New work enables neural networks to connect the dots.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox