Switch Transformer

4 Posts

A graph shows the cost in dollars of training large natural language processing models.
Switch Transformer

Who Can Afford to Train AI?: Cost of AI is Too Expensive for Many Small Companies

The cost of training top-performing machine learning models has grown beyond the reach of smaller companies.
2 min read
Animations that shows how the Google Search Algorithm works with Multimodal AI
Switch Transformer

Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.
2 min read
Animation showing a methaphorical transition from AI to a green environment
Switch Transformer

Greener Machine Learning

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...
1 min read
Different graphs showing switch transformer data
Switch Transformer

Bigger, Faster Transformers

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox