Wu Dao 2.0

3 Posts

smaller town bigger tree
Wu Dao 2.0

Trillions of Parameters: Are AI Models With Trillions of Parameters the New Normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
2 min read
Two images showing RETRO Architecture and Gopher (280B) vs State of the Art
Wu Dao 2.0

Large Language Models Shrink: Gopher and RETRO Prove Lean Language Models Can Push Boundaries

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.
2 min read
Animation showing GPT-3 in full action
Wu Dao 2.0

GPT-3 for All: GPT-3 is Available for Select Azure Users

Microsoft is making GPT-3 available to selected customers through its Azure cloud service.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox