Wu Dao 2.0

5 Posts

China’s LLMs Open Up: Alibaba’s new open source LLMs

The latest wave of large language models trained in Chinese is open source for some users. Internet giant Alibaba released large language models that are freely available to smaller organizations.

Wu Dao 2.0

Yoav Shoham: Language models that reason

I believe that natural language processing in 2022 will re-embrace symbolic reasoning, harmonizing it with the statistical operation of modern neural networks. Let me explain what I mean by this.

Illustration of giant Christmas tree in a town plaza

Wu Dao 2.0

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

Two images showing RETRO Architecture and Gopher (280B) vs State of the Art

Wu Dao 2.0

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

Wu Dao 2.0

GPT-3 for All: GPT-3 NLP Model is Available for Select Azure Users

Microsoft is making GPT-3 available to selected customers through its Azure cloud service.

Wu Dao 2.0

China’s LLMs Open Up: Alibaba’s new open source LLMs

Yoav Shoham: Language models that reason

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

GPT-3 for All: GPT-3 NLP Model is Available for Select Azure Users

Subscribe to The Batch