Wafer Scale Engine (WSE)

4 Posts

Charts showing performance scaling of TPU vs GPU on MLPerf-Transformer and Cerebras GPT-3 XL Performance
Wafer Scale Engine (WSE)

Built to Scale: Andromeda Supercomputer from Cerebras Speeds up AI

A new computing cluster delivers more bang per chip. Cerebras unveiled Andromeda, a supercomputer based on its processors. Unlike conventional clusters, the system’s processing speed rises linearly with additional processors.
Illustration of giant Christmas tree in a town plaza
Wafer Scale Engine (WSE)

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
Colossus Mk2, processor by Graphcore
Wafer Scale Engine (WSE)

New Horsepower for Neural Nets

A high-profile semiconductor startup made a bid for the future of AI computation. UK startup Graphcore released the Colossus Mk2, a processor intended to perform the matrix math calculations at the heart of deep learning more efficiently than other specialized processors.
Wafer Scale chip
Wafer Scale Engine (WSE)

Size Matters

Silicon Valley startup Cerebras shifted out of stealth mode to unveil its flagship product: an enormous chip designed from the ground up to accelerate neural networks.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox