Graphics Processing Unit (GPU)

BERT, a large language model released in 2018 and built upon the then-new transformer architecture, marked a paradigm shift in AI.

Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.

Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.

The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.

A new cloud-computing company promises to provide scarce AI processing power to startups and researchers. Voltage Park, a nonprofit north of Silicon Valley, will offer processing power from 24,000 top-of-the-line Nvidia H100 graphics processing units (GPUs)...

An upstart supplier of AI chips secured a major customer. Cerebras, which competes with Nvidia in hardware for training large models, signed a $100 million contract with Abu Dhabi tech conglomerate G42. The deal is the first part of a multi-stage plan to build a network of supercomputers.

Nvidia’s top-of-the-line chips are in high demand and short supply. There aren’t enough H100 graphics processing units (GPUs) to meet the crush of demand brought on by the vogue for generative AI, VentureBeat reported.

Chinese companies have found loopholes to sidestep United States limits on AI chips. Facing severe limits on U.S. exports of high-performance chips, Chinese AI firms are purchasing them through subsidiaries and using them through cloud services, the Financial Times reported.

Advanced AI requires advanced hardware. What if the global supply of high-end AI chips dries up? Most of the world’s advanced AI processors are manufactured in Taiwan, where tension with mainland China is rising.

New U.S. restrictions on chip sales aim to hamper China’s AI efforts. The U.S. government published sweeping limits on sales of processors that involve U.S. designs and technology to Chinese businesses. U.S. officials stated that the restrictions are meant to prevent China from militarizing AI.

Nvidia, known for chips designed to process AI systems, is providing access to large language models. Nvidia announced early access to NeMo LLM and BioNeMo, cloud-computing services that enable developers to generate text and biological sequences respectively.

The ban impacts Nvidia's A100 and H100 chips, and AMD's MI250.

Let’s get this out of the way: A brain is not a cluster of graphics processing units, and if it were, it would run software far more complex than the typical artificial neural network. Yet neural networks were inspired by the brain’s architecture.

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

Google designed its own AI chip for its new smartphone — a snub to Qualcomm, the dominant chip vendor in Android phones. What’s new: Google debuted the Tensor chip last week