Hardware

26 Posts

Blazing Inference Speed: Groq elevates AI processing speed with advanced chips.
Hardware

Blazing Inference Speed: Groq elevates AI processing speed with advanced chips.

An upstart chip company dramatically accelerates pretrained large language models. Groq offers cloud access to Meta’s Llama 2 and Mistral.ai’s Mixtral at speeds an order of magnitude greater than other AI platforms. Registered users can try it.
Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.
Hardware

Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.

Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.
GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.
Hardware

GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.

The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.
Sequence of industrial machines working
Hardware

Industrial Strength Language Model: Siemens and Microsoft launch GPT-powered Copilot for manufacturing machinery.

ChatGPT is pitching in on the assembly line. Siemens and Microsoft launched a joint pilot program of a GPT-powered model for controlling manufacturing machinery. German automotive parts manufacturer Schaeffler is testing the system in its factories, as is Siemens itself. 
More Cloud GPUs on the Way: Voltage Park offers Nvidia GPUs at $1.89/hour for startups and researchers
Hardware

More Cloud GPUs on the Way: Voltage Park offers Nvidia GPUs at $1.89/hour for startups and researchers

A new cloud-computing company promises to provide scarce AI processing power to startups and researchers. Voltage Park, a nonprofit north of Silicon Valley, will offer processing power from 24,000 top-of-the-line Nvidia H100 graphics processing units (GPUs)...
Cruise robotaxis parked
Hardware

Cruise Control: Cruise shuts down self-driving cars due to California safety concerns.

The state of California pulled the parking brake on Cruise driverless vehicles. The DMV suspended Cruise’s permit to operate vehicles in the state without safety drivers. The General Motors subsidiary responded by halting its robotaxi operations across the United States.
Series of NVIDIA chips disappearing one by one
Hardware

GPU Shortage Intensifies: All about Nvidia's GPU shortage

Nvidia’s top-of-the-line chips are in high demand and short supply. There aren’t enough H100 graphics processing units (GPUs) to meet the crush of demand brought on by the vogue for generative AI, VentureBeat reported.
Deep Learning at (Small) Scale: How to run PilotNet on a Raspberry Pi Pico microcontroller
Hardware

Deep Learning at (Small) Scale: How to run PilotNet on a Raspberry Pi Pico microcontroller

TinyML shows promise for bringing deep learning to applications where electrical power is scarce, processing in the cloud is impractical, and/or data privacy is paramount.
A person's hand grabbing a handful of AI chips arranged on a table
Hardware

Restricted Chips Slip Through: Loopholes help Chinese companies get U.S. chips.

Chinese companies have found loopholes to sidestep United States limits on AI chips. Facing severe limits on U.S. exports of high-performance chips, Chinese AI firms are purchasing them through subsidiaries and using them through cloud services, the Financial Times reported.
Charts showing performance scaling of TPU vs GPU on MLPerf-Transformer and Cerebras GPT-3 XL Performance
Hardware

Built to Scale: Andromeda Supercomputer from Cerebras Speeds up AI

A new computing cluster delivers more bang per chip. Cerebras unveiled Andromeda, a supercomputer based on its processors. Unlike conventional clusters, the system’s processing speed rises linearly with additional processors.
Person with a sad face in front of an abandoned Chip's Candies factory
Hardware

No More GPUs: Confronting the Fear of a Global Chip Shortage

Advanced AI requires advanced hardware. What if the global supply of high-end AI chips dries up? Most of the world’s advanced AI processors are manufactured in Taiwan, where tension with mainland China is rising.
Nvidia Chip
Hardware

Transformer Accelerator: Nvidia's H100 is Designed to Train Transformers Faster

Is your colossal text generator bogged down in training? Nvidia announced a chip designed to accelerate the transformer architecture, the basis of large language models such as GPT-3.
AI Research SuperCluster (RSC)
Hardware

New Supercomputer on the Block: All about Meta's AI Research Supercluster

Facebook’s parent company is staking its future on a new compute cluster. Meta unveiled AI Research SuperCluster (RSC), which is designed to accelerate training of large models for applications like computer vision, natural language processing, and speech recognition.
Semiconductor chip
Hardware

Chips at Risk: How the chip shortage impacts AI.

The hardware that runs the latest AI systems faces rising uncertainty as models grow larger and more computationally intensive. The U.S. Commerce Department sounded an alarm over bottlenecks in the availability of semiconductor chips.
First image showing the Google Tensor chip. Second image showing the Google Pixel 6 phone
Hardware

Competition Heats Up in Mobile AI: Google Designed Its Own Tensor AI Chip for Smartphones

Google designed its own AI chip for its new smartphone — a snub to Qualcomm, the dominant chip vendor in Android phones. What’s new: Google debuted the Tensor chip last week
Load More

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox