The Batch

Hardware

35 Posts

Grounding DINO animation depicting object detection with bounding boxes on images.
Hardware

Object Detection for Small Devices: Grounding DINO 1.5, an edge device model built for faster, smarter object detection

An open source model is designed to perform sophisticated object detection on edge devices like phones, cars, medical equipment, and smart doorbells.
Robotic arms collaborating to fold a red garment on a table.
Hardware

Household Help: π0, a machine learning system for household robotics

A new generation of robots can handle some household chores with unusual skill.
Close-up of a Chinese-made server chip labeled with the logo and text ‘710’ mounted on a motherboard.
Hardware

Further Chip Restrictions on China: TSMC stops advanced chip production for China on U.S. orders

The largest manufacturer of AI chips told its Chinese customers it would stop fabricating their most advanced designs, further limiting China’s access to AI hardware.
Comparison of Minecraft terrain with and without player modifications.
Hardware

No Game Engine Required: AI creates an interactive Minecraft-like world in real time

A real-time video generator lets you explore an open-ended, interactive virtual world — a video game without a game engine.
Person sitting by a campfire holding a stick, looking worried in a dark setting.
Hardware

AI Burns All the Energy: Will AI’s growing power demands drain the grid?

The globe’s growing AI infrastructure requires huge amounts of electricity, possibly more than power providers can generate responsibly. Could AI models suck energy resources dry?
Nuclear power plant cooling towers emitting steam into the sky.
Hardware

AI Giants Go Nuclear: Amazon, Google, and Microsoft bet on nuclear power to meet AI energy demands

Major AI companies plan to meet the growing demand with nuclear energy.
Design layout of Sedenak Data Centre Park, Malaysia.
Hardware

Malaysia’s Data Center Boom: Malaysia emerges as an AI and cloud computing hub, drawing billions in investment

Malaysia’s location, natural resources, and investor-friendly government are perfect for data centers, turning part of the country into an AI-fueled boomtown.
High Gear for Llama 3.1 405B: SambaNova boosts Llama 3.1 performance with fast, free access to largest model
Hardware

High Gear for Llama 3.1 405B: SambaNova boosts Llama 3.1 performance with fast, free access to largest model

SambaNova raised the speed limit for access to the largest model in the Llama 3.1 family — and it’s free.
Giant golden and black AI chip
Hardware

Nvidia Revs AI Engine: All about Nvidia’s new Blackwell architecture and B200 GPU

Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.
Blazing Inference Speed: Groq elevates AI processing speed with advanced chips.
Hardware

Blazing Inference Speed: Groq elevates AI processing speed with advanced chips.

An upstart chip company dramatically accelerates pretrained large language models. Groq offers cloud access to Meta’s Llama 2 and Mistral.ai’s Mixtral at speeds an order of magnitude greater than other AI platforms. Registered users can try it.
Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.
Hardware

Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.

Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.
GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.
Hardware

GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.

The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.
Sequence of industrial machines working
Hardware

Industrial Strength Language Model: Siemens and Microsoft launch GPT-powered Copilot for manufacturing machinery.

ChatGPT is pitching in on the assembly line. Siemens and Microsoft launched a joint pilot program of a GPT-powered model for controlling manufacturing machinery. German automotive parts manufacturer Schaeffler is testing the system in its factories, as is Siemens itself. 
More Cloud GPUs on the Way: Voltage Park offers Nvidia GPUs at $1.89/hour for startups and researchers
Hardware

More Cloud GPUs on the Way: Voltage Park offers Nvidia GPUs at $1.89/hour for startups and researchers

A new cloud-computing company promises to provide scarce AI processing power to startups and researchers. Voltage Park, a nonprofit north of Silicon Valley, will offer processing power from 24,000 top-of-the-line Nvidia H100 graphics processing units (GPUs)...
Cruise robotaxis parked
Hardware

Cruise Control: Cruise shuts down self-driving cars due to California safety concerns.

The state of California pulled the parking brake on Cruise driverless vehicles. The DMV suspended Cruise’s permit to operate vehicles in the state without safety drivers. The General Motors subsidiary responded by halting its robotaxi operations across the United States.
Load More

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox