Feb 21, 2024

Researchers devised a way to reduce memory requirements when fine-tuning large language models. Kai Lv and colleagues at Fudan University proposed low memory optimization (LOMO), a modification of stochastic gradient descent that stores less data than other optimizers during fine-tuning.

Judges in competitive gymnastics are using an AI system to double-check their decisions.

Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.

OpenAI’s new video generator raises the bar for detail and realism in generated videos — but the company released few details about how it built the system.

Earlier this month, my team AI Fund held its annual co-founder and CEO summit, where many of our collaborators gathered in California for two days to discuss how to build AI companies.

This week's top AI news and research stories featured OpenAI's Sora, Huawei's AI chips, an AI system to double-check judges' decisions in competitive gymnastics, and Würstchen, and a way to reduce memory requirements when fine-tuning large language models. But first:

The Batch AI News and Insights: Earlier this month, my team AI Fund held its annual co-founder and CEO summit, where many of our collaborators gathered in California for two days to discuss how to build AI companies.