A/B Test loop for building human insight
Letters

A Different Approach to A/B Testing

When a lot of data is available, machine learning is great at automating decisions. But when data is scarce, consider using the data to augment human insight, so people can make better decisions.
Speech bubble that says "It did well on the test set!"
Letters

High Test-Set Accuracy Is Not Enough

Over the last several decades, driven by a multitude of benchmarks, supervised learning algorithms have become really good at achieving high accuracy on test datasets. As valuable as this is, unfortunately maximizing average test set accuracy isn’t always enough.
The price of shares in video game retailer GameStop (NYSE: GME)
Letters

Trading on AI: The GameStop Phenomenon

The price of shares in video game retailer GameStop (NYSE: GME) gyrated wildly last week. Many people viewed the stock’s rapid ascent as a David-versus-Goliath story...
Slide that says "Proof of concept - production"
Letters

Don't Confuse Proof of Concept With Production Deployment

Last week, I talked about how best practices for machine learning projects are not one-size-fits-all, and how they vary depending on whether a project uses structured or unstructured data, and whether the dataset is small or big.
Table with information related to data and datasets
Letters

Structured and Unstructured Data: Implications for AI Development

Experience gained in building a model to solve one problem doesn’t always transfer to building models for other problems. How can you tell whether or not intuitions honed in one project are likely to generalize to another?
US Capitol during winter
Letters

How AI Can Strengthen Democracy

Last Wednesday, the U.S. Capitol building was overrun by insurrectionists at the moment when members of Congress were certifying the results of a national election.
Casino game
Letters

AI Concentrates Power and Wealth

In my letter last week, I alluded to the way AI tends to concentrate power and wealth. This tendency worries me, and I believe it deserves more attention. The U.S. government has been looking into these winner-take-most dynamics at a few leading technology companies...
Fireworks
Letters

Happy New Year! Three Aspirations for AI in 2021

Happy New Year! As we enter 2021, I want to share with you three wishes I have for AI in the upcoming year. I hope we can: Narrow the gap between proofs-of-concept and production.
Andrew Ng holding a cup, small christmas tree behind
Letters

The Power of Gratitude

Every year for the past decade, I flew to Singapore or Hong Kong to celebrate my mother’s birthday with her on December 22. This year, for the first time, we did it via Zoom.
Many research papers
Letters

Rules for Corporate AI Researchers

When a researcher works for a company, what rights should they have to publish their work, and what rights should the company that sponsored the work have? This issue has come up many times in the AI community across many companies...
Brass weight scales with cupped trays
Letters

Values for the AI Community, Part 3: Ethical AI

Like many people in the AI community, I am saddened by the sudden departure from Google of ethical AI researcher Timnit Gebru. Timnit is a tireless champion of diversity and fairness in AI.
Light bulb on
Letters

Advice for Start-Up Founders

The rise of AI creates opportunities for new startups that can move humanity forward. In the 1990s, the internet was embraced successfully by incumbent companies including Apple and Microsoft, but it also inspired hugely impactful...
Labeling training data charts
Letters

Data-Centric AI Development: Small-Data Problems

Over the last two weeks, I described the importance of clean, consistent labels and how to use human-level performance (HLP) to trigger a review of whether labeling instructions need to be reviewed.
Detecting system pointing out scratches on a surface
Letters

AI Versus Human-Level Performance, Part 2

Last week, I wrote about the limitation of using human-level performance (HLP) as a metric to beat in machine learning applications for manufacturing and other fields. In this letter, I would like to show why beating HLP isn’t always the best way to improve performance.
Different defects on a platform
Letters

AI Versus Human-Level Performance

Beating human-level performance (HLP) has been a goal of academic research in machine learning from speech recognition to X-ray diagnosis. When your model outperforms humans, you can argue that you’ve reached a significant milestone and publish a paper!

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox