Proportion of examples covered by number of annotators (sorted by number of annotations)
Bias

AI Knows Who Labeled the Data

The latest language models are great at answering questions about a given text passage. However, these models are also powerful enough to recognize an individual writer’s style, which can clue them in to the right answers. New research measures such annotator bias in several data sets.
Question from an exam
Bias

Smart Students, Dumb Algorithms: NLP Systems Struggle at Grading Essays

A growing number of companies that sell standardized tests are using natural language processing to assess writing skills. Critics contend that these language models don’t make the grade.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox