Books on the floor
Natural Language Processing

How to Learn Machine Learning

Want to become an AI practitioner? Here’s a program that will take you from beginner to job-ready. You may already have a head start, depending on your background. For a motivated person who starts with a solid high-school education it may take around two years.
Illustration: Board game pieces and puzzle pieces
Natural Language Processing

How to Keep Up in a Changing Field

Machine learning changes fast. Take natural language processing. Word2vec, introduced in 2013, quickly replaced one-hot encoding with word embeddings. Transformers revolutionized the field in 2017 by parallelizing the previously sequential training process.
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.
Natural Language Processing

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
A graph shows the cost in dollars of training large natural language processing models.
Natural Language Processing

Who Can Afford to Train AI?: Cost of AI is Too Expensive for Many Small Companies

The cost of training top-performing machine learning models has grown beyond the reach of smaller companies.
Animation showing GPT-3 in full action
Natural Language Processing

GPT-3 for All: GPT-3 NLP Model is Available for Select Azure Users

Microsoft is making GPT-3 available to selected customers through its Azure cloud service.
Animations that shows how the Google Search Algorithm works with Multimodal AI
Natural Language Processing

Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.
Series of example of accurate and inaccurate matching images to text
Natural Language Processing

Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data

The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.
Graph showing Expire-span which enables attention to ignore tokens that aren’t useful to the task at hand
Natural Language Processing

Sharper Attention: NLP Transformer Technique for More Efficient Token Usage

Self-attention enables transformer networks to track relationships between distant tokens — such as text characters — in long sequences, but the computational resources required grow quadratically with input size.
Libel-detection system from CaliberAI.
Natural Language Processing

Double Check for Defamation: NLP System Scans Text for Libel

A libel-detection system could help news outlets and social media companies stay out of legal hot water. CaliberAI, an Irish startup, scans text for statements that could be considered defamatory, Wired reported.
Animation showing a AI's metaphorical transition to using green energy.
Natural Language Processing

Greener Machine Learning: Techniques for Reducing the Carbon Footprint of NLP Models

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...
Voice recognition tool "Bleep" working
Natural Language Processing

Haters Gonna [Mute]: Intel NLP Allows Voice Chatters to Silence Hate Speech

A new tool aims to let video gamers control how much vitriol they receive from fellow players. Intel announced a voice recognition tool called Bleep that the company claims can moderate voice chat automatically, allowing users to silence offensive language.
Different graphs showing switch transformer data
Natural Language Processing

Bigger, Faster Transformers: Google's Switch Transformer uses MoE for Efficient NLP

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.
GPT-Neo related animation
Natural Language Processing

Language Models Want to Be Free: EleutherAI is Making an Open Source Version of GPT-3

A grassroots research collective aims to make a GPT-3 clone that’s available to everyone. EleutherAI, a loose-knit group of independent researchers, is developing GPT-Neo, an open source, free-to-use version of OpenAI’s gargantuan language model.
Animation alternating sad and happy emojis
Natural Language Processing

Online Clues to Mental Illness: NLP Model Analyzes Social Media for Signs of Mental Illness

Can social media posts reveal early signs of mental illness? A new machine learning model shows promising results. Researchers developed a model that analyzes messages and images posted by Facebook users for indicators of psychological problems.
Proof Search Tree
Natural Language Processing

The Proof Is in the Network: An NLP Transformer Based on GPT that Creates Math Proofs

OpenAI’s Generative Pre-Trained Transformer (GPT) architecture has created coherent essays, images, and code. Now it generates mathematical proofs as well.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox