A living room made out of cups of coffee: the people, the seats, the chimney, the lamp, all gather around a cozy fire.

One Architecture to Do Them All: Transformer: The AI architecture that can do it all.

The transformer architecture extended its reach to a variety of new domains.What happened: Originally developed for natural language processing, transformers are becoming the Swiss Army Knife of deep learning.
An illustration shows a cozy cabin where all the furniture is made out of coffee mugs.

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Standalone predictive performance of ACoR

Recognizing Autism: AI research can help identify autism early in children.

Classical machine learning techniques could help children with autism receive treatment earlier in life. Researchers led by Ishanu Chattopadhyay at University of Chicago developed a system that classified autism in young children based on data collected during routine checkups.
Animated charts show the results of a machine learning model that predicts the best depression drugs for a patient.

Which Drug Helps Your Depression?: AI System Matches Patients With the Right Depression Drug

Deep learning can predict how patients will respond to two antidepressant medicines.
An animation of a protein modeled by AlphaFold 2.

DeepMind Doubles Down on AlphaFold: DeepMind Launches Company to Commercialize AlphaFold 2

Isomorphic aims to build its business on AlphaFold 2, an ensemble of neural networks that finds the shapes of protein molecules.
Animation showing NarxCare, a system that analyzes databases that track drug prescriptions in the US

Fighting Addiction or Denying Care?: NarxCare Medical AI Denies Painkillers to Patients in Need

An epidemic of opioid abuse in the U.S. killed 93,000 people in 2020 alone. An algorithm intended to help doctors prescribe the drugs responsibly may be barring worthy patients from pain relief.
Different x-rays and CT scans displayed

AI Sees Race in X-Rays

Researchers from Emory University, MIT, Purdue University, and other institutions found that deep learning systems trained to interpret x-rays and CT scans also were able to identify their subjects as Asian, Black, or White.
Animation showing AlphaFold working

Biomedical Treasure Chest: DeepMind open sources AlphaFold and protein databases.

DeepMind opened access to AlphaFold, a model that finds the shapes of proteins, and to its output so far — a potential cornucopia for biomedical research. The research lab, a division of Google’s parent company Alphabet, made AlphaFold freely available.
Covid-19 over a graph

AI Against Covid Progress Report: A review of how AI was used to fight Covid-19.

A new report assessed how AI has helped address Covid-19 and where it has fallen short.
X-rays and charts about AI use in radiology

Radiologists Eye AI: Radiologists increasingly rely upon computer vision.

AI lately has achieved dazzling success interpreting X-rays and other medical imagery in the lab. Now it’s catching on in the clinic. Roughly one-third of U.S. radiologists use AI in some form in their work.
Protein structures

What AI Knows About Proteins: NLP systems can be used to code amino acids.

Transformer models trained on sequences of amino acids that form proteins have had success classifying and generating viable sequences. New research shows that they also capture information about protein structure.
Timeline for biomedical AI projects

Boosting Biomedicine: The NIH's Bridge2AI program will fund new health datasets.

The U.S. government aims to turbocharge biomedical AI research. The National Institutes of Health, which invests $41.7 billion annually in medical research, announced a program called Bridge to Artificial Intelligence (Bridge2AI) to promote machine learning in human biology and medicine.
CogView home website

Large Language Models for Chinese: A brief overview of the Wu Dao NLP models.

Researchers unveiled competition for the reigning large language model GPT-3. Four models collectively called Wu Dao were described by Beijing Academy of Artificial Intelligence, a research collective funded by the Chinese government, according to Synced Review.
Data related to a diagnostic advice received from a machine learning model vs a human expert

Would Your Doctor Take AI’s Advice?: Some doctors are skeptical of AI diagnoses.

Some doctors don’t trust a second opinion when it comes from an AI system. A team at MIT and Regensburg University investigated how physicians responded to diagnostic advice they received from a machine learning model versus a human expert.
Sequence showing a training step that uses different perspectives of the same patient to enhance unsupervised pretraining

Same Patient, Different Views: Contrastive pretraining improves medical imaging AI.

When you lack labeled training data, pretraining a model on unlabeled data can compensate. New research pretrained a model three times to boost performance on a medical imaging task.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox