Recurrent Neural Networks

16 Posts

Illustration of a laughing robot
Recurrent Neural Networks

Toward Machines That LOL: Scientists Teach a Speech Recognition Robot to Laugh

Even if we manage to stop robots from taking over the world, they may still have the last laugh. Researchers at Kyoto University developed a series of neural networks that enable a robot engaged in spoken conversation to chortle along with its human interlocutor.
2 min read
Neural Networks: Find the Function
Recurrent Neural Networks

Neural Networks: Find the Function

Let’s get this out of the way: A brain is not a cluster of graphics processing units, and if it were, it would run software far more complex than the typical artificial neural network. Yet neural networks were inspired by the brain’s architecture:
3 min read
Animated graphics from Google demonstrate Project Relate, a tool for recognizing impaired speech. .
Recurrent Neural Networks

Everyone Has a Voice: Project Relate Offers Synthesized Speech that Works in Real Time

An Android app offers speech recognition model for speech impaired by cerebral palsy, Down syndrome, Parkinson’s disease, stroke, or traumatic brain injury.
2 min read
Animated charts showing how AI can learn from simple tasks to harder versions of the same task
Recurrent Neural Networks

More Thinking Solves Harder Problems: AI Can Learn From Simple Tasks to Solve Hard Problems

In machine learning, an easy task and a more difficult version of the same task — say, a maze that covers a smaller or larger area — often are learned separately.
2 min read
Animated video showing a system to interpret electrical impulses from the brain as words
Recurrent Neural Networks

Listening to the Brain

Neural networks translated a paralyzed man’s brainwaves into conversational phrases. Researchers trained a system to interpret electrical impulses from the brain of a man who had lost the ability to speak 15 years ago, and displayed them as words on a video screen.
1 min read
Diagram showing how Project Debater works
Recurrent Neural Networks

Up for Debate

IBM’s Watson question-answering system stunned the world in 2011 when it bested human champions of the TV trivia game show Jeopardy! Although the Watson brand has fallen on hard times, the company’s language-processing prowess continues to develop.
2 min read
Graphs and data related to recurrent neural nets (RNNs)
Recurrent Neural Networks

Performance Guaranteed

Bayes-optimal algorithms always make the best decisions given their training and input, if certain assumptions hold true. New work shows that some neural networks can approach this kind of performance.
2 min read
Graphs and data related to transformer networks
Recurrent Neural Networks

The Transformation Continues

Transformer networks are gaining popularity as a high-accuracy alternative to recurrent neural networks. But they can run slowly when they’re applied to long sequences.
2 min read
Brains and neural signals reading
Recurrent Neural Networks

Listening to the Brain

AI has added an unlikely language to its catalog of translation capabilities: brain waves. Joseph Makin led a group from the University of California San Francisco to render a person’s neural signals as English text while the person while the person read a sentence aloud.
2 min read
Information related to machine learning
Recurrent Neural Networks

(Science) Community Outreach

Are your scientist friends intimidated by machine learning? They might be inspired by a primer from one of the world’s premier tech titans. Former Google CEO Eric Schmidt and Cornell PhD candidate Maithra Raghu school scientists in machine learning in a sprawling overview.
1 min read
Conference on Microsoft Teams with a person eating a chip bag
Recurrent Neural Networks

Silent Snacking

As working from home becomes the new normal, AI may protect you from the sound of coworkers munching while they chat. No more smacking lips and rustling chip bags! Microsoft’s online collaboration platform Teams announced a feature that removes extraneous sounds from videoconferences.
1 min read
Single Headed Attention RNN (SHA-RNN)
Recurrent Neural Networks

Language Modeling on One GPU

The latest large, pretrained language models rely on trendy layers based on transformer networks. New research shows that these newfangled layers may not be necessary.
2 min read
Illustration of a crystal snowball
Recurrent Neural Networks

Simulation Substitutes for Data

The future of machine learning may depend less on amassing ground-truth data than simulating the environment in which a model will operate. Deep learning works like magic with enough high-quality data. When examples are scarce, though, researchers are using simulation to fill the gap.
1 min read
Information related to Implicit Reinforcement without Interaction at Scale (IRIS)
Recurrent Neural Networks

Different Skills From Different Demos

Reinforcement learning trains models by trial and error. In batch reinforcement learning (BRL), models learn by observing many demonstrations by a variety of actors. But what if one doctor is handier with a scalpel while another excels at suturing?
2 min read
Booksby.ai book covers created by AI
Recurrent Neural Networks

Who’s Minding the Store?

Amazon, watch your back. There’s a new player in the book business and, unlike Jeff Bezos, it doesn’t need eight hours of sleep a night. The online bookstore Booksby.ai is run entirely by AI. Neural networks write the books, create the cover art, price the merchandise, even write the reviews.
1 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox