A new camera app uses a generative adversarial network to let users look like they’re dressed for success while they videoconference in their jammies.

What’s new: Xpression is an iPhone app that maps facial expressions onto still images in real time, allowing users to stream live video selfies clothed in digital costumes.

How it works: The app uses three deep learning models, a spokesperson for app maker EmbodyMe told The Batch.

The first model estimates three-dimensional face shapes and expressions from the source video. The second does the same with the target image, whether it be a work of art, an anime character, or a selfie dressed for success. Then a generative adversarial network (GAN) maps the source frames to the target.
The software works with video platforms including Zoom, Twitch, Microsoft Teams, and Google Meet. It can also be used to make YouTube videos.
The app is available to iOS users as a beta version here.

Behind the news: Computer vision networks aren’t the only models helping socially distanced workers stay productive and presentable.

Otter.ai uses natural language processing to provide real-time captions and translations for Zoom meetings.
Microsoft Teams’ AI-powered noise suppression feature mutes crinkling snack wrappers, clacking keyboards, and other distracting desktop din.

Why it matters: No more judgement for our rumpled work-from-home looks and untidy bedrooms!

We’re thinking: Apps like these are a lot of fun, and we’re excited to see how they will develop. But they also take us one step further into a world where it is increasingly hard to determine what, and who, is real. Society needs better and more consistent standards for labelling digital fakery.

Otter.ai

GAN Makes Pajamas Safe For Work

Subscribe to The Batch