homehome Home chatchat Notifications


Take yourself out (of any video stream) with this new app

So far, the app is more entertainment than a practical tool, but it is a very nice proof of concept.

Alexandru Micu
February 27, 2020 @ 5:31 pm

share Share

Ever felt like you’d just want to disappear? Jason Mayes, a senior developer advocate at Google, made it so you can — on video, at least.

Image via Youtube / Jason Mayes.

Mayes has developed an app he calls ‘Disappearing People,’ which can remove individuals from video streams in real-time. While it’s not perfect yet, with one example Mayes posted online still showing some pixelation and other flaws, it’s definitely workable. The app was built using Javascript and TensorFlow, a comprehensive library of free tools and resources for machine learning, and Mayes made the code freely available.

Camblock

The app works by first recording a series of images through a user’s webcam, which it uses to establish a baseline of their empty room. Once someone enters the room, the app recognizes them as being a human and erases their pixels out of the video. The gaps are then filled in with pixels from the baseline images of the room to create a seamless video.

In the sample video Mayes uploaded to Youtube, you can see him moving around the room (raw footage on the top part of the video) but not registering on the stream (bottom part of the video). There are a few seconds when his lower arms become visible, the app doesn’t remove his shadow on the wall to the left of the shot, and there are a few other glitches as well, but overall, it was a very fine performance.

You can also try the app for yourself here, and the code can be accessed here.

So far, the app is more entertainment than a practical tool, but it is a very nice proof of concept. If you don’t like taping over your laptop’s camera lens but are nonetheless concerned about privacy, it might just be the app for you, though.

share Share

The World's Tiniest Pacemaker is Smaller Than a Grain of Rice. It's Injected with a Syringe and Works using Light

This new pacemaker is so small doctors could inject it directly into your heart.

Scientists Just Made Cement 17x Tougher — By Looking at Seashells

Cement is a carbon monster — but scientists are taking a cue from seashells to make it tougher, safer, and greener.

Three Secret Russian Satellites Moved Strangely in Orbit and Then Dropped an Unidentified Object

We may be witnessing a glimpse into space warfare.

Researchers Say They’ve Solved One of the Most Annoying Flaws in AI Art

A new method that could finally fix the bizarre distortions in AI-generated images when they're anything but square.

The small town in Germany where both the car and the bicycle were invented

In the quiet German town of Mannheim, two radical inventions—the bicycle and the automobile—took their first wobbly rides and forever changed how the world moves.

Scientists Created a Chymeric Mouse Using Billion-Year-Old Genes That Predate Animals

A mouse was born using prehistoric genes and the results could transform regenerative medicine.

Americans Will Spend 6.5 Billion Hours on Filing Taxes This Year and It’s Costing Them Big

The hidden cost of filing taxes is worse than you think.

Evolution just keeps creating the same deep-ocean mutation

Creatures at the bottom of the ocean evolve the same mutation — and carry the scars of human pollution

Underwater Tool Use: These Rainbow-Colored Fish Smash Shells With Rocks

Wrasse fish crack open shells with rocks in behavior once thought exclusive to mammals and birds.

This strange rock on Mars is forcing us to rethink the Red Planet’s history

A strange rock covered in tiny spheres may hold secrets to Mars’ watery — or fiery — past.