homehome Home chatchat Notifications


This AI can tell which Instagram photos are edited

The future is here: it's AI versus the Gram.

Mihai Andrei
October 16, 2020 @ 8:48 pm

share Share

Image credits: Wang et al.

While the world is legitimately worried about deepfakes and other clever manipulations, one form of manipulation has been around for ages: Photoshop.

We all know that magazine photos are often cleverly edited, either with Photoshop or other image manipulation software. Most malicious manipulations, in general, use simple image editing tools. In a study published in e-print archive arXiv, a team of researchers has presented an AI algorithm capable of detecting image warping in human faces — probably the most common Instagram manipulation. The algorithm is also capable of predicting the location of edits and undoing the effect.

“Face warping is an interesting problem as it is a domain that is surprisingly hard for people to detect, but it is commonly used and has wide reaching implications,” researchers write in the study.

The topic is indeed popular — and not just among magazine stars. A search for “Image manipulation Instagram” on Google returns over 20 million results, and the hashtag #photomanipulation has over 1 million posts. Researchers also showed that humans are surprisingly bad at detecting this type of manipulation: in a case study presented in the paper, humans were correct in just 53.5% of the cases — just marginally better 50% than the flip of a coin.

This is where the new algorithm comes in. Not only can it detect when an image has been doctored, but it can also try to predict where exactly is it’s been edited.

Qualitative results on artist-created and auto-generated data, on two columns. (Input) Input manipulated image. (GT flow) The ”ground truth” optical flow from original to manipulated image. (Our prediction) The predicted flow of editing. (Flow overlay) Magnitude of
predicted flow overlaid.

So far, the algorithm only works with one type of warping manipulation, but researchers say it could be adapted to multiple types of manipulation — as it’s always the case with these machine learning algorithms, it’s all about how the algorithm is trained.

The application of the algorithm extends far beyond Instagram trickery. Image forensics, or forgery detection, is an increasingly important area of forensic research. But for now, you can use it to see which Instagram stars doctor their images.

A video depicting the detection technique.

The study has been published in arXiv.

share Share

If you use ChatGPT a lot, this study has some concerning findings for you

So, umm, AI is not your friend — literally.

Miyazaki Hates Your Ghibli-fied Photos and They're Probably a Copyright Breach Too

“I strongly feel that this is an insult to life itself,” he said.

Bad microphone? The people on your call probably think less of you

As it turns out, a bad microphone may be standing between you and your next job.

Earth’s Longest Volcanic Ridge May Be an Underwater Moving Hotspot

Scientists uncover surprising evidence that the Kerguelen hotspot, responsible for the 5,000-kilometer-long Ninetyeast Ridge, exhibited significant motion.

Meta's new AI can read your mind and type your thoughts with startling accuracy

Look like Mr. Zuckerberg is secretly working on something that could work as an alternative to invasive brain chips.

New NASA satellite mapped the oceans like never before

We know more about our Moon and Mars than the bottom of our oceans.

This AI Tool Can Scan Your Food and Tell You Exactly How Many Calories and Other Nutrients It Has

Knowing what's inside your food has never been so easy.

Everything you tell Alexa will now go to Amazon and you can't opt out

Users could previously opt out of this feature. Now, that option's gone.

The Rise—and Reckoning—of the Software Developer

For years, software developers stood near the labor market, earning high five- or six-figure salaries and basking in the glow of a red-hot tech sector. Recruiters flooded their inboxes, companies fought bidding wars over talent, and ambitious startups promised stock options that could turn employees into millionaires. But something has shifted. The hiring frenzy of […]

Speedrunners Just Discovered a Strange Problem With Old SNES Consoles: They're Sounding Faster

An old hardware choice means that the music is speeding up with the passing years.