homehome Home chatchat Notifications


This AI can tell which Instagram photos are edited

The future is here: it's AI versus the Gram.

Mihai Andrei
October 16, 2020 @ 8:48 pm

share Share

Image credits: Wang et al.

While the world is legitimately worried about deepfakes and other clever manipulations, one form of manipulation has been around for ages: Photoshop.

We all know that magazine photos are often cleverly edited, either with Photoshop or other image manipulation software. Most malicious manipulations, in general, use simple image editing tools. In a study published in e-print archive arXiv, a team of researchers has presented an AI algorithm capable of detecting image warping in human faces — probably the most common Instagram manipulation. The algorithm is also capable of predicting the location of edits and undoing the effect.

“Face warping is an interesting problem as it is a domain that is surprisingly hard for people to detect, but it is commonly used and has wide reaching implications,” researchers write in the study.

The topic is indeed popular — and not just among magazine stars. A search for “Image manipulation Instagram” on Google returns over 20 million results, and the hashtag #photomanipulation has over 1 million posts. Researchers also showed that humans are surprisingly bad at detecting this type of manipulation: in a case study presented in the paper, humans were correct in just 53.5% of the cases — just marginally better 50% than the flip of a coin.

This is where the new algorithm comes in. Not only can it detect when an image has been doctored, but it can also try to predict where exactly is it’s been edited.

Qualitative results on artist-created and auto-generated data, on two columns. (Input) Input manipulated image. (GT flow) The ”ground truth” optical flow from original to manipulated image. (Our prediction) The predicted flow of editing. (Flow overlay) Magnitude of
predicted flow overlaid.

So far, the algorithm only works with one type of warping manipulation, but researchers say it could be adapted to multiple types of manipulation — as it’s always the case with these machine learning algorithms, it’s all about how the algorithm is trained.

The application of the algorithm extends far beyond Instagram trickery. Image forensics, or forgery detection, is an increasingly important area of forensic research. But for now, you can use it to see which Instagram stars doctor their images.

A video depicting the detection technique.

The study has been published in arXiv.

share Share

AI thought X-rays are connected to eating refried beans or drinking beer

Instead of finding true medical insights, these algorithms sometimes rely on irrelevant factors — leading to misleading results.

AI is scheming to stay online — and then lying to humans

An alarming third party report almost looks like a prequel to Terminator.

The David Mayer case: ChatGPT refuses to say some names. We have an idea why

Who are David Mayer and Brian Hood?

The explosive secret behind the squirting cucumber is finally out

Scientists finally decode the secret mechanism that has been driving the peculiar seed dispersion action of squirting cucumber.

How CCTV Cameras and AI Can Prevent Floods in Cities

Researchers have developed an AI system using CCTV cameras to monitor culverts, potentially reducing urban flooding by detecting blockages in real-time.

Cars Are Unwittingly Killing Millions of Bees Every Day, Scientists Reveal

Apart from pollution, pesticides, and deforestation, cars are also now found to be killing bees in large numbers.

Could CAR-T Therapy Be the End of Lifelong Lupus Medication? Early Results Say 'Yes'

T-cells are real life saviors. If modified properly, they can save lupus patients from the trouble of taking medicines regularly.

Elon Musk’s social media posts have had a ‘sudden boost’ since July, new research reveals

Is the former Twitter platform now just used as a megaphone?

The world's first wooden satellite was launched into space

The satellite is made from magnolia wood, which was historically used for samurai sheaths.

Could Spraying Diamonds into the Sky Be the Key to Cooling the Planet?

Nothing is more precious than our planet, and we must cool it fast. Scientists say this can be done by decorating the sky with diamonds.