homehome Home chatchat Notifications


Adobe is using machine learning to help you spot Photoshopped pictures

Trust not your eyes.

Mihai Andrei
July 5, 2018 @ 10:22 pm

share Share

Adobe, the company known for giving us Photoshop, is trying to help you recognize what photos have been tampered with.

An illustration from Adobe’s new paper showing how edits in images can be spotted by a machine learning system. (via The Verge)

As we previously wrote, it’s becoming harder and harder to detect tampered images and videos from the real thing, and AI tools continue to make it more difficult. When you consider the ability of social media to spread these images like wildfire without even the slightest fact-checking, this becomes more than a nuisance — it becomes a real problem in society.

An early arms race

Many companies (including Adobe) are developing their own tools to make it easier and easier to manipulate the visual, but there’s also the other side: detecting what’s been manipulated. At the CVPR computer vision conference, Adobe demonstrated how this field, called digital forensics, can be automated quickly and efficiently. This type of approach could ultimately be incorporated into our daily lives to establish the authenticity of social media photos.

Although the research paper does not represent a breakthrough per se, it’s intriguing to see Adobe plunging into this field.

They work on three types of manipulation:

  • splicing, where two different images are combined
  • cloning, where objects are copied and pasted
  • removal, where an object is edited out altogether

When researchers or digital workers try to assess the validity of images, they look for artifacts left behind by editing. For instance, when an object is copied from an image and pasted onto another, the background noise level of the two is often inconsistent. Adobe used an already established approach — taking a large dataset of images and “training” an algorithm — to detect tampering.

The new algorithm scored higher than other existing tools, but only marginally so. Furthermore, the tool has no application in so-called “deep fakes” — images and videos entirely created by AI. The algorithm is also only as good as the database it’s fed. For now, it’s still an early stage program.

It’s not hard to see this turning into an arms race of sorts. As detection algorithms improve, we might see more tools that better hide these manipulations. For now, we should all keep in mind just how easy it is to manipulate an image before we share it on Facebook. It’s becoming clearer that in much of today’s media, we’re already in an arms race between truth and lies. There’s a good chance this type of algorithm could play an important role in the future.

share Share

Tennis May Add Nearly 10 Years to Your Life and Most People Are Ignoring It

Could a weekly match on the court be the secret to a longer, healthier life?

Humans Have Been Reshaping Earth with Fire for at Least 50,000 Years

Fossil charcoal reveals early humans’ growing impact on the carbon cycle before the Ice Age.

The Strangest Microbe Ever Found Straddles The Line Between Life and Non-Life

A newly discovered archaeon blurs the boundary between cells and viruses.

This $8750 Watch Was Designed for Space and Could Finally Replace Apollo-era Omega Watches

An audacious new timepiece dares to outshine Omega’s legacy in space

The Brain May Make New Neurons in Adulthood and Even Old Age

Researchers identify the birthplace of new brain cells well into late adulthood.

Your gut has a secret weapon against 'forever chemicals': microbes

Our bodies have some surprising allies sometimes.

High IQ People Are Strikingly Better at Forecasting the Future

New study shows intelligence shapes our ability to forecast life events accurately.

Cheese Before Bed Might Actually Be Giving You Nightmares

Eating dairy or sweets late at night may fuel disturbing dreams, new study finds.

Scientists Ranked the Most Hydrating Drinks and Water Didn't Win

Milk is more hydrating than water. Here's why.

Methane Leaks from Fossil Fuels Hit Record Highs. And We're Still Looking the Other Way

Powerful leaks, patchy action, and untapped fixes keep methane near record highs in 2024.