homehome Home chatchat Notifications


New algorithm turns low-resolution photos into detailed images -- CSI style

Zoom in on that license plate. Yes, I see it clearly now...

Mihai Andrei
November 6, 2017 @ 6:17 pm

share Share

You know that stereotypic scene from the CSI movies when they zoom in on a car they can barely see and then read the license plate clearly? Well, that bit of fiction might turn into reality, as computer scientists from the Max Planck Institute for Intelligent Systems in Tübingen have used artificial intelligence to create high-definition images from low-resolution photos.

EnhanceNet-PAT is capable of upsampling a low-resolution image (left) to a high definition version (middle). The result is indistinguishable from the original image (right). Credit: Max Planck Institute for Intelligent Systems.

It’s not the first time researchers have looked at something like this. The technology is called single-image super-resolution (SISR). SISR has been researched for decades, but without much success. No matter how you look at it, the problem was that they just didn’t have enough pixels to generate a sharp image.

Now, researchers developed a tool called EnhanceNet-PAT, which uses AI to generate new pixels and “fill” the image up.

“The task of super-resolution has been studied for decades,” Mehdi M.S. Sajjadi, one of the researchers on the project, told Digital Trends. “Before this work, even the state of the art has been producing very blurry images, especially at textured regions. The reason for this is that they asked their neural networks the impossible — to reconstruct the original image with pixel-perfect accuracy. Since this is impossible, the neural networks produce blurry results. We take a different approach [by instead asking] the neural network to produce realistic textures. To do this, the neural network takes a look at the whole image, detects regions, and uses this semantic information to produce realistic textures and sharper images.”

First, the neural network was fed a large data set of different images. It learned different textures and colors. Then, it was given downscaled images which it had to improve. The upscaled results were then compared to the initial photo, with the algorithm analyzing and learning from these differences. After a while, it did a good enough job without any human input.

Of course, this isn’t a magic fix and not all photos can be fixed (at least not yet), but results are exciting. As for the applications, there’s no shortage of those, Sajjadi says. The algorithm could be used to restore old family photos or give them a good enough resolution for larger prints; on a more pragmatic level, the technology could greatly help in object recognition, which has potential in detecting pedestrians and other objects in self-driving cars.

Journal Reference: Mehdi S. M. Sajjadi, Bernhard Schölkopf, Michael Hirsch. EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis.

share Share

A Simple Heat Hack Could Revolutionize How We Produce Yogurt

In principle, the method could be deployed tomorrow, researchers say.

Scientists Create a ‘Smart Sponge’ That Knows When to Heal and When to Fight Inflammation

This hydrogel could help millions of people lead a better life.

The Race to the Bottom: Japan Is Set to Start Testing Deep-Sea Mining

There's a big hidden cost to this practice.

Japan Just Smashed the Internet Speed World Record and It's Much Faster Than You Think

Researchers transmitted 127,500 GB every second — over the distance from Chicago to Dallas.

Can You Tell Which Knot Is Strongest? Most People Fail This Surprisingly Tough Challenge

Knots are a test of physical intuition and most of us are failing hard.

Scientists Call for a Global Pause on Creating “Mirror Life” Before It’s Too Late: “The threat we’re talking about is unprecedented”

Creating synthetic lifeforms is almost here, and the consequences could be devastating.

For the First Time Ever We Can See Planets Starting to Form Around a Star

JWST and ALMA peered through a natural opening in the star’s surrounding cloud to catch the action up close.

There might be an anti-aging secret hiding in magic mushrooms

Psilocybin extends cell life, and preserves aging DNA structures.

Not Just Hunters: Wooden Tools Unearth the Sophisticated, Plant-Eating World of Early Humans

What if the Stone Age wasn't really about stone?

This is How Exercise Supercharges the Immune System Against Cancer

Exercise reshapes gut bacteria to supercharge immune response against tumors.