homehome Home chatchat Notifications


Machine learning corrects photos taken in complete darkness, turns them into amazingly sharp images

Who needs Photoshop when you got this?

Tibi Puiu
May 11, 2018 @ 4:47 pm

share Share

We’ve all tried to fix poorly lit pictures in Photoshop, but the results always end up unsatisfactory. You can’t polish a turd, they say. Researchers at the University of Illinois at Urbana–Champaign would beg to differ, however. In a new study, the researchers demonstrated a novel machine learning algorithm that corrects photos taken in complete darkness, with astonishing results.

In order to take decent photos in low-lighting conditions, professionals advise that you set a longer exposure and use a tripod to eliminate blur. You can also increase the camera’s sensor sensitivity, at the cost of introducing noise, which is what makes the photos grainy and ugly.

The new algorithm, however, is capable of turning even pitch black photos into impressively sharp images. They’re not the best, but given the starting conditions, the results are miles away from anything we’ve seen any post-production software do before.

The researchers first trained their neural network with a dataset of 5,094 dark, short-exposure images and an equal number of long-exposure images of the same scene. This taught the algorithm what the scene ought to look like with proper lighting and exposure.

“The network operates directly on raw sensor data and replaces much of the traditional image processing pipeline, which tends to perform poorly on such data. We report promising results on the new dataset, analyze factors that affect performance, and highlight opportunities for future work,” the researchers wrote.

Some of the photos used to train the algorithm were taken by an iPhone 6, which means that someday similar technology could be integrated into smartphones. In this day and age, the software can matter just as much as the hardware, if not more, when it comes to snapping quality pictures. Think motion stabilization, lighting correction, and all the gimmicks employed by the cheap camera in your phone, in the absence of which photos would look abhorrent.

Who else is looking forward to using this new technology? Leave your comment below.

The study titled ‘Learning to See in the Dark‘ was published in the pre-print server Arxiv. 

share Share

This 5,500-year-old Kish tablet is the oldest written document

Beer, goats, and grains: here's what the oldest document reveals.

A Huge, Lazy Black Hole Is Redefining the Early Universe

Astronomers using the James Webb Space Telescope have discovered a massive, dormant black hole from just 800 million years after the Big Bang.

Did Columbus Bring Syphilis to Europe? Ancient DNA Suggests So

A new study pinpoints the origin of the STD to South America.

The Magnetic North Pole Has Shifted Again. Here’s Why It Matters

The magnetic North pole is now closer to Siberia than it is to Canada, and scientists aren't sure why.

For better or worse, machine learning is shaping biology research

Machine learning tools can increase the pace of biology research and open the door to new research questions, but the benefits don’t come without risks.

This Babylonian Student's 4,000-Year-Old Math Blunder Is Still Relatable Today

More than memorializing a math mistake, stone tablets show just how advanced the Babylonians were in their time.

Sixty Years Ago, We Nearly Wiped Out Bed Bugs. Then, They Started Changing

Driven to the brink of extinction, bed bugs adapted—and now pesticides are almost useless against them.

LG’s $60,000 Transparent TV Is So Luxe It’s Practically Invisible

This TV screen vanishes at the push of a button.

Couple Finds Giant Teeth in Backyard Belonging to 13,000-year-old Mastodon

A New York couple stumble upon an ancient mastodon fossil beneath their lawn.

Worms and Dogs Thrive in Chernobyl’s Radioactive Zone — and Scientists are Intrigued

In the Chernobyl Exclusion Zone, worms show no genetic damage despite living in highly radioactive soil, and free-ranging dogs persist despite contamination.