homehome Home chatchat Notifications


This algorithm lets you delete water from underwater photos

Underwater photography is spectacular enough. But what if we could make it even more amazing?

Mihai Andrei
December 19, 2019 @ 9:19 pm

share Share

Image credits: Derya Akkaynak.

Underwater photography is not just for Instagram feeds — they are very important for biologists who monitor underwater ecosystem such as coral reefs. Coral reefs are some of the most colorful and vibrant environments on Earth, but like all underwater photos, photos of coral reefs tend to come out tainted by hues of blue and green. This makes it more difficult for researchers to identify species and traits of species from images, and makes monitoring considerably more difficult.

Now, there’s a solution for that: it’s called Sea-Thru.

Engineer and oceanographer Derya Akkaynak and her postdoctoral adviser, engineer Tali Treibitz, spent four years working to develop and improve an algorithm that would essentially “remove” the water from underwater photography.

The way the light is absorbed and scattered in water causes photos to be dim and overtaken by blue tones. Sea-thru removes the color cast and backscatter, leaving behind a crisp and clear image.

Image credits: Derya Akkaynak.

The method relies on taking multiple images of the same thing, from slightly different angles factoring in the physics of light absorption. Then, the algorithm produces a model of the photo, reversing the effects caused by the scattering and absorption.

“The Sea-thru method estimates backscatter using the dark pixels and their known range information,” the researchers describe the method in a working paper. “Then, it uses an estimate of the spatially varying illuminant to obtain the range-dependent attenuation coefficient. Using more than 1,100 images from two optically different water bodies, which we make available, we show that our method with the revised model outperforms those using the atmospheric model. “

The downside of this is that it requires quite a lot of images, and therefore, large datasets. Thankfully, many scientists are already capturing images this way using a process called photogrammetry (a technique that uses photographs to make certain measurements). Sea-Thru will readily work with photogrammetry images, Akkaynak says, which already raises intriguing prospects.

Results on different processing methods. Image credits: Derya Akkaynak.

This method is not akin to image manipulation — it’s not photoshopping or image manipulation. The colors are not enhanced or modified, it’s a physical correction rather than a visually pleasing modification, says Akkaynak.

Although the algorithm was only recently announced, it’s already causing quite a stir due to its potential. Any tool that can help scientists better understand the oceans, particularly at this extremely delicate time, can’t come sooner enough.

“Sea-thru is a significant step towards opening up large underwater datasets to powerful computer vision and machine learning algorithms, and will help boost underwater research at a time when our oceans are increasing stress from pollution, overfishing, and climate change,” the researchers conclude.

share Share

Scientists Quietly Developed a 6G Chip Capable of 100 Gbps Speeds

A single photonic chip for all future wireless communication.

Japan Is Starting to Use Robots in 7-Eleven Shops to Compensate for the Massive Shortage of Workers

These robots are taking over repetitive jobs and reducing workload as Japan combats a worker crisis.

A Massive Seaweed Belt Stretching from Africa to the Caribbean is Changing The Ocean

The Great Atlantic Sargassum Belt hit a record 37.5 million tons this May

Anthropic AI Wanted to Settle Pirated Books Case for $1.5 Billion. A Judge Thinks We Can Do Better

This case is quickly shaping up to be a landmark in AI history.

Orcas Are Attacking Boats Again and We Still Don't Know Why

It's one of the most curious behaviors we've ever observed.

Shark Teeth Are Supposed to be Nearly Indestructible but Climate Change is Starting to Corrode Them

Sharks could suffer from climate change in ways that people hadn't previously considered.

Are Cyborg Jellyfish the Next Step of Deep Ocean Exploration?

We still know very little about our oceans. Can jellyfish change that?

Dolphins and Whales Can Be Friends and Sometimes Hang Out Together

They have a club and you're not invited.

Scientists discover a giant virus in the Pacific with the longest tail ever recorded

The micron-long tail could reshape our understanding of marine viral life.

Anthropic says it's "vaccinating" its AI with evil data to make it less evil

The Black Mirror episodes are writing themselves now.