homehome Home chatchat Notifications


This algorithm lets you delete water from underwater photos

Underwater photography is spectacular enough. But what if we could make it even more amazing?

Mihai Andrei
December 19, 2019 @ 9:19 pm

share Share

Image credits: Derya Akkaynak.

Underwater photography is not just for Instagram feeds — they are very important for biologists who monitor underwater ecosystem such as coral reefs. Coral reefs are some of the most colorful and vibrant environments on Earth, but like all underwater photos, photos of coral reefs tend to come out tainted by hues of blue and green. This makes it more difficult for researchers to identify species and traits of species from images, and makes monitoring considerably more difficult.

Now, there’s a solution for that: it’s called Sea-Thru.

Engineer and oceanographer Derya Akkaynak and her postdoctoral adviser, engineer Tali Treibitz, spent four years working to develop and improve an algorithm that would essentially “remove” the water from underwater photography.

The way the light is absorbed and scattered in water causes photos to be dim and overtaken by blue tones. Sea-thru removes the color cast and backscatter, leaving behind a crisp and clear image.

Image credits: Derya Akkaynak.

The method relies on taking multiple images of the same thing, from slightly different angles factoring in the physics of light absorption. Then, the algorithm produces a model of the photo, reversing the effects caused by the scattering and absorption.

“The Sea-thru method estimates backscatter using the dark pixels and their known range information,” the researchers describe the method in a working paper. “Then, it uses an estimate of the spatially varying illuminant to obtain the range-dependent attenuation coefficient. Using more than 1,100 images from two optically different water bodies, which we make available, we show that our method with the revised model outperforms those using the atmospheric model. “

The downside of this is that it requires quite a lot of images, and therefore, large datasets. Thankfully, many scientists are already capturing images this way using a process called photogrammetry (a technique that uses photographs to make certain measurements). Sea-Thru will readily work with photogrammetry images, Akkaynak says, which already raises intriguing prospects.

Results on different processing methods. Image credits: Derya Akkaynak.

This method is not akin to image manipulation — it’s not photoshopping or image manipulation. The colors are not enhanced or modified, it’s a physical correction rather than a visually pleasing modification, says Akkaynak.

Although the algorithm was only recently announced, it’s already causing quite a stir due to its potential. Any tool that can help scientists better understand the oceans, particularly at this extremely delicate time, can’t come sooner enough.

“Sea-thru is a significant step towards opening up large underwater datasets to powerful computer vision and machine learning algorithms, and will help boost underwater research at a time when our oceans are increasing stress from pollution, overfishing, and climate change,” the researchers conclude.

share Share

If you use ChatGPT a lot, this study has some concerning findings for you

So, umm, AI is not your friend — literally.

Miyazaki Hates Your Ghibli-fied Photos and They're Probably a Copyright Breach Too

“I strongly feel that this is an insult to life itself,” he said.

Bad microphone? The people on your call probably think less of you

As it turns out, a bad microphone may be standing between you and your next job.

Sharks Aren’t Silent After All. This One Clicks Like a Castanet

This is the first evidence of sound production in a shark.

New NASA satellite mapped the oceans like never before

We know more about our Moon and Mars than the bottom of our oceans.

This AI Tool Can Scan Your Food and Tell You Exactly How Many Calories and Other Nutrients It Has

Knowing what's inside your food has never been so easy.

The Arctic Seafloor Is Full of Life — And We’re About to Destroy It

The Arctic Ocean is more than just icy waters, it harbors vibrant ecosystems — but it also harbors valuable oil, gas, and rare earth elements.

Venomous love: These male octopuses inject venom into females so they can escape being eaten

In the perilous world of cephalopod romance, male blue-lined octopuses have evolved a shocking strategy to survive mating.

There's a Great Whale Urine Highway That Moves Nutrients Across Oceans

Whales migrate great distances and, as they travel, create nutrient superhighways in our oceans.

This Small Deep-Sea Predator Hidden in the Atacama Trench is Darkness Personified

Hidden in the abyss of the Atacama Trench, Dulcibella camanchaca reveals itself as a unique predator adapted to the darkness.