homehome Home chatchat Notifications


This algorithm lets you delete water from underwater photos

Underwater photography is spectacular enough. But what if we could make it even more amazing?

Mihai Andrei
December 19, 2019 @ 9:19 pm

share Share

Image credits: Derya Akkaynak.

Underwater photography is not just for Instagram feeds — they are very important for biologists who monitor underwater ecosystem such as coral reefs. Coral reefs are some of the most colorful and vibrant environments on Earth, but like all underwater photos, photos of coral reefs tend to come out tainted by hues of blue and green. This makes it more difficult for researchers to identify species and traits of species from images, and makes monitoring considerably more difficult.

Now, there’s a solution for that: it’s called Sea-Thru.

Engineer and oceanographer Derya Akkaynak and her postdoctoral adviser, engineer Tali Treibitz, spent four years working to develop and improve an algorithm that would essentially “remove” the water from underwater photography.

The way the light is absorbed and scattered in water causes photos to be dim and overtaken by blue tones. Sea-thru removes the color cast and backscatter, leaving behind a crisp and clear image.

Image credits: Derya Akkaynak.

The method relies on taking multiple images of the same thing, from slightly different angles factoring in the physics of light absorption. Then, the algorithm produces a model of the photo, reversing the effects caused by the scattering and absorption.

“The Sea-thru method estimates backscatter using the dark pixels and their known range information,” the researchers describe the method in a working paper. “Then, it uses an estimate of the spatially varying illuminant to obtain the range-dependent attenuation coefficient. Using more than 1,100 images from two optically different water bodies, which we make available, we show that our method with the revised model outperforms those using the atmospheric model. “

The downside of this is that it requires quite a lot of images, and therefore, large datasets. Thankfully, many scientists are already capturing images this way using a process called photogrammetry (a technique that uses photographs to make certain measurements). Sea-Thru will readily work with photogrammetry images, Akkaynak says, which already raises intriguing prospects.

Results on different processing methods. Image credits: Derya Akkaynak.

This method is not akin to image manipulation — it’s not photoshopping or image manipulation. The colors are not enhanced or modified, it’s a physical correction rather than a visually pleasing modification, says Akkaynak.

Although the algorithm was only recently announced, it’s already causing quite a stir due to its potential. Any tool that can help scientists better understand the oceans, particularly at this extremely delicate time, can’t come sooner enough.

“Sea-thru is a significant step towards opening up large underwater datasets to powerful computer vision and machine learning algorithms, and will help boost underwater research at a time when our oceans are increasing stress from pollution, overfishing, and climate change,” the researchers conclude.

share Share

AI thought X-rays are connected to eating refried beans or drinking beer

Instead of finding true medical insights, these algorithms sometimes rely on irrelevant factors — leading to misleading results.

AI is scheming to stay online — and then lying to humans

An alarming third party report almost looks like a prequel to Terminator.

The David Mayer case: ChatGPT refuses to say some names. We have an idea why

Who are David Mayer and Brian Hood?

Killer whales target whale sharks in rarely seen hunting strategy

Orcas have been observed launching synchronized attacks hunting whale sharks for the first time.

How CCTV Cameras and AI Can Prevent Floods in Cities

Researchers have developed an AI system using CCTV cameras to monitor culverts, potentially reducing urban flooding by detecting blockages in real-time.

Elon Musk’s social media posts have had a ‘sudden boost’ since July, new research reveals

Is the former Twitter platform now just used as a megaphone?

The incredible fishes that wander oceans with a transparent head

They're some of the most unusual creatures in the ocean.

The world's first wooden satellite was launched into space

The satellite is made from magnolia wood, which was historically used for samurai sheaths.

Fast fashion company replaces models with AI and brags about it

The clothes they are "wearing" are real. But everything else is very, very fake.

AI could diagnose heart disease in dogs before it's too late

Heart murmurs often go undiagnosed in dogs. This new tool could help.