See our underwater image reconstruction contributions in the news
Based on the developments in the lab we established SeaErra-Vision, developing intelligent vision solutions for the underwater world.
Underwater images suffer from color distortion and low contrast, because light is attenuated while it propagates through water. Attenuation underwater varies with wavelength, unlike terrestrial images where attenuation is assumed to be spectrally uniform. The current underwater image formation model descends from atmospheric dehazing equations where attenuation is a weak function of wavelength. We showed that this model introduces significant errors and dependencies in the estimation of the direct transmission signal. We proposed a revised equation for underwater image formation.
The revised physically accurate model showed:
-
the attenuation coefficient of the signal is not uniform across the scene but depends on object range and reflectance
-
the coefficient governing the increase in backscatter with distance differs from the signal attenuation coefficient.
More recently, we developed Sea-thru, an algorithm that recovers color with our revised model using RGBD images. The Sea-thru method estimates backscatter using the dark pixels and their known range information. Then, it uses an estimate of the spatially varying illuminant to obtain the range-dependent attenuation coefficient.
We also address the problem of underwater single-image color restoration using haze-lines. The attenuation depends both on the water body and the 3D structure of the scene, making color restoration difficult. By estimating just two additional global parameters: the attenuation ratios of the blue-red and blue-green color channels, the problem is reduced to single image dehazing, where all color channels have the same attenuation coefficients.
Also, we aim to constrain the set of physically-feasible wideband attenuation coefficients in the ocean by utilizing water attenuation measured worldwide by oceanographers. We calculate the space of valid wideband effective attenuation coefficients in the 3D RGB domain and find that a bound manifold in 3-space sufficiently represents the variation from the clearest to murkiest waters. Finally, we suggest a method for estimating the medium properties (both attenuation and scattering) using only images of backscattered light from the system’s light sources.
Code & Datasets
SQUID: STEREO QUANTITATIVE UNDERWATER IMAGE DATASET
The database contains 57 stereo pairs from four different sites in Israel, two in the Red Sea (representing tropical water) and two in the Mediterranean Sea (temperate water). The dataset includes RAW images, TIF files, camera clibration files, and distance maps.
SQUID: SOURCE CODE UNDERWATER COLOR RESTORATION
This is a revised implementation of the color restoration method described in: Diving into Haze-Lines: Color Restoration of Underwater Images. Berman, D. and Treibitz T. and Avidan S., BMVC 2017.