Underwater Image Enhancement Using Deep Transfer Learning Based on a Color Restoration Model

被引:22
作者
Zhang, Yunfeng [1 ]
Jiang, Qun [1 ]
Liu, Peide [2 ]
Gao, Shanshan [1 ]
Pan, Xiao [1 ,3 ]
Zhang, Caiming [4 ]
机构
[1] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan 250014, Peoples R China
[2] Shandong Univ Finance & Econ, Inst Marine Econ & Management, Sch Management Sci & Engn, Jinan 250014, Peoples R China
[3] Shandong Univ Finance & Econ, Shandong Res Ctr, China US Digital Media Int Cooperat, Jinan 250014, Peoples R China
[4] Shandong Univ, Sch Comp Sci & Technol, Jinan 250100, Peoples R China
关键词
Image color analysis; Image restoration; Image enhancement; Degradation; Cameras; Adaptation models; Attenuation; Coarse granularity similarity; physical model; transfer learning; underwater image enhancement;
D O I
10.1109/JOE.2022.3227393
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In ocean engineering, an underwater vehicle is widely used as an important equipment to explore the ocean. However, due to the reflection and attenuation of light when propagating in water, the images captured by the visual system of an underwater vehicle in the complex underwater environment usually suffer from low visibility, blurred details, and color distortion. To solve this problem, in this article, we present an underwater image enhancement framework based on transfer learning, which consists of a domain transformation module and an image enhancement module. The two modules, respectively, perform color correction and image enhancement, effectively transferring in-air image dehazing to underwater image enhancement. To maintain the physical properties of an underwater image, we embed the physical model into the domain transformation module which ensures that the transformed image complies with the physical model. To effectively remove the color deviation, a coarse-grained similarity calculation is added to the domain transformation module to improve the model performance. The experimental results on real-world underwater images of different scenes show that the presented method is superior to some advanced underwater image enhancement algorithms both qualitatively and quantitatively. Furthermore, we conduct ablation experiments to indicate the contribution of each component and further validate the effectiveness of the presented method through application tests.
引用
收藏
页码:489 / 514
页数:26
相关论文
共 70 条
[1]   Sea-thru: A Method For Removing Water From Underwater Images [J].
Akkaynak, Derya ;
Treibitz, Tali .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1682-1691
[2]   A Revised Underwater Image Formation Model [J].
Akkaynak, Derya ;
Treibitz, Tali .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6723-6732
[3]   I-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Indoor Images [J].
Ancuti, Cosmin ;
Ancuti, Codruta O. ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2018, 2018, 11182 :620-631
[4]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[5]  
[Anonymous], 2013, ICML WORKSH CHALL RE
[6]   Diving deeper into underwater image enhancement: A survey [J].
Anwar, Saeed ;
Li, Chongyi .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 89
[7]   SPECTRAL DEPENDENCE OF THE DIFFUSE ATTENUATION COEFFICIENT OF LIGHT IN OCEAN WATERS [J].
AUSTIN, RW ;
PETZOLD, TJ .
OPTICAL ENGINEERING, 1986, 25 (03) :471-479
[8]  
Berman D., 2017, PROC BRIT MACHINE VI, V1
[9]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[10]   Integrating structured biological data by Kernel Maximum Mean Discrepancy [J].
Borgwardt, Karsten M. ;
Gretton, Arthur ;
Rasch, Malte J. ;
Kriegel, Hans-Peter ;
Schoelkopf, Bernhard ;
Smola, Alex J. .
BIOINFORMATICS, 2006, 22 (14) :E49-E57