Underwater Image Enhancement Using Deep Transfer Learning Based on a Color Restoration Model

被引:22
作者
Zhang, Yunfeng [1 ]
Jiang, Qun [1 ]
Liu, Peide [2 ]
Gao, Shanshan [1 ]
Pan, Xiao [1 ,3 ]
Zhang, Caiming [4 ]
机构
[1] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan 250014, Peoples R China
[2] Shandong Univ Finance & Econ, Inst Marine Econ & Management, Sch Management Sci & Engn, Jinan 250014, Peoples R China
[3] Shandong Univ Finance & Econ, Shandong Res Ctr, China US Digital Media Int Cooperat, Jinan 250014, Peoples R China
[4] Shandong Univ, Sch Comp Sci & Technol, Jinan 250100, Peoples R China
关键词
Image color analysis; Image restoration; Image enhancement; Degradation; Cameras; Adaptation models; Attenuation; Coarse granularity similarity; physical model; transfer learning; underwater image enhancement;
D O I
10.1109/JOE.2022.3227393
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In ocean engineering, an underwater vehicle is widely used as an important equipment to explore the ocean. However, due to the reflection and attenuation of light when propagating in water, the images captured by the visual system of an underwater vehicle in the complex underwater environment usually suffer from low visibility, blurred details, and color distortion. To solve this problem, in this article, we present an underwater image enhancement framework based on transfer learning, which consists of a domain transformation module and an image enhancement module. The two modules, respectively, perform color correction and image enhancement, effectively transferring in-air image dehazing to underwater image enhancement. To maintain the physical properties of an underwater image, we embed the physical model into the domain transformation module which ensures that the transformed image complies with the physical model. To effectively remove the color deviation, a coarse-grained similarity calculation is added to the domain transformation module to improve the model performance. The experimental results on real-world underwater images of different scenes show that the presented method is superior to some advanced underwater image enhancement algorithms both qualitatively and quantitatively. Furthermore, we conduct ablation experiments to indicate the contribution of each component and further validate the effectiveness of the presented method through application tests.
引用
收藏
页码:489 / 514
页数:26
相关论文
共 70 条
[51]   Human-Visual-System-Inspired Underwater Image Quality Measures [J].
Panetta, Karen ;
Gao, Chen ;
Agaian, Sos .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2016, 41 (03) :541-551
[52]   Underwater Image Restoration Based on Image Blurriness and Light [J].
Peng, Yan-Tsung ;
Cosman, Pamela C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) :1579-1594
[53]  
Redmon J, 2018, Arxiv, DOI arXiv:1804.02767
[54]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[55]   Recovery of underwater visibility and structure by polarization analysis [J].
Schechner, YY ;
Karpel, N .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2005, 30 (03) :570-587
[56]   Domain Adaptation for Image Dehazing [J].
Shao, Yuanjie ;
Li, Lerenhan ;
Ren, Wenqi ;
Gao, Changxin ;
Sang, Nong .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2805-2814
[57]   Estimation of Ambient Light and Transmission Map with Common Convolutional Architecture [J].
Shin, Young-Sik ;
Cho, Younggun ;
Pandey, Gaurav ;
Kim, Ayoung .
OCEANS 2016 MTS/IEEE MONTEREY, 2016,
[58]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[59]  
Takeuchi I, 2006, J MACH LEARN RES, V7, P1231
[60]   Self-tuning underwater image restoration [J].
Trucco, Emanuele ;
Olmos-Antillon, Adriana T. .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2006, 31 (02) :511-519