Underwater Image Quality Improvement via Color, Detail, and Contrast Restoration

被引:31
作者
Liang, Zheng [1 ]
Zhang, Weidong [2 ]
Ruan, Rui [1 ]
Zhuang, Peixian [3 ,4 ]
Xie, Xiwang [5 ]
Li, Chongyi [6 ]
机构
[1] Anhui Univ, Sch Internet, Hefei 230039, Peoples R China
[2] Henan Inst Sci & Technol, Sch Informat Engn, Xinxiang 453600, Peoples R China
[3] Univ Sci & Technol Beijing, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China
[4] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[5] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
[6] Nankai Univ, Sch Comp Sci, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater image restoration; color balance; linear saturation transformation; backscatter light removal;
D O I
10.1109/TCSVT.2023.3297524
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the complex imaging mechanism, underwater images often suffer from multiple degradation issues, such as color cast, blurry detail, and low contrast, which affect the extraction of valuable information. To deal with these degradation issues, a simple yet effective underwater image quality improvement method based on color, detail and contrast restoration (CDCR) is developed, which consists of three key modules: a well-preserved finding-driven color balance module (CBM), a linear saturation transformation-based discriminant function-based detail restoration module (DRM), and a transmission minimization-oriented contrast restoration module (CRM). First, the CBM explores a well-preserved channel finding and employs a channel compensation strategy to balance the color differences among three color channels. Second, the DRM uses a piecewise underwater image saturation estimation strategy, which takes the various spectral properties of water into account and designs an additional linear saturation transformation-based discriminant function to prevent the transmission from being under-estimated. At last, the CRM estimates a global backscatter light based on transmission minimization and further improves the contrast by locally removing the backscatter light of the base layer. Our restored image is appealing in its natural color, fine details, and high contrast. Extensive experiments on three underwater image enhancement datasets show that our CDCR achieves better results than state-of-the-art methods, i.e., compared with the second-best method, the average PCQI and UIQM values of our method increase by 5.7% and 0.2%, and the average Blur and DFAD values of our method decrease by 8.0% and 5.3%. Meanwhile, experiments further suggest that the rate of new visible edges and the quality of contrast restoration of our CDCR at least increase by 7.7% and 51.2% in most tested sandstorm and foggy images, respectively, which demonstrates that our method has a good generalization capability for sandstorm and foggy image restoration.
引用
收藏
页码:1726 / 1742
页数:17
相关论文
共 9 条
[1]  
[Anonymous], 2004, J. Comput. Vis., V60, P91
[2]   Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging [J].
Choi, Lark Kwon ;
You, Jaehee ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) :3888-3901
[3]   Underwater scene prior inspired deep underwater image and video enhancement [J].
Li, Chongyi ;
Anwar, Saeed ;
Porikli, Fatih .
PATTERN RECOGNITION, 2020, 98
[4]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110
[5]   Single image dehazing via multi-scale gradient domain contrast enhancement [J].
Mi, Zetian ;
Zhou, Huan ;
Zheng, Yijun ;
Wang, Minghui .
IET IMAGE PROCESSING, 2016, 10 (03) :206-214
[6]   A Fast Image Dehazing Algorithm Using Morphological Reconstruction [J].
Salazar-Colores, Sebastian ;
Cabal-Yepez, Eduardo ;
Ramos-Arreguin, Juan M. ;
Botella, Guillermo ;
Ledesma-Carrillo, Luis M. ;
Ledesma, Sergio .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) :2357-2366
[7]   Saliency Detection via Graph-Based Manifold Ranking [J].
Yang, Chuan ;
Zhang, Lihe ;
Lu, Huchuan ;
Ruan, Xiang ;
Yang, Ming-Hsuan .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3166-3173
[8]   Single Image Dehazing Using Bounded Channel Difference Prior [J].
Zhao, Xuan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :727-735
[9]   A Novel Fast Single Image Dehazing Algorithm Based on Artificial Multiexposure Image Fusion [J].
Zhu, Zhiqin ;
Wei, Hongyan ;
Hu, Gang ;
Li, Yuanyuan ;
Qi, Guanqiu ;
Mazur, Neal .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70