Investigating intrinsic degradation factors by multi-branch aggregation for real-world underwater image enhancement

被引:35
作者
Xue, Xinwei [1 ,3 ]
Li, Zexuan [2 ]
Ma, Long [2 ]
Jia, Qi [1 ,3 ]
Liu, Risheng [1 ,3 ]
Fan, Xin [1 ,3 ]
机构
[1] Dalian Univ Technol, RU Int Sch Informat Sci & Engn, DUT, Dalian, Liaoning, Peoples R China
[2] Dalian Univ Technol, Sch Software Technol, Dalian, Liaoning, Peoples R China
[3] Dalian Univ Technol, Engn & Key Lab Ubiquitous Network & Serv Software, Dalian, Peoples R China
基金
国家重点研发计划;
关键词
Underwater image enhancement; Multi -branch learning; Real -world underwater images; Comprehensive evaluation;
D O I
10.1016/j.patcog.2022.109041
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, improving the visual quality of underwater images has received extensive attentions in both computer vision and ocean engineering fields. However, existing works mostly focus on directly learning clear images from degraded observations but without careful investigations on the intrinsic degradation factors, thus require mass training data and lack generalization ability. In this work, we propose a new method, named Multi-Branch Aggregation Network (termed as MBANet) to partially address the above issue. Specifically, by analyzing underwater degradation factors from the perspective of both color dis-tortions and veil effects, MBANet first constructs a multi-branch multi-variable architecture to obtain one intermediate coarse result and two degraded factors. We then establish a physical model inspired process to fully utilize our estimated degraded factors and thus obtain the desired clear output images. A series of evaluations on multiple datasets show the superiority of our method against existing state-of-the-art approaches, both in execution speed and accuracy. Furthermore, we demonstrate that our MBANet can significantly improve the performance of salience object detection in the underwater environment.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 53 条
[1]   Sea-thru: A Method For Removing Water From Underwater Images [J].
Akkaynak, Derya ;
Treibitz, Tali .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1682-1691
[2]   A Revised Underwater Image Formation Model [J].
Akkaynak, Derya ;
Treibitz, Tali .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6723-6732
[3]   Color Balance and Fusion for Underwater Image Enhancement [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bekaert, Philippe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :379-393
[4]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[5]   SWIPENET: Object detection in noisy underwater scenes [J].
Chen, Long ;
Zhou, Feixiang ;
Wang, Shengke ;
Dong, Junyu ;
Li, Ning ;
Ma, Haiping ;
Wang, Xin ;
Zhou, Huiyu .
PATTERN RECOGNITION, 2022, 132
[6]   Color Channel Compensation (3C): A Fundamental Pre-Processing Step for Image Enhancement [J].
Codruta, Ancuti O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Sbert, Mateu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :2653-2665
[7]   Color Correction Preprocessing for Multiview Video Coding [J].
Doutre, Colin ;
Nasiopoulos, Panos .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2009, 19 (09) :1400-1405
[8]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[9]   Deep Underwater Image Restoration and Beyond [J].
Dudhane, Akshay ;
Hambarde, Praful ;
Patil, Prashant ;
Murala, Subrahmanyam .
IEEE SIGNAL PROCESSING LETTERS, 2020, 27 :675-679
[10]  
Fabbri C, 2018, IEEE INT CONF ROBOT, P7159