DMML: Deep Multi-Prior and Multi-Discriminator Learning for Underwater Image Enhancement

被引:12
作者
Esmaeilzehi, Alireza [1 ]
Ou, Yang [2 ,3 ]
Ahmad, M. Omair [4 ]
Swamy, M. N. S. [4 ]
机构
[1] Univ Toronto, Edward S Rogers Sr Dept Elect & Comp Engn, Toronto M5S 3G8, ON, Canada
[2] Concordia Univ, Dept Elect & Comp Engn, Montreal, PQ H3G 1M8, Canada
[3] Chengdu Univ, Sch Mech Engn, Chengdu 610106, Peoples R China
[4] Concordia Univ, Dept Elect & Comp Engn, Montreal H3G 1M8, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Image enhancement; Training; Visualization; Image color analysis; Task analysis; Image restoration; Measurement; Deep learning; underwater image restoration and enhancement; multi-prior image processing; adversarial learning; QUALITY ASSESSMENT;
D O I
10.1109/TBC.2024.3349773
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Enhancing the quality of the images acquired under the water environments is crucial in many broadcast technologies. As the richness of the features generated by deep underwater image enhancement networks improves, the visual signals with higher qualities can be yielded. In view of this, in this paper, we propose a new deep network for the task of underwater image enhancement, in which the network feature generation process is guided by the prior information obtained from various underwater medium transmission map and atmospheric light estimation methods. Further, in order to obtain high values for different image quality assessment metrics associated with the images produced by the proposed network, we introduce a multi-stage training process for our network. In the first stage, the proposed network is trained with the conventional supervised learning technique, whereas, in the second stage, the training process of the network is carried out by the adversarial learning technique. Finally, in the third stage, the training of the network obtained by the conventional supervised learning is continued by the guidance of the one trained by the adversarial learning technique. In the development of the adversarial learning-based stage of our network, we propose a novel multi-discriminator generative adversarial network, which is able to produce images with more realistic textures and structures. The proposed multi-discriminator generative adversarial network employs the discrimination process between the real and fake data in various underwater environment color spaces. The results of different experimentations show the effectiveness of the proposed scheme in restoring the high-quality images compared to the other state-of-the-art deep underwater image enhancement networks.
引用
收藏
页码:637 / 653
页数:17
相关论文
共 42 条
[1]   Sea-thru: A Method For Removing Water From Underwater Images [J].
Akkaynak, Derya ;
Treibitz, Tali .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1682-1691
[2]   Color Balance and Fusion for Underwater Image Enhancement [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bekaert, Philippe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :379-393
[3]   The Perception-Distortion Tradeoff [J].
Blau, Yochai ;
Michaeli, Tomer .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6228-6237
[4]  
Carlevaris-Bianco N., 2010, Proc. Oceans MTS/IEEE Seattle, P1, DOI DOI 10.1109/OCEANS.2010.5664428
[5]   Domain Adaptation for Underwater Image Enhancement via Content and Style Separation [J].
Chen, Yu-Wei ;
Pei, Soo-Chang .
IEEE ACCESS, 2022, 10 :90523-90534
[6]   RUIG: Realistic Underwater Image Generation Towards Restoration [J].
Desai, Chaitra ;
Tabib, Ramesh Ashok ;
Reddy, Sai Sudheer ;
Patil, Ujwala ;
Mudenagudi, Uma .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :2181-2189
[7]   Transmission Estimation in Underwater Single Images [J].
Drews-, P., Jr. ;
do Nascimento, E. ;
Moraes, F. ;
Botelho, S. ;
Campos, M. .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, :825-830
[8]   SRNMSM: A Deep Light-Weight Image Super Resolution Network Using Multi-Scale Spatial and Morphological Feature Generating Residual Blocks [J].
Esmaeilzehi, Alireza ;
Ahmad, M. Omair ;
Swamy, M. N. S. .
IEEE TRANSACTIONS ON BROADCASTING, 2022, 68 (01) :58-68
[9]   UPDResNN: A Deep Light-Weight Image Upsampling and Deblurring Residual Neural Network [J].
Esmaeilzehi, Alireza ;
Ahmad, M. Omair ;
Swamy, M. N. S. .
IEEE TRANSACTIONS ON BROADCASTING, 2021, 67 (02) :538-548
[10]  
Fabbri C, 2018, IEEE INT CONF ROBOT, P7159