Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration

被引:61
|
作者
Sharma, Prasen [1 ]
Bisht, Ira [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Dept Comp Sci & Engn, Multimedia Lab, Gauhati, Assam, India
关键词
Image restoration; underwater vision; enhancement; super-resolution; deep learning; ENHANCEMENT;
D O I
10.1145/3511021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Background: Underwater images, in general, suffer from low contrast and high color distortions due to the non-uniform attenuation of the light as it propagates through the water. In addition, the degree of attenuation varies with the wavelength, resulting in the asymmetric traversing of colors. Despite the prolific works for underwater image restoration (UIR) using deep learning, the above asymmetricity has not been addressed in the respective network engineering. Contributions: As the first novelty, this article shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain for the task of UIR. Further, it is important to suppress the irrelevant multi-contextual features and increase the representational power of the model. Therefore, as a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions. An extensive set of experiments have been carried out to show the efficacy of the proposed scheme over existing best-published literature on benchmark datasets. More importantly, we have demonstrated a comprehensive validation of enhanced images across various high-level vision tasks, e.g., underwater image semantic segmentation and diver's 2D pose estimation. A sample video to exhibit our real-world performance is available at https://tinyurl.com/yzcrup9n. Also, we have open-sourced our framework at https://github.com/pksvision/Deep-WaveNet-UnderwaterImage- Restoration.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Multi-scale convolution underwater image restoration network
    Tang, Zhijie
    Li, Jianda
    Huang, Jingke
    Wang, Zhanhua
    Luo, Zhihang
    MACHINE VISION AND APPLICATIONS, 2022, 33 (06)
  • [42] Single Underwater Image Restoration Based on Depth Estimation and Transmission Compensation
    Chang, Herng-Hua
    Cheng, Chia-Yang
    Sung, Chia-Chi
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2019, 44 (04) : 1130 - 1149
  • [43] Underwater Image Enhancement and Attenuation Restoration Based on Depth and Backscatter Estimation
    Hsieh, Yi-Zeng
    Chang, Ming-Ching
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2025, 11 : 321 - 332
  • [44] An underwater image restoration based on global polarization effects of underwater scene
    Li, Yafeng
    Ruan, Rui
    Mi, Zetian
    Shen, Xin
    Gao, Tianzhu
    Fu, Xianping
    OPTICS AND LASERS IN ENGINEERING, 2023, 165
  • [45] Underwater image restoration based on second-order statistical characteristics
    Wang, Rui
    Shen, Kuo
    Wang, Guoyu
    Ji, Tingting
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (04)
  • [46] Restoration of Underwater Distorted Image Sequence Based on Generative Adversarial Network
    He, Changxin
    Zhang, Zhen
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 866 - 870
  • [47] Image Restoration Technology Based on Discrete Neural network
    Zhou, Duoying
    2015 INTERNATIONAL CONFERENCE ON ENERGY, MATERIALS AND MANUFACTURING ENGINEERING (EMME 2015), 2015, 25
  • [48] A Global Self-Attention Memristive Neural Network for Image Restoration
    Zhang, Wenhao
    Xiao, He
    Xie, Dirui
    Zhou, Yue
    Duan, Shukai
    Hu, Xiaofang
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (03): : 2613 - 2624
  • [49] Deep neural network based image annotation
    Zhu, Songhao
    Shi, Zhe
    Sun, Chengjian
    Shen, Shuhan
    PATTERN RECOGNITION LETTERS, 2015, 65 : 103 - 108
  • [50] Asymmetric Loss Based on Image Properties for Deep Learning-Based Image Restoration
    Zhu, Linlin
    Han, Yu
    Xi, Xiaoqi
    Zhang, Zhicun
    Liu, Mengnan
    Li, Lei
    Tan, Siyu
    Yan, Bin
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (03): : 3367 - 3386