UDAformer: Underwater image enhancement based on dual attention transformer

被引:50
作者
Shen, Zhen [1 ]
Xu, Haiyong [1 ]
Luo, Ting [2 ]
Song, Yang [2 ]
He, Zhouyan [2 ]
机构
[1] Ningbo Univ, Sch Math & Stat, Ningbo 315211, Peoples R China
[2] Ningbo Univ, Coll Sci & Technol, Ningbo 315211, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2023年 / 111卷
关键词
Underwater image enhancement; Self -attention mechanism; Transformer;
D O I
10.1016/j.cag.2023.01.009
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Underwater images suffer from color casts and low contrast degraded due to wavelength-dependent light scatter and abortion of the underwater environment, which impacts the application of high-level computer vision tasks. Considering the characteristics of uneven degradation and loss of color channel of underwater images, a novel dual attention transformer-based underwater image en-hancement method, called UDAformer, is proposed. Specifically, Dual Attention Transformer Block (DATB) combining Channel Self-Attention Transformer (CSAT) with Pixel Self-Attention Transformer is proposed for efficient encoding and decoding of underwater image features. Then, the shifted window method for the pixel self-attention (SW-PSAT) is proposed to improve computational efficiency. Finally, the underwater images are recovered through the design of residual connections based on the underwater imaging model. Experimental results demonstrate the proposed UDAformer surpasses previous state-of-the-art methods, both qualitatively and quantitatively. The code is publicly available at: https://github.com/ShenZhen0502/UDAformer.(c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:77 / 88
页数:12
相关论文
共 49 条
[11]   A Survey on Vision Transformer [J].
Han, Kai ;
Wang, Yunhe ;
Chen, Hanting ;
Chen, Xinghao ;
Guo, Jianyuan ;
Liu, Zhenhua ;
Tang, Yehui ;
Xiao, An ;
Xu, Chunjing ;
Xu, Yixing ;
Yang, Zhaohui ;
Zhang, Yiman ;
Tao, Dacheng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) :87-110
[12]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[13]   Visual saliency detection via a recurrent residual convolutional neural network based on densely aggregated features [J].
Hua, Chunjian ;
Zou, Xintong ;
Ling, Yan ;
Chen, Ying .
COMPUTERS & GRAPHICS-UK, 2022, 104 :72-85
[14]   Shallow-Water Image Enhancement Using Relative Global Histogram Stretching Based on Adaptive Parameter Acquisition [J].
Huang, Dongmei ;
Wang, Yan ;
Song, Wei ;
Sequeira, Jean ;
Mavromatis, Sebastien .
MULTIMEDIA MODELING, MMM 2018, PT I, 2018, 10704 :453-465
[15]   IMAGE-ENHANCEMENT BY HISTOGRAM TRANSFORMATION [J].
HUMMEL, R .
COMPUTER GRAPHICS AND IMAGE PROCESSING, 1977, 6 (02) :184-195
[16]   MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentation [J].
Ibtehaz, Nabil ;
Rahman, M. Sohel .
NEURAL NETWORKS, 2020, 121 :74-87
[17]  
Islam MJ, 2020, ROBOTICS: SCIENCE AND SYSTEMS XVI
[18]   Fast Underwater Image Enhancement for Improved Visual Perception [J].
Islam, Md Jahidul ;
Xia, Youya ;
Sattar, Junaed .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :3227-3234
[19]   Two-step domain adaptation for underwater image enhancement [J].
Jiang, Qun ;
Zhang, Yunfeng ;
Bao, Fangxun ;
Zhao, Xiuyang ;
Zhang, Caiming ;
Liu, Peide .
PATTERN RECOGNITION, 2022, 122
[20]   Target Oriented Perceptual Adversarial Fusion Network for Underwater Image Enhancement [J].
Jiang, Zhiying ;
Li, Zhuoxiao ;
Yang, Shuzhou ;
Fan, Xin ;
Liu, Risheng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) :6584-6598