TAFormer: A Transmission-Aware Transformer for Underwater Image Enhancement

被引:1
作者
Li, Yuanyuan [1 ]
Mi, Zetian [1 ]
Wang, Yulin [1 ]
Jiang, Shuaiyong [1 ]
Fu, Xianping [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
基金
中国国家自然科学基金;
关键词
Imaging; Transformers; Image color analysis; Image enhancement; Image restoration; Degradation; Circuit faults; Transmission-aware transformer; transmission-guided multi-head self-attention; spatio-frequency domain interaction; underwater image enhancement;
D O I
10.1109/TCSVT.2024.3455353
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The attenuation and scattering of different colors of light underwater are wavelength- and distance-dependent, leading to various degradation problems in underwater images. When enhancing underwater images, many deep learning-based methods rely solely on convolutional neural networks to learn a mapping from degraded images to clear images to achieve enhanced effects. However, such methods have limitations in capturing long-term dependencies, preventing them from accurately capturing the global information of images. Although Transformers can solve this problem, there is a lack of inductive bias in training due to the limited number of training datasets with certain degradation phenomena. To address this issue, a novel Swin Transformer based on physical perception is proposed for the first time. Swin Transformer is used to solve the long- and short-distance dependency problem. Additionally, the underwater image degradation process is considered in network design to solve the problem of poor inductive bias. Combining the advantages of physical imaging, convolutional neural networks and Transformer can effectively improve the visual quality of underwater images. Rich qualitative and quantitative experimental results show that our Transformer achieves competitive performance on 5 benchmark datasets.
引用
收藏
页码:601 / 616
页数:16
相关论文
共 80 条
  • [1] Color Balance and Fusion for Underwater Image Enhancement
    Ancuti, Codruta O.
    Ancuti, Cosmin
    De Vleeschouwer, Christophe
    Bekaert, Philippe
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 379 - 393
  • [2] Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
  • [3] Diving deeper into underwater image enhancement: A survey
    Anwar, Saeed
    Li, Chongyi
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 89
  • [4] Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset
    Berman, Dana
    Levy, Deborah
    Avidan, Shai
    Treibitz, Tali
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) : 2822 - 2837
  • [5] Perceptual Underwater Image Enhancement With Deep Learning and Physical Priors
    Chen, Long
    Jiang, Zheheng
    Tong, Lei
    Liu, Zhihua
    Zhao, Aite
    Zhang, Qianni
    Dong, Junyu
    Zhou, Huiyu
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (08) : 3078 - 3092
  • [6] MFFN: An Underwater Sensing Scene Image Enhancement Method Based on Multiscale Feature Fusion Network
    Chen, Renzhang
    Cai, Zhanchuan
    Cao, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] Underwater Image Enhancement by Wavelength Compensation and Dehazing
    Chiang, John Y.
    Chen, Ying-Ching
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (04) : 1756 - 1769
  • [8] Color Channel Compensation (3C): A Fundamental Pre-Processing Step for Image Enhancement
    Codruta, Ancuti O.
    Ancuti, Cosmin
    De Vleeschouwer, Christophe
    Sbert, Mateu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 2653 - 2665
  • [9] PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN With Dual-Discriminators
    Cong, Runmin
    Yang, Wenyu
    Zhang, Wei
    Li, Chongyi
    Guo, Chun-Le
    Huang, Qingming
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4472 - 4485
  • [10] Underwater Depth Estimation and Image Restoration Based on Single Images
    Drews, Paulo L. J., Jr.
    Nascimento, Erickson R.
    Botelho, Silvia S. C.
    Montenegro Campos, Mario Fernando
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) : 24 - 35