TAFormer: A Transmission-Aware Transformer for Underwater Image Enhancement

被引:1
作者
Li, Yuanyuan [1 ]
Mi, Zetian [1 ]
Wang, Yulin [1 ]
Jiang, Shuaiyong [1 ]
Fu, Xianping [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
基金
中国国家自然科学基金;
关键词
Imaging; Transformers; Image color analysis; Image enhancement; Image restoration; Degradation; Circuit faults; Transmission-aware transformer; transmission-guided multi-head self-attention; spatio-frequency domain interaction; underwater image enhancement;
D O I
10.1109/TCSVT.2024.3455353
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The attenuation and scattering of different colors of light underwater are wavelength- and distance-dependent, leading to various degradation problems in underwater images. When enhancing underwater images, many deep learning-based methods rely solely on convolutional neural networks to learn a mapping from degraded images to clear images to achieve enhanced effects. However, such methods have limitations in capturing long-term dependencies, preventing them from accurately capturing the global information of images. Although Transformers can solve this problem, there is a lack of inductive bias in training due to the limited number of training datasets with certain degradation phenomena. To address this issue, a novel Swin Transformer based on physical perception is proposed for the first time. Swin Transformer is used to solve the long- and short-distance dependency problem. Additionally, the underwater image degradation process is considered in network design to solve the problem of poor inductive bias. Combining the advantages of physical imaging, convolutional neural networks and Transformer can effectively improve the visual quality of underwater images. Rich qualitative and quantitative experimental results show that our Transformer achieves competitive performance on 5 benchmark datasets.
引用
收藏
页码:601 / 616
页数:16
相关论文
共 80 条
[51]   Underwater Image Restoration Based on Image Blurriness and Light [J].
Peng, Yan-Tsung ;
Cosman, Pamela C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) :1579-1594
[52]  
Piao Y, 2020, PROC CVPR IEEE, P9057, DOI 10.1109/CVPR42600.2020.00908
[53]   SGUIE-Net: Semantic Attention Guided Underwater Image Enhancement With Multi-Scale Perception [J].
Qi, Qi ;
Li, Kunqian ;
Zheng, Haiyong ;
Gao, Xiang ;
Hou, Guojia ;
Sun, Kun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :6816-6830
[54]   Reinforced Swin-Convs Transformer for Simultaneous Underwater Sensing Scene Image Enhancement and Super-resolution [J].
Ren, Tingdi ;
Xu, Haiyong ;
Jiang, Gangyi ;
Yu, Mei ;
Zhang, Xuan ;
Wang, Biao ;
Luo, Ting .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[55]   Uncertainty-guided hierarchical frequency domain Transformer for image restoration [J].
Shao, Mingwen ;
Qiao, Yuanjian ;
Meng, Deyu ;
Zuo, Wangmeng .
KNOWLEDGE-BASED SYSTEMS, 2023, 263
[56]   The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations [J].
Sharma, G ;
Wu, WC ;
Daa, EN .
COLOR RESEARCH AND APPLICATION, 2005, 30 (01) :21-30
[57]  
Tang Y., 2022, P AS C COMP VIS, P1403
[58]   Adaptive Underwater Image Enhancement Guided by Generalized Imaging Components [J].
Tang, Yonghua ;
Liu, Xu ;
Zhang, Zhipeng ;
Lin, Sen .
IEEE SIGNAL PROCESSING LETTERS, 2023, 30 :1772-1776
[59]  
Vaswani A., 2017, PROC 31 C NEURAL INF, V30
[60]   Graph-Collaborated Auto-Encoder Hashing for Multiview Binary Clustering [J].
Wang, Huibing ;
Yao, Mingze ;
Jiang, Guangqi ;
Mi, Zetian ;
Fu, Xianping .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) :10121-10133