DHFormer: A Vision Transformer-Based Attention Module for Image Dehazing

被引:1
作者
Wasi, Abdul [1 ]
Shiney, O. Jeba [1 ]
机构
[1] Chandigarh Univ, Mohali, India
来源
COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT I | 2024年 / 2009卷
关键词
Residual Learning; Transmission Matrix; Vision Transformer; Attention Module; NETWORK;
D O I
10.1007/978-3-031-58181-6_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Images acquired in hazy conditions have degradations induced in them. Dehazing such images is a vexed and ill-posed problem. Scores of prior-based and learning-based approaches have been proposed to mitigate the effect of haze and generate haze-free images. Many conventional methods are constrained by their lack of awareness regarding scene depth and their incapacity to capture long-range dependencies. In this paper, a method that uses residual learning and vision transformers in an attention module is proposed. It essentially comprises two networks: In the first one, the network takes the ratio of a hazy image and the approximated transmission matrix to estimate a residual map. The second network takes this residual image as input and passes it through convolution layers before superposing it on the generated feature maps. It is then passed through global context and depth-aware transformer encoders to obtain channel attention. The attention module then infers the spatial attention map before generating the final haze-free image. Experimental results including several quantitative metrics demonstrate the efficiency and scalability of the suggested methodology.
引用
收藏
页码:148 / 159
页数:12
相关论文
共 29 条
[1]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[2]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[3]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[4]   Dehazing Using Color-Lines [J].
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2014, 34 (01)
[5]   Single image dehazing [J].
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2008, 27 (03)
[6]   A Novel Transformer-Based Attention Network for Image Dehazing [J].
Gao, Guanlei ;
Cao, Jie ;
Bao, Chun ;
Hao, Qun ;
Ma, Aoqi ;
Li, Gang .
SENSORS, 2022, 22 (09)
[7]  
Hatamizadeh Ali, P MACHINE LEARNING R
[8]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[9]  
Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579
[10]   Benchmarking Single-Image Dehazing and Beyond [J].
Li, Boyi ;
Ren, Wenqi ;
Fu, Dengpan ;
Tao, Dacheng ;
Feng, Dan ;
Zeng, Wenjun ;
Wang, Zhangyang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :492-505