DHFormer: A Vision Transformer-Based Attention Module for Image Dehazing

被引:1
作者
Wasi, Abdul [1 ]
Shiney, O. Jeba [1 ]
机构
[1] Chandigarh Univ, Mohali, India
来源
COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT I | 2024年 / 2009卷
关键词
Residual Learning; Transmission Matrix; Vision Transformer; Attention Module; NETWORK;
D O I
10.1007/978-3-031-58181-6_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Images acquired in hazy conditions have degradations induced in them. Dehazing such images is a vexed and ill-posed problem. Scores of prior-based and learning-based approaches have been proposed to mitigate the effect of haze and generate haze-free images. Many conventional methods are constrained by their lack of awareness regarding scene depth and their incapacity to capture long-range dependencies. In this paper, a method that uses residual learning and vision transformers in an attention module is proposed. It essentially comprises two networks: In the first one, the network takes the ratio of a hazy image and the approximated transmission matrix to estimate a residual map. The second network takes this residual image as input and passes it through convolution layers before superposing it on the generated feature maps. It is then passed through global context and depth-aware transformer encoders to obtain channel attention. The attention module then infers the spatial attention map before generating the final haze-free image. Experimental results including several quantitative metrics demonstrate the efficiency and scalability of the suggested methodology.
引用
收藏
页码:148 / 159
页数:12
相关论文
共 29 条
[11]   Image Dehazing Using Residual-Based Deep CNN [J].
Li, Jinjiang ;
Li, Guihui ;
Fan, Hui .
IEEE ACCESS, 2018, 6 :26831-26842
[12]   Two-stage single image dehazing network using swin-transformer [J].
Li, Xiaoling ;
Hua, Zhen ;
Li, Jinjiang .
IET IMAGE PROCESSING, 2022, 16 (09) :2518-2534
[13]  
McCartney E. J., 1976, Optics of the atmosphere. Scattering by molecules and particles
[14]   Efficient Image Dehazing with Boundary Constraint and Contextual Regularization [J].
Meng, Gaofeng ;
Wang, Ying ;
Duan, Jiangyong ;
Xiang, Shiming ;
Pan, Chunhong .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :617-624
[15]   Gated Fusion Network for Single Image Dehazing [J].
Ren, Wenqi ;
Ma, Lin ;
Zhang, Jiawei ;
Pan, Jinshan ;
Cao, Xiaochun ;
Liu, Wei ;
Yang, Ming-Hsuan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3253-3261
[16]   Single Image Dehazing via Multi-scale Convolutional Neural Networks [J].
Ren, Wenqi ;
Liu, Si ;
Zhang, Hua ;
Pan, Jinshan ;
Cao, Xiaochun ;
Yang, Ming-Hsuan .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :154-169
[17]   Photo-Realistic Image Dehazing and Verifying Networks via Complementary Adversarial Learning [J].
Shin, Joongchol ;
Paik, Joonki .
SENSORS, 2021, 21 (18)
[18]   Indoor Segmentation and Support Inference from RGBD Images [J].
Silberman, Nathan ;
Hoiem, Derek ;
Kohli, Pushmeet ;
Fergus, Rob .
COMPUTER VISION - ECCV 2012, PT V, 2012, 7576 :746-760
[19]   Investigating Haze-relevant Features in A Learning Framework for Image Dehazing [J].
Tang, Ketan ;
Yang, Jianchao ;
Wang, Jue .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :2995-3002
[20]  
Vaswani A, 2017, ADV NEUR IN, V30