DEA-Net: Single Image Dehazing Based on Detail-Enhanced Convolution and Content-Guided Attention

被引:105
作者
Chen, Zixuan [1 ]
He, Zewei [1 ]
Lu, Zhe-Ming [1 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; detail-enhanced convolution; content-guided attention; fusion scheme; NETWORK; VISIBILITY; WEATHER;
D O I
10.1109/TIP.2024.3354108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is a challenging ill-posed problem which estimates latent haze-free images from observed hazy images. Some existing deep learning based methods are devoted to improving the model performance via increasing the depth or width of convolution. The learning ability of Convolutional Neural Network (CNN) structure is still under-explored. In this paper, a Detail-Enhanced Attention Block (DEAB) consisting of Detail-Enhanced Convolution (DEConv) and Content-Guided Attention (CGA) is proposed to boost the feature learning for improving the dehazing performance. Specifically, the DEConv contains difference convolutions which can integrate prior information to complement the vanilla one and enhance the representation capacity. Then by using the re-parameterization technique, DEConv is equivalently converted into a vanilla convolution to reduce parameters and computational cost. By assigning the unique Spatial Importance Map (SIM) to every channel, CGA can attend more useful information encoded in features. In addition, a CGA-based mixup fusion scheme is presented to effectively fuse the features and aid the gradient flow. By combining above mentioned components, we propose our Detail-Enhanced Attention Network (DEA-Net) for recovering high-quality haze-free images. Extensive experimental results demonstrate the effectiveness of our DEA-Net, outperforming the state-of-the-art (SOTA) methods by boosting the PSNR index over 41 dB with only 3.653 M parameters. (The source code of our DEA-Net is available at https://github.com/cecret3350/DEA-Net.)
引用
收藏
页码:1002 / 1015
页数:14
相关论文
共 47 条
  • [1] Self-Guided Image Dehazing Using Progressive Feature Fusion
    Bai, Haoran
    Pan, Jinshan
    Xiang, Xinguang
    Tang, Jinhui
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1217 - 1229
  • [2] Non-Local Image Dehazing
    Berman, Dana
    Treibitz, Tali
    Avidan, Shai
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1674 - 1682
  • [3] DehazeNet: An End-to-End System for Single Image Haze Removal
    Cai, Bolun
    Xu, Xiangmin
    Jia, Kui
    Qing, Chunmei
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) : 5187 - 5198
  • [4] Multi-Scale Boosted Dehazing Network with Dense Feature Fusion
    Dong, Hang
    Pan, Jinshan
    Xiang, Lei
    Hu, Zhe
    Zhang, Xinyi
    Wang, Fei
    Yang, Ming-Hsuan
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2154 - 2164
  • [5] Image Dehazing Transformer with Transmission-Aware 3D Position Embedding
    Guo, Chunle
    Yan, Qixin
    Anwar, Saeed
    Cong, Runmin
    Ren, Wenqi
    Li, Chongyi
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5802 - 5810
  • [6] Single Image Haze Removal Using Dark Channel Prior
    He, Kaiming
    Sun, Jian
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) : 2341 - 2353
  • [7] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [8] He KM, 2009, PROC CVPR IEEE, P1956, DOI [10.1109/CVPRW.2009.5206515, 10.1109/CVPR.2009.5206515]
  • [9] Bag of Tricks for Image Classification with Convolutional Neural Networks
    He, Tong
    Zhang, Zhi
    Zhang, Hang
    Zhang, Zhongyue
    Xie, Junyuan
    Li, Mu
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 558 - 567
  • [10] Single image super-resolution based on progressive fusion of orientation-aware features
    He, Zewei
    Chen, Du
    Cao, Yanpeng
    Yang, Jiangxin
    Cao, Yanlong
    Li, Xin
    Tang, Siliang
    Zhuang, Yueting
    Lu, Zhe-ming
    [J]. PATTERN RECOGNITION, 2023, 133