Dynamic Multi-Attention Dehazing Network with Adaptive Feature Fusion

被引:3
作者
Zhao, Donghui [1 ]
Mo, Bo [1 ]
Zhu, Xiang [2 ]
Zhao, Jie [1 ,3 ]
Zhang, Heng [4 ]
Tao, Yimeng [1 ]
Zhao, Chunbo [1 ]
机构
[1] Beijing Inst Technol, Beijing 100081, Peoples R China
[2] Beijing Bldg Mat Res Inst Co Ltd, Beijing 100041, Peoples R China
[3] North Nav Control Technol Co Ltd, Beijing 100176, Peoples R China
[4] Shanghai Electromech Engn Inst, Shanghai 201109, Peoples R China
关键词
dehazing; CNN; feature attention; feature fusion; contrastive learning; IMAGE; VISION;
D O I
10.3390/electronics12030529
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Dynamic Multi-Attention Dehazing Network (DMADN) for single image dehazing. The proposed network consists of two key components, the Dynamic Feature Attention (DFA) module, and the Adaptive Feature Fusion (AFF) module. The DFA module provides pixel-wise weights and channel-wise weights for input features, considering that the haze distribution is always uneven in a degenerated image and the value in each channel is different. We propose an AFF module based on the adaptive mixup operation to restore the missing spatial information from high-resolution layers. Most previous works have concentrated on increasing the scale of the model to improve dehazing performance, which makes it difficult to apply in edge devices. We introduce contrastive learning in our training processing, which leverages both positive and negative samples to optimize our network. The contrastive learning strategy could effectively improve the quality of output while not increasing the model's complexity and inference time in the testing phase. Extensive experimental results on the synthetic and real-world hazy images demonstrate that DMADN achieves state-of-the-art dehazing performance with a competitive number of parameters.
引用
收藏
页数:19
相关论文
共 60 条
[41]  
Qin X, 2020, AAAI CONF ARTIF INTE, V34, P11908
[42]   Enhanced Pix2pix Dehazing Network [J].
Qu, Yanyun ;
Chen, Yizi ;
Huang, Jingying ;
Xie, Yuan .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :8152-8160
[43]   Gated Fusion Network for Single Image Dehazing [J].
Ren, Wenqi ;
Ma, Lin ;
Zhang, Jiawei ;
Pan, Jinshan ;
Cao, Xiaochun ;
Liu, Wei ;
Yang, Ming-Hsuan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3253-3261
[44]   Single Image Dehazing via Multi-scale Convolutional Neural Networks [J].
Ren, Wenqi ;
Liu, Si ;
Zhang, Hua ;
Pan, Jinshan ;
Cao, Xiaochun ;
Yang, Ming-Hsuan .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :154-169
[45]   Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understanding [J].
Sakaridis, Christos ;
Dai, Dengxin ;
Hecker, Simon ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 :707-724
[46]   Semantic Foggy Scene Understanding with Synthetic Data [J].
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (09) :973-992
[47]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[48]  
Song S., 2021, P INT C COMPUTER SCI
[49]   Visibility in bad weather from a single image [J].
Tan, Robby T. .
2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, :2347-2354
[50]   Fast Visibility Restoration from a Single Color or Gray Level Image [J].
Tarel, Jean-Philippe ;
Hautiere, Nicolas .
2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, :2201-2208