Multi-level Feature Interaction and Efficient Non-Local Information Enhanced Channel Attention for image dehazing

被引:73
作者
Sun, Hang [1 ,2 ]
Li, Bohui [2 ]
Dan, Zhiping [2 ]
Hu, Wei [3 ]
Du, Bo [4 ]
Yang, Wen [2 ]
Wan, Jun [5 ]
机构
[1] China Three Gorges Univ, Hubei Engn Technol Res Ctr Farmland Environm Monit, Yichang 443002, Peoples R China
[2] China Three Gorges Univ, Hubei Key Lab Intelligent Vis Based Monitoring Hyd, Yichang 443002, Peoples R China
[3] Wuhan Univ, Dept Obstet & Gynaecol Ultrasound, Renmin Hosp, Wuhan 430060, Peoples R China
[4] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[5] Zhongnan Univ Econ & Law, Sch Informat & Safety Engn, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; Multi-level feature interaction; Non-local information; Channel attention; NETWORK;
D O I
10.1016/j.neunet.2023.03.017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image dehazing is a challenging task in computer vision. Currently, most dehazing methods adopt the U-Net architecture that directly fuses the decoding layer with the corresponding scale encoding layer. These methods ignore the effective utilization of different encoding layer information and existing feature information dilute problems, resulting in suboptimal edge details and overall scene aspects of dehazed image restoration. In addition, Squeeze and Excitation (SE) channel attention is widely used in dehazing network. However, the two fully-connected layers of dimensionality reduction operation in SE will negatively affect the weight prediction of feature channels, thus reducing the performance of the dehazing network. To solve the above problems, we propose a Multi-level Feature Interaction and Non-local Information Enhanced Channel Attention (MFINEA) dehazing model. Specifically, a multi-level feature interaction module is proposed to enable the decoding layer to fuse shallow and deep feature information extracted from different encoding layers for better recovery of edge details and the overall scene. Furthermore, an efficient non-local information enhanced channel attention module is proposed to mine more effective feature channel information for the weight assignment of the feature maps. The experimental results on several challenging benchmark datasets show that our MFINEA outperforms the state-of-the-art dehazing methods.(c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:10 / 27
页数:18
相关论文
共 67 条
[41]  
Shazeer Noam, 2017, INT C LEARNING REPRE
[42]   A conditional Triplet loss for few-shot learning and its application to image co-segmentation [J].
Shi, Daming ;
Orouskhani, Maysam ;
Orouskhani, Yasin .
NEURAL NETWORKS, 2021, 137 :54-62
[43]  
Shyam P, 2021, AAAI CONF ARTIF INTE, V35, P9657
[44]   WSAMF-Net: Wavelet Spatial Attention-Based MultiStream Feedback Network for Single Image Dehazing [J].
Song, Xibin ;
Zhou, Dingfu ;
Li, Wei ;
Ding, Haodong ;
Dai, Yuchao ;
Zhang, Liangjun .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) :575-588
[45]   Scale-free heterogeneous cycleGAN for defogging from a single image for autonomous driving in fog [J].
Sun, Hang ;
Zhang, Yan ;
Chen, Peng ;
Dan, Zhiping ;
Sun, Shuifa ;
Wan, Jun ;
Li, Weisheng .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (05) :3737-3751
[46]   SADnet: Semi-supervised Single Image Dehazing Method Based on an Attention Mechanism [J].
Sun, Ziyi ;
Zhang, Yunfeng ;
Bao, Fangxun ;
Wang, Ping ;
Yao, Xunxiang ;
Zhang, Caiming .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (02)
[47]   MAXIM: Multi-Axis MLP for Image Processing [J].
Tu, Zhengzhong ;
Talebi, Hossein ;
Zhang, Han ;
Yang, Feng ;
Milanfar, Peyman ;
Bovik, Alan ;
Li, Yinxiao .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5759-5770
[48]   Flexibly regularized mixture models and application to image segmentation [J].
Vacher, Jonathan ;
Launay, Claire ;
Coen-Cagli, Ruben .
NEURAL NETWORKS, 2022, 149 :107-123
[49]   Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network [J].
Wan, Jun ;
Xi, Hui ;
Zhou, Jie ;
Lai, Zhihui ;
Pedrycz, Witold ;
Wang, Xu ;
Sun, Hang .
IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (06) :3546-3560
[50]   ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks [J].
Wang, Qilong ;
Wu, Banggu ;
Zhu, Pengfei ;
Li, Peihua ;
Zuo, Wangmeng ;
Hu, Qinghua .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11531-11539