Multi-level Feature Interaction and Efficient Non-Local Information Enhanced Channel Attention for image dehazing

被引:73
作者
Sun, Hang [1 ,2 ]
Li, Bohui [2 ]
Dan, Zhiping [2 ]
Hu, Wei [3 ]
Du, Bo [4 ]
Yang, Wen [2 ]
Wan, Jun [5 ]
机构
[1] China Three Gorges Univ, Hubei Engn Technol Res Ctr Farmland Environm Monit, Yichang 443002, Peoples R China
[2] China Three Gorges Univ, Hubei Key Lab Intelligent Vis Based Monitoring Hyd, Yichang 443002, Peoples R China
[3] Wuhan Univ, Dept Obstet & Gynaecol Ultrasound, Renmin Hosp, Wuhan 430060, Peoples R China
[4] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[5] Zhongnan Univ Econ & Law, Sch Informat & Safety Engn, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; Multi-level feature interaction; Non-local information; Channel attention; NETWORK;
D O I
10.1016/j.neunet.2023.03.017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image dehazing is a challenging task in computer vision. Currently, most dehazing methods adopt the U-Net architecture that directly fuses the decoding layer with the corresponding scale encoding layer. These methods ignore the effective utilization of different encoding layer information and existing feature information dilute problems, resulting in suboptimal edge details and overall scene aspects of dehazed image restoration. In addition, Squeeze and Excitation (SE) channel attention is widely used in dehazing network. However, the two fully-connected layers of dimensionality reduction operation in SE will negatively affect the weight prediction of feature channels, thus reducing the performance of the dehazing network. To solve the above problems, we propose a Multi-level Feature Interaction and Non-local Information Enhanced Channel Attention (MFINEA) dehazing model. Specifically, a multi-level feature interaction module is proposed to enable the decoding layer to fuse shallow and deep feature information extracted from different encoding layers for better recovery of edge details and the overall scene. Furthermore, an efficient non-local information enhanced channel attention module is proposed to mine more effective feature channel information for the weight assignment of the feature maps. The experimental results on several challenging benchmark datasets show that our MFINEA outperforms the state-of-the-art dehazing methods.(c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:10 / 27
页数:18
相关论文
共 67 条
[11]  
Chen Bo, 2020, P IEEECVF C COMPUTER
[12]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383
[13]   Learning to Filter: Siamese Relation Network for Robust Tracking [J].
Cheng, Siyuan ;
Zhong, Bineng ;
Li, Guorong ;
Liu, Xin ;
Tang, Zhenjun ;
Li, Xianxian ;
Wang, Jing .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4419-4429
[14]   Deeply Shape-guided Cascade for Instance Segmentation [J].
Ding, Hao ;
Qiao, Siyuan ;
Yuille, Alan ;
Shen, Wei .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8274-8284
[15]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[16]  
Dong Y, 2020, AAAI CONF ARTIF INTE, V34, P10729
[17]   Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing [J].
Engin, Deniz ;
Genc, Anil ;
Ekenel, Hazim Kemal .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :938-946
[18]   3Global Second-order Pooling Convolutional Networks [J].
Gao, Zilin ;
Xie, Jiangtao ;
Wang, Qilong ;
Li, Peihua .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3019-3028
[19]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[20]   MARG-UNet: A Single Image Dehazing Network Based on Multimodal Attention Residual Group [J].
Guo, Hao-Fei ;
Piao, Jin-Chun .
2022 IEEE 2ND INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SOFTWARE ENGINEERING (ICICSE 2022), 2022, :105-109