Multi-level Feature Interaction and Efficient Non-Local Information Enhanced Channel Attention for image dehazing

被引:73
作者
Sun, Hang [1 ,2 ]
Li, Bohui [2 ]
Dan, Zhiping [2 ]
Hu, Wei [3 ]
Du, Bo [4 ]
Yang, Wen [2 ]
Wan, Jun [5 ]
机构
[1] China Three Gorges Univ, Hubei Engn Technol Res Ctr Farmland Environm Monit, Yichang 443002, Peoples R China
[2] China Three Gorges Univ, Hubei Key Lab Intelligent Vis Based Monitoring Hyd, Yichang 443002, Peoples R China
[3] Wuhan Univ, Dept Obstet & Gynaecol Ultrasound, Renmin Hosp, Wuhan 430060, Peoples R China
[4] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[5] Zhongnan Univ Econ & Law, Sch Informat & Safety Engn, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; Multi-level feature interaction; Non-local information; Channel attention; NETWORK;
D O I
10.1016/j.neunet.2023.03.017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image dehazing is a challenging task in computer vision. Currently, most dehazing methods adopt the U-Net architecture that directly fuses the decoding layer with the corresponding scale encoding layer. These methods ignore the effective utilization of different encoding layer information and existing feature information dilute problems, resulting in suboptimal edge details and overall scene aspects of dehazed image restoration. In addition, Squeeze and Excitation (SE) channel attention is widely used in dehazing network. However, the two fully-connected layers of dimensionality reduction operation in SE will negatively affect the weight prediction of feature channels, thus reducing the performance of the dehazing network. To solve the above problems, we propose a Multi-level Feature Interaction and Non-local Information Enhanced Channel Attention (MFINEA) dehazing model. Specifically, a multi-level feature interaction module is proposed to enable the decoding layer to fuse shallow and deep feature information extracted from different encoding layers for better recovery of edge details and the overall scene. Furthermore, an efficient non-local information enhanced channel attention module is proposed to mine more effective feature channel information for the weight assignment of the feature maps. The experimental results on several challenging benchmark datasets show that our MFINEA outperforms the state-of-the-art dehazing methods.(c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:10 / 27
页数:18
相关论文
共 67 条
[21]  
He KM, 2009, PROC CVPR IEEE, P1956, DOI [10.1109/CVPRW.2009.5206515, 10.1109/CVPR.2009.5206515]
[22]   Distilling Image Dehazing with Heterogeneous Task Imitation [J].
Hong, Ming ;
Xie, Yuan ;
Li, Cuihua ;
Qu, Yanyun .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3459-3468
[23]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[24]  
Huang BH, 2020, IEEE WINT CONF APPL, P1795, DOI [10.1109/WACV45572.2020.9093471, 10.1109/wacv45572.2020.9093471]
[25]   Enhanced Multiscale Attention Network for Single Image Dehazing [J].
Imai, Wataru ;
Ikehara, Masaaki .
IEEE ACCESS, 2022, 10 :93626-93635
[26]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[27]   Brain-inspired multiple-target tracking using Dynamic Neural Fields [J].
Kamkar, Shiva ;
Moghaddam, Hamid Abrishami ;
Lashgari, Reza ;
Erlhagen, Wolfram .
NEURAL NETWORKS, 2022, 151 :121-131
[28]   Benchmarking Single-Image Dehazing and Beyond [J].
Li, Boyi ;
Ren, Wenqi ;
Fu, Dengpan ;
Tao, Dacheng ;
Feng, Dan ;
Zeng, Wenjun ;
Wang, Zhangyang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :492-505
[29]   AOD-Net: All-in-One Dehazing Network [J].
Li, Boyi ;
Peng, Xiulian ;
Wang, Zhangyang ;
Xu, Jizheng ;
Feng, Dan .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4780-4788
[30]   MSAFF-Net: Multiscale Attention Feature Fusion Networks for Single Image Dehazing and Beyond [J].
Lin, Cunyi ;
Rong, Xianwei ;
Yu, Xiaoyan .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :3089-3100