Multi-level Feature Interaction and Efficient Non-Local Information Enhanced Channel Attention for image dehazing

被引:73
作者
Sun, Hang [1 ,2 ]
Li, Bohui [2 ]
Dan, Zhiping [2 ]
Hu, Wei [3 ]
Du, Bo [4 ]
Yang, Wen [2 ]
Wan, Jun [5 ]
机构
[1] China Three Gorges Univ, Hubei Engn Technol Res Ctr Farmland Environm Monit, Yichang 443002, Peoples R China
[2] China Three Gorges Univ, Hubei Key Lab Intelligent Vis Based Monitoring Hyd, Yichang 443002, Peoples R China
[3] Wuhan Univ, Dept Obstet & Gynaecol Ultrasound, Renmin Hosp, Wuhan 430060, Peoples R China
[4] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[5] Zhongnan Univ Econ & Law, Sch Informat & Safety Engn, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; Multi-level feature interaction; Non-local information; Channel attention; NETWORK;
D O I
10.1016/j.neunet.2023.03.017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image dehazing is a challenging task in computer vision. Currently, most dehazing methods adopt the U-Net architecture that directly fuses the decoding layer with the corresponding scale encoding layer. These methods ignore the effective utilization of different encoding layer information and existing feature information dilute problems, resulting in suboptimal edge details and overall scene aspects of dehazed image restoration. In addition, Squeeze and Excitation (SE) channel attention is widely used in dehazing network. However, the two fully-connected layers of dimensionality reduction operation in SE will negatively affect the weight prediction of feature channels, thus reducing the performance of the dehazing network. To solve the above problems, we propose a Multi-level Feature Interaction and Non-local Information Enhanced Channel Attention (MFINEA) dehazing model. Specifically, a multi-level feature interaction module is proposed to enable the decoding layer to fuse shallow and deep feature information extracted from different encoding layers for better recovery of edge details and the overall scene. Furthermore, an efficient non-local information enhanced channel attention module is proposed to mine more effective feature channel information for the weight assignment of the feature maps. The experimental results on several challenging benchmark datasets show that our MFINEA outperforms the state-of-the-art dehazing methods.(c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:10 / 27
页数:18
相关论文
共 67 条
[1]  
Ainslie J, 2020, PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), P268
[2]   NTIRE 2021 NonHomogeneous Dehazing Challenge Report [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Vasluianu, Florin-Alexandru ;
Timofte, Radu ;
Fu, Minghan ;
Liu, Huan ;
Yu, Yankun ;
Chen, Jun ;
Wang, Keyan ;
Chang, Jerome ;
Wang, Xiyao ;
Liu, Jing ;
Xu, Yi ;
Zhang, Xinjian ;
Zhao, Minyi ;
Zhou, Shuigeng ;
Chen, Tianyi ;
Fu, Jiahui ;
Jiang, Wentao ;
Gao, Chen ;
Liu, Si ;
Wang, Yudong ;
Guo, Jichang ;
Li, Chongyi ;
Yan, Qixin ;
Zheng, Sida ;
Zamir, Syed Waqas ;
Arora, Aditya ;
Dudhane, Akshay ;
Khan, Salman ;
Hayat, Munawar ;
Khan, Fahad Shahbaz ;
Shao, Ling ;
Zhang, Haichuan ;
Guo, Tiantong ;
Monga, Vishal ;
Yang, Wenjin ;
Lin, Jin ;
Luo, Xiaotong ;
Huang, Guowen ;
Chen, Shuxin ;
Qu, Yanyun ;
Xu, Kele ;
Yang, Lehan ;
Sun, Pengliang ;
Niu, Xuetong ;
Zheng, Junjun ;
Ruan, Xiaotong ;
Wang, Yunfeng ;
Yang, Jiang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :627-646
[3]   NTIRE 2019 Image Dehazing Challenge Report [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu ;
Van Gool, Luc ;
Zhang, Lei ;
Yang, Ming-Hsuan ;
Guo, Tiantong ;
Li, Xuelu ;
Cherukuri, Venkateswararao ;
Monga, Vishal ;
Jiang, Hao ;
Yang, Siyuan ;
Liu, Yan ;
Qu, Xiaochao ;
Wan, Pengfei ;
Park, Dongwon ;
Chun, Se Young ;
Hong, Ming ;
Huang, Jinying ;
Chen, Yizi ;
Chen, Shuxin ;
Wang, Bomin ;
Michelini, Pablo Navarrete ;
Liu, Hanwen ;
Zhu, Dan ;
Liu, Jing ;
Santra, Sanchayan ;
Mondal, Ranjan ;
Chanda, Bhabatosh ;
Morales, Peter ;
Klinghoffer, Tzofi ;
Le Manh Quan ;
Kim, Yong-Guk ;
Liang, Xiao ;
Li, Runde ;
Pan, Jinshan ;
Tang, Jinhui ;
Purohit, Kuldeep ;
Suin, Maitreya ;
Rajagopalan, A. N. ;
Schettini, Raimondo ;
Bianco, Simone ;
Piccoli, Flavio ;
Cusano, C. ;
Celona, Luigi ;
Hwang, Sunhee ;
Ma, Yu Seung ;
Byun, Hyeran ;
Murala, Subrahmanyam ;
Dudhane, Akshay .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :2241-2253
[4]  
Ancuti CO, 2019, IEEE IMAGE PROC, P1014, DOI [10.1109/icip.2019.8803046, 10.1109/ICIP.2019.8803046]
[5]   Self-Guided Image Dehazing Using Progressive Feature Fusion [J].
Bai, Haoran ;
Pan, Jinshan ;
Xiang, Xinguang ;
Tang, Jinhui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1217-1229
[6]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[7]  
Bi Q., 2021, 2021 MED IMAGE COMPU, P55
[8]   Local Semantic Enhanced ConvNet for Aerial Scene Recognition [J].
Bi, Qi ;
Qin, Kun ;
Zhang, Han ;
Xia, Gui-Song .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :6498-6511
[9]   A Multiple-Instance Densely-Connected ConvNet for Aerial Scene Classification [J].
Bi, Qi ;
Qin, Kun ;
Li, Zhili ;
Zhang, Han ;
Xu, Kai ;
Xia, Gui-Song .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4911-4926
[10]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198