Image fusion algorithm for traffic accident rescue based on deep learning

被引:0
作者
Jiang S. [1 ]
Wang P.-L. [1 ]
Deng Z.-J. [2 ]
Bie Y.-M. [3 ]
机构
[1] College of Physics, Changchun University of Science and Technology, Changchun
[2] Zhejiang Dahua Technology Co.,Ltd., Hangzhou
[3] College of Transportation, Jilin University, Changchun
来源
Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition) | 2023年 / 53卷 / 12期
关键词
attention mechanism; discriminator; image fusion; infrared image; transportation systems engineering; visible light image;
D O I
10.13229/j.cnki.jdxbgxb.20230346
中图分类号
学科分类号
摘要
Aiming at the problem that fire,smoke and other situations at the scene of serious traffic accidents affect the detection equipment to complete the search and rescue of trapped persons, a Convolutional Block Attention Module-Improved Loss-Dual-Discriminator Conditional Generative Based on Convolutional Attention Mechanism Adversarial Network(CBAM-IL-DDCGAN)infrared and visible image fusion method is proposed. Firstly,the decoding network with attention feature fusion module is used to restore and reconstruct the image from space and channel. Secondly,an adaptive weight calculation method based on gradient information is designed. Finally,the test experiment of fused image continuous frames was carried out. Experimental results show that the proposed image fusion algorithm performs well, and achieves a significant improvement of more than 7% in PSNR,SSIM and MSE compared with the traditional algorithm and the generative adversarial network algorithm. These results verify the feasibility and superiority of the fusion algorithm in complex traffic accident rescue. © 2023 Editorial Board of Jilin University. All rights reserved.
引用
收藏
页码:3472 / 3480
页数:8
相关论文
共 17 条
[1]  
Li Qing-qing, Research on infrared and visible image fusion based on multilayer information extraction and transmission, (2022)
[2]  
Cheng Bo-yang, Research on infrared and visible im-age fusion based on rolling guided shear wave trans-form, (2020)
[3]  
Gu Zhen-fei, Yuan Xiao-yan, Zhang Deng-yin, Et al., A method of infrared image enhancement based on regional saliency recognition, Journal of Jiangsu University (Natural Science Edition), 40, 6, pp. 681-687, (2019)
[4]  
Sheng Wen-shun, Sun Yan-wen, Zhang Hui-ying, Multi-focus image fusion algorithm based on sparse-ness theory and FFST-GIF, Journal of Jiangsu University (Natural Science Edition), 43, 2, pp. 195-200, (2022)
[5]  
Wang Bin, Zhao Zuo-peng, Driver attitude estima-tion method based on dual-stream fully convolutional network, Journal of Jiangsu University(Natural Sci-ence Edition), 43, 2, pp. 161-168, (2022)
[6]  
Li Chen-xu, Jiang Hao-bin, Wang Cheng-yu, Et al., Vehicle pose estimation method based on sensor in-formation fusion, Journal of Jiangsu University (Natural Science Edition), 43, 6, pp. 636-644, (2022)
[7]  
Liu Y, Chen X, Peng H, Et al., Multi-focus image fu-sion with a deep convolutional neural network[J], In-formation Fusion, 36, pp. 191-207, (2017)
[8]  
Zhao Y, Fu G, Wang H, Et al., The fusion of un-matched infrared and visible images based on genera-tive adversarial networks, Mathematical Problems in Engineering, 2020, (2020)
[9]  
An W B, Wang H M., Infrared and visible image fu-sion with supervised convolutional Neural network, Optik, 219, (2020)
[10]  
Ma Jia-yi, Xu Han, Jiang Jun-jun, Et al., DDcGAN: a dual-discriminator conditional generative adversarial network for multi-resolution image fusion, IEEE Transactions on Image Processing, 29, pp. 4980-4995, (2020)