A Multi-Branch Multi-Scale Deep Learning Image Fusion Algorithm Based on DenseNet

被引:6
作者
Dong, Yumin [1 ]
Chen, Zhengquan [1 ]
Li, Ziyi [1 ]
Gao, Feng [2 ]
机构
[1] Chongqing Normal Univ, Sch Comp & Informat Sci, Chongqing 401331, Peoples R China
[2] Qingdao Technol Univ, Sci Sch, Qingdao 266525, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 21期
基金
中国国家自然科学基金;
关键词
deep learning; image fusion; multi-scale image; GENERATIVE ADVERSARIAL NETWORK; PERFORMANCE; NEST;
D O I
10.3390/app122110989
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Infrared images have good anti-environmental interference ability and can capture hot target information well, but their pictures lack rich detailed texture information and poor contrast. Visible image has clear and detailed texture information, but their imaging process depends more on the environment, and the quality of the environment determines the quality of the visible image. This paper presents an infrared image and visual image fusion algorithm based on deep learning. Two identical feature extractors are used to extract the features of visible and infrared images of different scales, fuse these features through specific fusion methods, and restore the features of visible and infrared images to the pictures through the feature restorer to make up for the deficiencies in the various photos of infrared and visible images. This paper tests infrared visual images, multi-focus images, and other data sets. The traditional image fusion algorithm is compared several with the current advanced image fusion algorithm. The experimental results show that the image fusion method proposed in this paper can keep more feature information of the source image in the fused image, and achieve excellent results in some image evaluation indexes.
引用
收藏
页数:11
相关论文
共 33 条
[1]   Image quality measures and their performance [J].
Eskicioglu, AM ;
Fisher, PS .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) :2959-2965
[2]  
Fu Y, 2022, Arxiv, DOI arXiv:2107.13967
[3]   A Dual-branch Network for Infrared and Visible Image Fusion [J].
Fu, Yu ;
Wu, Xiao-Jun .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :10675-10680
[4]   Effective method for fusing infrared and visible images [J].
Fu, Yu ;
Wu, Xiao-Jun ;
Kittler, Josef .
JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (03)
[5]   Image fusion based on generative adversarial network consistent with perception [J].
Fu, Yu ;
Wu, Xiao-Jun ;
Durrani, Tariq .
INFORMATION FUSION, 2021, 72 :110-125
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]  
Iandola F, 2014, DenseNet: Implementing efficient ConvNet descriptor pyramids
[8]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[9]  
Kumar N., 2019, P INT C MEDICAL IMAG
[10]   RFN-Nest: An end-to-end residual fusion network for infrared and visible images [J].
Li, Hui ;
Wu, Xiao-Jun ;
Kittler, Josef .
INFORMATION FUSION, 2021, 73 :72-86