A Multi-Branch Multi-Scale Deep Learning Image Fusion Algorithm Based on DenseNet

被引:6
作者
Dong, Yumin [1 ]
Chen, Zhengquan [1 ]
Li, Ziyi [1 ]
Gao, Feng [2 ]
机构
[1] Chongqing Normal Univ, Sch Comp & Informat Sci, Chongqing 401331, Peoples R China
[2] Qingdao Technol Univ, Sci Sch, Qingdao 266525, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 21期
基金
中国国家自然科学基金;
关键词
deep learning; image fusion; multi-scale image; GENERATIVE ADVERSARIAL NETWORK; PERFORMANCE; NEST;
D O I
10.3390/app122110989
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Infrared images have good anti-environmental interference ability and can capture hot target information well, but their pictures lack rich detailed texture information and poor contrast. Visible image has clear and detailed texture information, but their imaging process depends more on the environment, and the quality of the environment determines the quality of the visible image. This paper presents an infrared image and visual image fusion algorithm based on deep learning. Two identical feature extractors are used to extract the features of visible and infrared images of different scales, fuse these features through specific fusion methods, and restore the features of visible and infrared images to the pictures through the feature restorer to make up for the deficiencies in the various photos of infrared and visible images. This paper tests infrared visual images, multi-focus images, and other data sets. The traditional image fusion algorithm is compared several with the current advanced image fusion algorithm. The experimental results show that the image fusion method proposed in this paper can keep more feature information of the source image in the fused image, and achieve excellent results in some image evaluation indexes.
引用
收藏
页数:11
相关论文
共 33 条
  • [1] [Anonymous], 2014, arXiv
  • [2] Image quality measures and their performance
    Eskicioglu, AM
    Fisher, PS
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) : 2959 - 2965
  • [3] Fu Y, 2022, Arxiv, DOI arXiv:2107.13967
  • [4] A Dual-branch Network for Infrared and Visible Image Fusion
    Fu, Yu
    Wu, Xiao-Jun
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10675 - 10680
  • [5] Effective method for fusing infrared and visible images
    Fu, Yu
    Wu, Xiao-Jun
    Kittler, Josef
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (03)
  • [6] Image fusion based on generative adversarial network consistent with perception
    Fu, Yu
    Wu, Xiao-Jun
    Durrani, Tariq
    [J]. INFORMATION FUSION, 2021, 72 : 110 - 125
  • [7] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [8] ImageNet Classification with Deep Convolutional Neural Networks
    Krizhevsky, Alex
    Sutskever, Ilya
    Hinton, Geoffrey E.
    [J]. COMMUNICATIONS OF THE ACM, 2017, 60 (06) : 84 - 90
  • [9] Kumar N., 2019, P INT C MEDICAL IMAG
  • [10] RFN-Nest: An end-to-end residual fusion network for infrared and visible images
    Li, Hui
    Wu, Xiao-Jun
    Kittler, Josef
    [J]. INFORMATION FUSION, 2021, 73 : 72 - 86