A Multi-Branch Multi-Scale Deep Learning Image Fusion Algorithm Based on DenseNet

被引:6
|
作者
Dong, Yumin [1 ]
Chen, Zhengquan [1 ]
Li, Ziyi [1 ]
Gao, Feng [2 ]
机构
[1] Chongqing Normal Univ, Sch Comp & Informat Sci, Chongqing 401331, Peoples R China
[2] Qingdao Technol Univ, Sci Sch, Qingdao 266525, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 21期
基金
中国国家自然科学基金;
关键词
deep learning; image fusion; multi-scale image; GENERATIVE ADVERSARIAL NETWORK; PERFORMANCE; NEST;
D O I
10.3390/app122110989
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Infrared images have good anti-environmental interference ability and can capture hot target information well, but their pictures lack rich detailed texture information and poor contrast. Visible image has clear and detailed texture information, but their imaging process depends more on the environment, and the quality of the environment determines the quality of the visible image. This paper presents an infrared image and visual image fusion algorithm based on deep learning. Two identical feature extractors are used to extract the features of visible and infrared images of different scales, fuse these features through specific fusion methods, and restore the features of visible and infrared images to the pictures through the feature restorer to make up for the deficiencies in the various photos of infrared and visible images. This paper tests infrared visual images, multi-focus images, and other data sets. The traditional image fusion algorithm is compared several with the current advanced image fusion algorithm. The experimental results show that the image fusion method proposed in this paper can keep more feature information of the source image in the fused image, and achieve excellent results in some image evaluation indexes.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Action recognition algorithm based on multi-scale and multi-branch features
    Zhang Lei
    Han Guang-Liang
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2022, 37 (12) : 1614 - 1625
  • [2] Lung tumor image recognition algorithm with densenet fusion multi-scale images
    Zhou T.
    Huo B.-Q.
    Lu H.-L.
    Ma Z.-J.
    Ye X.-Y.
    Dong Y.-L.
    Liu S.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2021, 29 (07): : 1695 - 1708
  • [3] Skin Lesion Image Segmentation Algorithm Based on Multi-Scale DenseNet
    Yang Guoliang
    Lai Zhendong
    Wang Yang
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (18)
  • [4] MMUnet: medical image segmentation via multi-branch and multi-scale Unet
    Zheng, Kailiang
    Zhao, Li
    Zheng, Jianwei
    Chen, Huiling
    Zhang, Xiaoqin
    JOURNAL OF ELECTRONIC IMAGING, 2025, 34 (01)
  • [5] Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation
    Jiang, Yun
    Liu, Wenhuan
    Wu, Chao
    Yao, Huixiao
    SYMMETRY-BASEL, 2021, 13 (03): : 1 - 25
  • [6] Multi-branch CNN for Multi-scale Age Estimation
    Del Coco, Marco
    Carcagni, Pierluigi
    Leo, Marco
    Spagnolo, Paolo
    Mazzeo, Pier Luigi
    Distante, Cosimo
    IMAGE ANALYSIS AND PROCESSING (ICIAP 2017), PT II, 2017, 10485 : 234 - 244
  • [7] Deep Multi-Scale Feature Fusion Target Detection Algorithm Based on Deep Learning
    Liu Xin
    Chen Siyi
    Chen Xiaolong
    Du Xinhao
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (12)
  • [8] A Multi-Scale Image Enhancement Algorithm Based on Deep Learning and Illumination Compensation
    Jia, Dianru
    Yang, Jianju
    TRAITEMENT DU SIGNAL, 2022, 39 (01) : 179 - 185
  • [9] Deep learning-based compressed image artifacts reduction based on multi-scale image fusion
    Yeh, Chia-Hung
    Lin, Chu-Han
    Lin, Min-Hui
    Kang, Li-Wei
    Huang, Chih-Hsiang
    Chen, Mei-Juan
    INFORMATION FUSION, 2021, 67 (195-207) : 195 - 207
  • [10] Pruning Multi-Scale Multi-Branch Network for Small-Sample Hyperspectral Image Classification
    Bai, Yu
    Xu, Meng
    Zhang, Lili
    Liu, Yuxuan
    ELECTRONICS, 2023, 12 (03)