Image fusion algorithm based on unsupervised deep learning-optimized sparse representation

被引:16
|
作者
An, Feng-Ping [1 ,2 ]
Ma, Xing-min [3 ]
Bai, Lei [4 ]
机构
[1] Huaiyin Normal Univ, Sch Phys & Elect Elect Engn, Huaian 223300, JS, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, BJ, Peoples R China
[3] China Elect Technol Grp Corp, 15th Res Inst, Beijing 100083, BJ, Peoples R China
[4] North China Inst Sci & Technol, Sch Comp, Beijing 100081, BJ, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Image fusion; Unsupervised; Deep learning; Optimized sparse representation; Over-complete dictionary learning; CONVOLUTIONAL NEURAL-NETWORK; CNN;
D O I
10.1016/j.bspc.2021.103140
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The image fusion method based on deep learning has problems such as the supervised learning of the model, the edge and noise of the fused image, and the setting of the image fusion weight map. To solve these problems, this paper proposes an end-to-end unsupervised deep learning model that performs one-to-many focus image fusion. It solves the training problem encountered by supervised deep learning models while avoiding the unreasonable image fusion weight maps. In addition, this paper proposes an optimized sparse representation method that divides an image into a target area and a background area. Then, it uses super complete dictionary learning to obtain a sparse representation of the image background area. This approach makes the proposed unsupervised deep learning image fusion method robust to noise. Finally, using this method to carry out image fusion experiments, the results show that the quality evaluation indicators of the fused image obtained by this method substantially outperform those of both mainstream machine learning and deep learning image fusion methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Unsupervised Infrared Image and Visible Image Fusion Algorithm Based on Deep Learning
    Chen Guoyang
    Wu Xiaojun
    Xu Tianyang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (04)
  • [2] Image classification algorithm based on stacked sparse coding deep learning model-optimized kernel function nonnegative sparse representation
    An, Fengping
    SOFT COMPUTING, 2020, 24 (22) : 16967 - 16981
  • [3] Image classification algorithm based on stacked sparse coding deep learning model-optimized kernel function nonnegative sparse representation
    Fengping An
    Soft Computing, 2020, 24 : 16967 - 16981
  • [4] Optimized Projections for Generalized Joint Sparse Representation based Image Fusion
    Zhang, Qiheng
    Yun, Hongquan
    Ju, Wen
    Xu, Li
    Lu, Zhengkun
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 4934 - 4938
  • [5] An Unsupervised Monocular Image Depth Prediction Algorithm Based on Multiple Loss Deep Learning
    Tang, Xiaojiao
    Chen, Lifang
    IEEE ACCESS, 2019, 7 : 162405 - 162414
  • [6] An image fusion method with sparse representation based on genetic algorithm optimization
    Zhao X.-J.
    Li Y.-Z.
    Lei S.-Y.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2016, 39 (02): : 73 - 76and87
  • [7] SAR and Multispectral Image Fusion Algorithm Based on Sparse Representation and NSST
    Liu, Kaixuan
    Li, Yufeng
    2ND INTERNATIONAL CONFERENCE ON GREEN ENERGY AND SUSTAINABLE DEVELOPMENT (GESD 2019), 2019, 2122
  • [8] Remote Sensing Image Fusion Based on Dictionary Learning and Sparse Representation
    Yin, Fei
    Cao, Shuhua
    Xu, Xiaojie
    2019 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2019, 11321
  • [9] A feature representation of sketch based on fusion of sparse coding and deep learning
    Zhao P.
    Gao J.-C.
    Feng C.-C.
    Han L.
    Kongzhi yu Juece/Control and Decision, 2021, 36 (03): : 699 - 704
  • [10] Image fusion based on Bandelet and Sparse Representation
    Zhang Jiuxing
    Zhang Wei
    Li Xuzhi
    NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615