Image fusion algorithm based on unsupervised deep learning-optimized sparse representation

被引:16
作者
An, Feng-Ping [1 ,2 ]
Ma, Xing-min [3 ]
Bai, Lei [4 ]
机构
[1] Huaiyin Normal Univ, Sch Phys & Elect Elect Engn, Huaian 223300, JS, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, BJ, Peoples R China
[3] China Elect Technol Grp Corp, 15th Res Inst, Beijing 100083, BJ, Peoples R China
[4] North China Inst Sci & Technol, Sch Comp, Beijing 100081, BJ, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Image fusion; Unsupervised; Deep learning; Optimized sparse representation; Over-complete dictionary learning; CONVOLUTIONAL NEURAL-NETWORK; CNN;
D O I
10.1016/j.bspc.2021.103140
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The image fusion method based on deep learning has problems such as the supervised learning of the model, the edge and noise of the fused image, and the setting of the image fusion weight map. To solve these problems, this paper proposes an end-to-end unsupervised deep learning model that performs one-to-many focus image fusion. It solves the training problem encountered by supervised deep learning models while avoiding the unreasonable image fusion weight maps. In addition, this paper proposes an optimized sparse representation method that divides an image into a target area and a background area. Then, it uses super complete dictionary learning to obtain a sparse representation of the image background area. This approach makes the proposed unsupervised deep learning image fusion method robust to noise. Finally, using this method to carry out image fusion experiments, the results show that the quality evaluation indicators of the fused image obtained by this method substantially outperform those of both mainstream machine learning and deep learning image fusion methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation
    Wei, Qi
    Bioucas-Dias, Jose
    Dobigeon, Nicolas
    Tourneret, Jean-Yves
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (07): : 3658 - 3668
  • [22] Deep Learning Based Face Recognition with Sparse Representation Classification
    Cheng, Eric-Juwei
    Prasad, Mukesh
    Puthal, Deepak
    Sharma, Nabin
    Prasad, Om Kumar
    Chin, Po-Hao
    Lin, Chin-Teng
    Blumenstein, Michael
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT III, 2017, 10636 : 665 - 674
  • [23] Remote Sensing Image Fusion Based on Structured Dictionary Learning and Joint Sparse Representation
    Li, Xinyi
    Wang, Jun
    Ai, Na
    Zhang, Yongqin
    Peng, Jinye
    [J]. PROCEEDINGS OF THE 2017 12TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2017, : 1200 - 1205
  • [24] Image fusion algorithm for traffic accident rescue based on deep learning
    Jiang S.
    Wang P.-L.
    Deng Z.-J.
    Bie Y.-M.
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (12): : 3472 - 3480
  • [25] A multi-source image fusion algorithm based on gradient regularized convolution sparse representation
    WANG Jian
    QIN Chunxia
    ZHANG Xiufei
    YANG Ke
    REN Ping
    [J]. Journal of Systems Engineering and Electronics, 2020, 31 (03) : 447 - 459
  • [26] A multi-source image fusion algorithm based on gradient regularized convolution sparse representation
    Wang Jian
    Qin Chunxia
    Zhang Xiufei
    Yang Ke
    Ren Ping
    [J]. JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2020, 31 (03) : 447 - 459
  • [27] Improved Fusion Algorithm for Infrared and Visible Images Based on Image Enhancement and Convolutional Sparse Representation
    Zhu, Rong
    Zheng, Wan-bo
    Wang, Yao
    Tan, Chun-lin
    [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2025, 45 (02) : 558 - 568
  • [28] Image Classification Algorithm Based on Proposal Region Clustering Learning-Unsupervised Deep Learning
    Lei Li
    Xiao-li Yin
    [J]. Journal of Electrical Engineering & Technology, 2023, 18 : 1337 - 1349
  • [29] Image Fusion With Convolutional Sparse Representation
    Liu, Yu
    Chen, Xun
    Ward, Rabab K.
    Wang, Z. Jane
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (12) : 1882 - 1886
  • [30] Image Colorization Algorithm Based on Deep Learning
    Wang, Na
    Chen, Guo-Dong
    Tian, Ying
    [J]. SYMMETRY-BASEL, 2022, 14 (11):