Image fusion algorithm based on unsupervised deep learning-optimized sparse representation

被引:17
作者
An, Feng-Ping [1 ,2 ]
Ma, Xing-min [3 ]
Bai, Lei [4 ]
机构
[1] Huaiyin Normal Univ, Sch Phys & Elect Elect Engn, Huaian 223300, JS, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, BJ, Peoples R China
[3] China Elect Technol Grp Corp, 15th Res Inst, Beijing 100083, BJ, Peoples R China
[4] North China Inst Sci & Technol, Sch Comp, Beijing 100081, BJ, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Image fusion; Unsupervised; Deep learning; Optimized sparse representation; Over-complete dictionary learning; CONVOLUTIONAL NEURAL-NETWORK; CNN;
D O I
10.1016/j.bspc.2021.103140
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The image fusion method based on deep learning has problems such as the supervised learning of the model, the edge and noise of the fused image, and the setting of the image fusion weight map. To solve these problems, this paper proposes an end-to-end unsupervised deep learning model that performs one-to-many focus image fusion. It solves the training problem encountered by supervised deep learning models while avoiding the unreasonable image fusion weight maps. In addition, this paper proposes an optimized sparse representation method that divides an image into a target area and a background area. Then, it uses super complete dictionary learning to obtain a sparse representation of the image background area. This approach makes the proposed unsupervised deep learning image fusion method robust to noise. Finally, using this method to carry out image fusion experiments, the results show that the quality evaluation indicators of the fused image obtained by this method substantially outperform those of both mainstream machine learning and deep learning image fusion methods.
引用
收藏
页数:10
相关论文
共 36 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   Ensemble of CNN for multi-focus image fusion [J].
Amin-Naji, Mostafa ;
Aghagolzadeh, Ali ;
Ezoji, Mehdi .
INFORMATION FUSION, 2019, 51 :201-214
[3]   Transmitter beamforming and weighted image fusion-based multiple signal classification algorithm for corrosion monitoring [J].
Bao, Qiao ;
Yuan, Shenfang ;
Guo, Fangyu ;
Qiu, Lei .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2019, 18 (02) :621-634
[4]   Robust Multi-Focus Image Fusion Using Edge Model and Multi-Matting [J].
Chen, Yibo ;
Guan, Jingwei ;
Cham, Wai-Kuen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) :1526-1541
[5]   Multi-focus image fusion with the all convolutional neural network [J].
Du C.-B. ;
Gao S.-S. .
Optoelectronics Letters, 2018, 14 (01) :71-75
[6]   Multi-focus image fusion using Content Adaptive Blurring [J].
Farid, Muhammad Shahid ;
Mahmood, Arif ;
Al-Maadeed, Somaya Ali .
INFORMATION FUSION, 2019, 45 :96-112
[7]   A new image fusion performance metric based on visual information fidelity [J].
Han, Yu ;
Cai, Yunze ;
Cao, Yin ;
Xu, Xiaoming .
INFORMATION FUSION, 2013, 14 (02) :127-135
[8]   Convolutional neural network-based multimodal image fusion via similarity learning in the shearlet domain [J].
Hermessi, Haithem ;
Mourali, Olfa ;
Zagrouba, Ezzeddine .
NEURAL COMPUTING & APPLICATIONS, 2018, 30 (07) :2029-2045
[9]  
Hinneburg A., 1998, Proceedings Fourth International Conference on Knowledge Discovery and Data Mining, P58
[10]   Multi-scale image fusion through rolling guidance filter [J].
Jian, Lihua ;
Yang, Xiaomin ;
Zhou, Zhili ;
Zhou, Kai ;
Liu, Kai .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 83 :310-325