Recent advances via convolutional sparse representation model for pixel-level image fusion

被引:4
作者
Pan, Yue [1 ]
Lan, Tianye [1 ]
Xu, Chongyang [1 ]
Zhang, Chengfang [2 ]
Feng, Ziliang [1 ]
机构
[1] Sichuan Univ, Coll Comp Sci, South 1 Ring Rd, Chengdu 610065, Sichuan, Peoples R China
[2] Sichuan Police Coll, Intelligent Policing Key Lab Sichuan Prov, 186 Longtouguan Rd, Luzhou 646000, Sichuan, Peoples R China
关键词
Image fusion; Convolutional sparse representation; Convolutional dictionary learning; Online convolutional sparse coding; Online convolutional dictionary learning; QUALITY ASSESSMENT; INFRARED IMAGE; MULTI-FOCUS; PERFORMANCE; INFORMATION; TRANSFORM; ALGORITHM;
D O I
10.1007/s11042-023-17584-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image fusion aims to integrate complementary information from different source images into the final output image. This plays a significant role in high-level vision tasks. However, image fusion methods based on sparse representation (SR) or conventional multiscale transform (MST) have some drawbacks that are difficult to overcome. As an alternative form of SR, convolutional sparse representation (CSR) has the advantages of detail preservation and shift-invariance, which can overcome the shortcomings of SR- and MST-based fusion methods. Since CSR has been widely used in the field of image fusion and has advanced this field to a great extent, it is necessary to conduct a comprehensive investigation of image fusion based on CSR. To the best of our knowledge, there are no previous papers reviewing and evaluating CSR-based fusion methods, and this study is the first retrospective. In this paper, we focus on CSR-based image fusion methods and review the recent advances in pixel-level image fusion based on CSR. In the experimental part of the paper, multifocal images, infrared-visible images, and multimodal medical images are used as test images to compare and evaluate the performance of different image fusion methods. In addition, the future trend of CSR-based image fusion is discussed. This paper is expected to serve as a resource of reference for both researchers and general learners seeking an overview of CSR-based image fusion.
引用
收藏
页码:52899 / 52930
页数:32
相关论文
共 107 条
[51]  
Qiu C, 2020, Space Med Med Eng
[52]   Information measure for performance of image fusion [J].
Qu, GH ;
Zhang, DL ;
Yan, PF .
ELECTRONICS LETTERS, 2002, 38 (07) :313-315
[53]   Dictionaries for Sparse Representation Modeling [J].
Rubinstein, Ron ;
Bruckstein, Alfred M. ;
Elad, Michael .
PROCEEDINGS OF THE IEEE, 2010, 98 (06) :1045-1057
[54]  
Shao L, 2020, Infrared and visible image fusion based on spatial convolution sparse representation, V1634
[55]   Categorical Data Clustering Using Harmony Search Algorithm for Healthcare Datasets [J].
Sharma, Abha ;
Kumar, Pushpendra ;
Babulal, Kanojia Sindhuben ;
Obaid, Ahmed J. ;
Patel, Harshita .
INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS, 2022, 13 (04)
[56]  
Shen S, 2021, Multimodal image fusion based on improved pulse coupled neural network and convolutional sparse representation in nsst domain, V5, P1295
[57]   Morphological Component Analysis-Based Perceptual Medical Image Fusion Using Convolutional Sparsity-Motivated PCNN [J].
Tian, Chuangeng ;
Tang, Lu ;
Li, Xiao ;
Liu, Kaili ;
Wang, Jian .
SCIENTIFIC PROGRAMMING, 2021, 2021 (2021)
[58]  
Veshki FG, 2022, Coupled feature learning via structured convolutional sparse coding for multimodal image fusion, P2500
[59]   Image Fusion Using Adjustable Non-subsampled Shearlet Transform [J].
Vishwakarma, Amit ;
Bhuyan, M. K. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2019, 68 (09) :3367-3378
[60]   Multifocus image fusion based on robust principal component analysis [J].
Wan, Tao ;
Zhu, Chenchen ;
Qin, Zengchang .
PATTERN RECOGNITION LETTERS, 2013, 34 (09) :1001-1008