Recent advances via convolutional sparse representation model for pixel-level image fusion

被引:4
作者
Pan, Yue [1 ]
Lan, Tianye [1 ]
Xu, Chongyang [1 ]
Zhang, Chengfang [2 ]
Feng, Ziliang [1 ]
机构
[1] Sichuan Univ, Coll Comp Sci, South 1 Ring Rd, Chengdu 610065, Sichuan, Peoples R China
[2] Sichuan Police Coll, Intelligent Policing Key Lab Sichuan Prov, 186 Longtouguan Rd, Luzhou 646000, Sichuan, Peoples R China
关键词
Image fusion; Convolutional sparse representation; Convolutional dictionary learning; Online convolutional sparse coding; Online convolutional dictionary learning; QUALITY ASSESSMENT; INFRARED IMAGE; MULTI-FOCUS; PERFORMANCE; INFORMATION; TRANSFORM; ALGORITHM;
D O I
10.1007/s11042-023-17584-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image fusion aims to integrate complementary information from different source images into the final output image. This plays a significant role in high-level vision tasks. However, image fusion methods based on sparse representation (SR) or conventional multiscale transform (MST) have some drawbacks that are difficult to overcome. As an alternative form of SR, convolutional sparse representation (CSR) has the advantages of detail preservation and shift-invariance, which can overcome the shortcomings of SR- and MST-based fusion methods. Since CSR has been widely used in the field of image fusion and has advanced this field to a great extent, it is necessary to conduct a comprehensive investigation of image fusion based on CSR. To the best of our knowledge, there are no previous papers reviewing and evaluating CSR-based fusion methods, and this study is the first retrospective. In this paper, we focus on CSR-based image fusion methods and review the recent advances in pixel-level image fusion based on CSR. In the experimental part of the paper, multifocal images, infrared-visible images, and multimodal medical images are used as test images to compare and evaluate the performance of different image fusion methods. In addition, the future trend of CSR-based image fusion is discussed. This paper is expected to serve as a resource of reference for both researchers and general learners seeking an overview of CSR-based image fusion.
引用
收藏
页码:52899 / 52930
页数:32
相关论文
共 107 条
[41]   Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study [J].
Liu, Zheng ;
Blasch, Erik ;
Xue, Zhiyun ;
Zhao, Jiying ;
Laganiere, Robert ;
Wu, Wei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (01) :94-109
[42]   Fusion of visible and infrared image via compressive sensing using convolutional sparse representation [J].
Nirmalraj, S. ;
Nagarajan, G. .
ICT EXPRESS, 2021, 7 (03) :350-354
[43]   A wavelet-based image fusion tutorial [J].
Pajares, G ;
de la Cruz, JM .
PATTERN RECOGNITION, 2004, 37 (09) :1855-1872
[44]  
Papyan V, 2017, Convolutional dictionary learning via local processing, P5296
[45]  
Papyan V, 2017, J MACH LEARN RES, V18, P1
[46]  
Pawar GA, 2019, Multi focal image fusion with convolutional sparse representation and stationary wavelet transform, P865
[47]   Infrared and Visible Image Fusion Method Based on Rolling Guidance Filter and Convolution Sparse Representation [J].
Pei Peipei ;
Yang Yanchun ;
Dang Jianwu ;
Wang Yangping .
LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (12)
[48]  
Piella G, 2003, A new quality metric for image fusion, V3
[49]  
Plaut E, 2018, Matching pursuit based convolutional sparse coding, P6847
[50]   Hematological image analysis for segmentation and characterization of erythrocytes using FC-TriSDR [J].
Priyanka ;
Babulal, Kanojia Sindhuben .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (05) :7861-7886