Recent advances via convolutional sparse representation model for pixel-level image fusion

被引:4
作者
Pan, Yue [1 ]
Lan, Tianye [1 ]
Xu, Chongyang [1 ]
Zhang, Chengfang [2 ]
Feng, Ziliang [1 ]
机构
[1] Sichuan Univ, Coll Comp Sci, South 1 Ring Rd, Chengdu 610065, Sichuan, Peoples R China
[2] Sichuan Police Coll, Intelligent Policing Key Lab Sichuan Prov, 186 Longtouguan Rd, Luzhou 646000, Sichuan, Peoples R China
关键词
Image fusion; Convolutional sparse representation; Convolutional dictionary learning; Online convolutional sparse coding; Online convolutional dictionary learning; QUALITY ASSESSMENT; INFRARED IMAGE; MULTI-FOCUS; PERFORMANCE; INFORMATION; TRANSFORM; ALGORITHM;
D O I
10.1007/s11042-023-17584-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image fusion aims to integrate complementary information from different source images into the final output image. This plays a significant role in high-level vision tasks. However, image fusion methods based on sparse representation (SR) or conventional multiscale transform (MST) have some drawbacks that are difficult to overcome. As an alternative form of SR, convolutional sparse representation (CSR) has the advantages of detail preservation and shift-invariance, which can overcome the shortcomings of SR- and MST-based fusion methods. Since CSR has been widely used in the field of image fusion and has advanced this field to a great extent, it is necessary to conduct a comprehensive investigation of image fusion based on CSR. To the best of our knowledge, there are no previous papers reviewing and evaluating CSR-based fusion methods, and this study is the first retrospective. In this paper, we focus on CSR-based image fusion methods and review the recent advances in pixel-level image fusion based on CSR. In the experimental part of the paper, multifocal images, infrared-visible images, and multimodal medical images are used as test images to compare and evaluate the performance of different image fusion methods. In addition, the future trend of CSR-based image fusion is discussed. This paper is expected to serve as a resource of reference for both researchers and general learners seeking an overview of CSR-based image fusion.
引用
收藏
页码:52899 / 52930
页数:32
相关论文
共 107 条
[1]  
Babulal K.S., 2022, Deep Learning-Based Object Detection: An Investigation, P697
[2]   Real-Time Surveillance System for Detection of Social Distancing [J].
Babulal, Kanojia Sindhuben ;
Das, Amit Kumar ;
Kumar, Pushpendra ;
Rajput, Dharmendra Singh ;
Alam, Afroj ;
Obaid, Ahmed J. .
INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS, 2022, 13 (04)
[3]   From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images [J].
Bruckstein, Alfred M. ;
Donoho, David L. ;
Elad, Michael .
SIAM REVIEW, 2009, 51 (01) :34-81
[4]  
Cao Y., 2020, Navigation and Control, V19, P97
[5]  
[陈广秋 Chen Guangqiu], 2021, [吉林大学学报. 工学版, Journal of Jilin University. Engineering and Technology Edition], V51, P996
[6]   A new automated quality assessment algorithm for image fusion [J].
Chen, Yin ;
Blum, Rick S. .
IMAGE AND VISION COMPUTING, 2009, 27 (10) :1421-1432
[7]  
Chengfang Zhang, 2020, Recent Developments in Mechatronics and Intelligent Robotics. Proceedings of ICMIR 2019. Advances in Intelligent Systems and Computing (AISC 1060), P155, DOI 10.1007/978-981-15-0238-5_15
[8]  
Chipman LJ., 1995, Wavelets and image fusion. IEEE, V3, P248
[9]   Convolutional Dictionary Learning: Acceleration and Convergence [J].
Chun, Il Yong ;
Fessler, Jeffrey A. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :1697-1712
[10]  
Chun IY, 2017, Convergent convolutional dictionary learning using adaptive contrast enhancement (cdl-ace): Application of cdl to image denoising, P460