Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain

被引:0
作者
Xu, Jiachang [1 ]
Hong, Ding [1 ]
Su, Shuzhi [1 ]
Fang, Ruichong [2 ]
Li, Hongjin [3 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Anhui, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Cyberspace Secur, Beijing 100876, Peoples R China
[3] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Sch Biomed Engn, Dalian 116024, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Neurons; Image fusion; Feature extraction; Data mining; Ignition; Visualization; Training; Dynamic threshold neural P (DTNP) system; image fusion; infrared and visible images; multiscale morphological gradient (MSMG); non-subsampled shearlet transform (NSST); NETWORK; NEST;
D O I
10.1109/TIM.2024.3460942
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion is the process of integrating information from multiple sensor images to obtain a comprehensive understanding. However, existing fusion algorithms face challenges in achieving high-quality fused images. In this article, a novel fusion framework based on saliency detection dynamic threshold neural P (SD-DTNP) systems is proposed. The non-subsampled shearlet transform (NSST) is first introduced to obtain key features at different scales and orientations. To overcome the disadvantage of visual saliency map (VSM)-based algorithms resulting in unnatural fused images, a novel fusion rule of the contrast saliency DTNP (CS-DTNP) system is designed to fuse the low-frequency sub-band. The high-frequency sub-bands are fused by combining the multiscale morphological gradient (MSMG) with the DTNP system, which can avoid the influence of noise and integrate more structural information. Experiments demonstrate that, compared with seven advanced fusion algorithms, the proposed algorithm not only improves the spatial consistency of the final image but also preserves the salient and detailed information.
引用
收藏
页数:13
相关论文
共 51 条
[1]   A new image quality metric for image fusion: The sum of the correlations of differences [J].
Aslantas, V. ;
Bendes, E. .
AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2015, 69 (12) :160-166
[2]  
Bhateja V., 2015, Int. J. Rough Sets Data Anal., V2, P78, DOI DOI 10.4018/IJRSDA.2015070105
[3]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[4]   MUFusion: A general unsupervised image fusion network based on memory unit [J].
Cheng, Chunyang ;
Xu, Tianyang ;
Wu, Xiao-Jun .
INFORMATION FUSION, 2023, 92 :80-92
[5]   Remote Sensing Images Fusion Algorithm Based on Shearlet Transform [J].
Deng, Chengzhi ;
Wang, Shengqian ;
Chen, Xi .
2009 INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND INFORMATION APPLICATION TECHNOLOGY, VOL III, PROCEEDINGS,, 2009, :451-454
[6]   Sparse directional image representations using the discrete shearlet transform [J].
Easley, Glenn ;
Labate, Demetrio ;
Lim, Wang-Q .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2008, 25 (01) :25-46
[7]   Contourlet and discrete cosine transform based quality guaranteed robust image watermarking method using artificial bee colony algorithm [J].
Gul, Ertugrul ;
Toprak, Ahmet Nusret .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 212
[8]  
Haghighat M, 2014, I C APPL INF COMM TE, P424
[9]   A new image fusion performance metric based on visual information fidelity [J].
Han, Yu ;
Cai, Yunze ;
Cao, Yin ;
Xu, Xiaoming .
INFORMATION FUSION, 2013, 14 (02) :127-135
[10]   An improved hybrid multiscale fusion algorithm based on NSST for infrared-visible images [J].
Hu, Peng ;
Wang, Chenjun ;
Li, Dequan ;
Zhao, Xin .
VISUAL COMPUTER, 2024, 40 (02) :1245-1259