Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain

被引:0
|
作者
Xu, Jiachang [1 ]
Hong, Ding [1 ]
Su, Shuzhi [1 ]
Fang, Ruichong [2 ]
Li, Hongjin [3 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Anhui, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Cyberspace Secur, Beijing 100876, Peoples R China
[3] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Sch Biomed Engn, Dalian 116024, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Neurons; Image fusion; Feature extraction; Data mining; Ignition; Visualization; Training; Dynamic threshold neural P (DTNP) system; image fusion; infrared and visible images; multiscale morphological gradient (MSMG); non-subsampled shearlet transform (NSST); NETWORK; NEST;
D O I
10.1109/TIM.2024.3460942
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion is the process of integrating information from multiple sensor images to obtain a comprehensive understanding. However, existing fusion algorithms face challenges in achieving high-quality fused images. In this article, a novel fusion framework based on saliency detection dynamic threshold neural P (SD-DTNP) systems is proposed. The non-subsampled shearlet transform (NSST) is first introduced to obtain key features at different scales and orientations. To overcome the disadvantage of visual saliency map (VSM)-based algorithms resulting in unnatural fused images, a novel fusion rule of the contrast saliency DTNP (CS-DTNP) system is designed to fuse the low-frequency sub-band. The high-frequency sub-bands are fused by combining the multiscale morphological gradient (MSMG) with the DTNP system, which can avoid the influence of noise and integrate more structural information. Experiments demonstrate that, compared with seven advanced fusion algorithms, the proposed algorithm not only improves the spatial consistency of the final image but also preserves the salient and detailed information.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Infrared and Visible Image Fusion Based on Different Constraints in the Non-Subsampled Shearlet Transform Domain
    Huang, Yan
    Bi, Duyan
    Wu, Dongpeng
    SENSORS, 2018, 18 (04)
  • [2] A fusion algorithm for infrared and visible images based on saliency analysis and non-subsampled Shearlet transform
    Zhang Baohua
    Lu Xiaoqi
    Pei Haiquan
    Zhao Ying
    INFRARED PHYSICS & TECHNOLOGY, 2015, 73 : 286 - 297
  • [3] Technique for infrared and visible image fusion based on non-subsampled shearlet transform and spiking cortical model
    Kong, Weiwei
    Wang, Binghe
    Lei, Yang
    INFRARED PHYSICS & TECHNOLOGY, 2015, 71 : 87 - 98
  • [4] Remote sensing image fusion in the non-subsampled shearlet transform domain
    Xiong Z.
    Liu M.
    Guo Q.
    Li A.
    Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 2022, 43 (02): : 290 - 297
  • [5] Infrared and visible light images fusion algorithm based on non-subsampled Shearlet transform
    Gao, Guorong
    Liu, Yanping
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2014, 45 (03): : 268 - 274
  • [6] Infrared and visible images fusion using visual saliency and optimized spiking cortical model in non-subsampled shearlet transform domain
    Hou, Ruichao
    Nie, Rencan
    Zhou, Dongming
    Cao, Jinde
    Liu, Dong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (20) : 28609 - 28632
  • [7] Infrared and visible images fusion using visual saliency and optimized spiking cortical model in non-subsampled shearlet transform domain
    Ruichao Hou
    Rencan Nie
    Dongming Zhou
    Jinde Cao
    Dong Liu
    Multimedia Tools and Applications, 2019, 78 : 28609 - 28632
  • [8] A novel Image Fusion Framework based on Non-Subsampled Shearlet Transform (NSST) Domain
    Li, Penghua
    Wang, Huan
    Li, Xiaofei
    Hu, Hexu
    Wei, Hongyan
    Yuan, Yupeng
    Zhang, Zuwei
    Qi, Guanqiu
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 1409 - 1414
  • [9] INFRARED AND VISIBLE IMAGE FUSION BASED ON OBJECT EXTRACTION AND ADAPTIVE PULSE COUPLED NEURAL NETWORK VIA NON-SUBSAMPLED SHEARLET TRANSFORM
    Sun Wei
    Hu Shaohai
    Liu Shuaiqi
    Sun Yuchao
    2014 12TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2014, : 946 - 951
  • [10] FPGA Implementation of Non-Subsampled Shearlet Transform for Image Fusion
    Bhaskar, P. C.
    Munde, V. R.
    2017 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, CONTROL AND AUTOMATION (ICCUBEA), 2017,