DBSD: DUAL branches network using semantic and detail information for infrared and visible image fusion

被引:0
|
作者
Wang, Xuejiao [1 ]
Hua, Zhen [1 ,2 ]
Li, Jinjiang [1 ,2 ]
机构
[1] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Dual branches network; Semantic branch; Detail branch; Full-scale skip connections; CONNECTION;
D O I
10.1016/j.infrared.2023.104769
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Infrared and visible image fusion is of great importance in all-weather target detection and surveillance work. However, the existing fusion algorithms have problems such as missing information and vague details. Aiming at the above problems, this paper proposes a dual-branch fusion network based on semantic and detail information (DBSD). The dual-branch structure is used to fully acquire the structural and textural features of multi-modal images to obtain the images with complete features and clear details. The network adds multi -receptive blocks and large kernel blocks in semantic branches and uses full-scale skip connections to achieve multi-directional and multi-scale feature extraction. Densely connected blocks are used in detail branches to improve the reusability of features. The fusion block based on channel and spatial attention mechanisms is used to integrate multi-scale semantic and detail features to enhance key features in the fusion results. Through a series of experiments conducted on three publicly available datasets to verify the superiority of DBSD.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] DBIF: Dual-Branch Feature Extraction Network for Infrared and Visible Image Fusion
    Zhang, Haozhe
    Cui, Rongpu
    Zheng, Zhuohang
    Gao, Shaobing
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 309 - 323
  • [42] MCnet: Multiscale visible image and infrared image fusion network
    Sun, Le
    Li, Yuhang
    Zheng, Min
    Zhong, Zhaoyi
    Zhang, Yanchun
    SIGNAL PROCESSING, 2023, 208
  • [43] Infrared and Visible Image Fusion Method Based on Tikhonov Regularization and Detail Reconstruction
    Lu Xin
    Yang Lin
    Li Min
    Zhang Xuewu
    ACTA OPTICA SINICA, 2020, 40 (02)
  • [44] Significant target analysis and detail preserving based infrared and visible image fusion
    Yin, Wenxia
    He, Kangjian
    Xu, Dan
    Luo, Yueying
    Gong, Jian
    INFRARED PHYSICS & TECHNOLOGY, 2022, 121
  • [45] DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion
    Wu, Dan
    Han, Mina
    Yang, Yang
    Zhao, Shan
    Rao, Yujing
    Li, Hao
    Lin, Xing
    Zhou, Chengjiang
    Bai, Haicheng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [46] length A semantic-driven network for infrared and visible fusion
    Liu, Xiaowen
    Huo, Hongtao
    Li, Jing
    Pang, Shan
    Zheng, Bowen
    INFORMATION FUSION, 2024, 108
  • [47] A dual-modal semantic guidance and differential feature complementation fusion method for infrared and visible image
    Bao, Wenxia
    Feng, Zhijie
    Du, Yinlai
    Ling, Chong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [48] An Efficient Network Model for Visible and Infrared Image Fusion
    Pan, Zhu
    Ouyang, Wanqi
    IEEE ACCESS, 2023, 11 : 86413 - 86430
  • [49] Multigrained Attention Network for Infrared and Visible Image Fusion
    Li, Jing
    Huo, Hongtao
    Li, Chang
    Wang, Renhua
    Sui, Chenhong
    Liu, Zhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [50] CFNet: An infrared and visible image compression fusion network
    Xing, Mengliang
    Liu, Gang
    Tang, Haojie
    Qian, Yao
    Zhang, Jun
    PATTERN RECOGNITION, 2024, 156