DBSD: DUAL branches network using semantic and detail information for infrared and visible image fusion

被引:0
|
作者
Wang, Xuejiao [1 ]
Hua, Zhen [1 ,2 ]
Li, Jinjiang [1 ,2 ]
机构
[1] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Dual branches network; Semantic branch; Detail branch; Full-scale skip connections; CONNECTION;
D O I
10.1016/j.infrared.2023.104769
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Infrared and visible image fusion is of great importance in all-weather target detection and surveillance work. However, the existing fusion algorithms have problems such as missing information and vague details. Aiming at the above problems, this paper proposes a dual-branch fusion network based on semantic and detail information (DBSD). The dual-branch structure is used to fully acquire the structural and textural features of multi-modal images to obtain the images with complete features and clear details. The network adds multi -receptive blocks and large kernel blocks in semantic branches and uses full-scale skip connections to achieve multi-directional and multi-scale feature extraction. Densely connected blocks are used in detail branches to improve the reusability of features. The fusion block based on channel and spatial attention mechanisms is used to integrate multi-scale semantic and detail features to enhance key features in the fusion results. Through a series of experiments conducted on three publicly available datasets to verify the superiority of DBSD.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Infrared and Visible Image Fusion Using Detail Enhanced Channel Attention Network
    Cui, Yinghan
    Du, Huiqian
    Mei, Wenbo
    IEEE ACCESS, 2019, 7 : 182185 - 182197
  • [2] DSAFusion: Detail-semantic-aware network for infrared and low-light visible image fusion
    Xia, Menghan
    Lin, Cheng
    Xu, Biyun
    Li, Qian
    Fang, Hao
    Huang, Zhenghua
    INFRARED PHYSICS & TECHNOLOGY, 2025, 147
  • [3] DSFusion: Infrared and visible image fusion method combining detail and scene information
    Liu, Kuizhuang
    Li, Min
    Chen, Cheng
    Rao, Chengwei
    Zuo, Enguang
    Wang, Yunling
    Yan, Ziwei
    Wang, Bo
    Chen, Chen
    Lv, Xiaoyi
    PATTERN RECOGNITION, 2024, 154
  • [4] SIEFusion: Infrared and Visible Image Fusion via Semantic Information Enhancement
    Lv, Guohua
    Song, Wenkuo
    Wei, Zhonghe
    Cheng, Jinyong
    Dong, Aimei
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT III, 2024, 14427 : 176 - 187
  • [5] SIGFusion: Semantic Information-Guided Infrared and Visible Image Fusion
    Lv, Guohua
    Sima, Chaoqun
    Gao, Yongbiao
    Dong, Aimei
    Ma, Guangxiao
    Cheng, Jinyong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [6] Infrared and visible image fusion with edge detail implantation
    Liu, Junyu
    Zhang, Yafei
    Li, Fan
    FRONTIERS IN PHYSICS, 2023, 11
  • [7] A Dual-branch Network for Infrared and Visible Image Fusion
    Fu, Yu
    Wu, Xiao-Jun
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10675 - 10680
  • [8] SPGFUSION: A SEMANTIC PRIOR GUIDED INFRARED AND VISIBLE IMAGE FUSION NETWORK
    Xiao, Quanquan
    Jin, Haiyan
    Su, Haonan
    Zuo, Fengyuan
    Zhang, Yuanlin
    Xiao, Zhaolin
    Wang, Bin
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 2405 - 2409
  • [9] Distillation-fusion-semantic unified driven network for infrared and visible image fusion
    Jiang, Yang
    Li, Jiawei
    Liu, Jinyuan
    Lei, Jia
    Li, Chen
    Zhou, Shihua
    Kasabov, Nikola K.
    INFRARED PHYSICS & TECHNOLOGY, 2024, 137
  • [10] Semantic Guided Infrared and Visible Image Fusion
    Wu, Wei
    Zhang, Dazhi
    Hou, Jilei
    Wang, Yu
    Lu, Tao
    Zhou, Huabing
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2021, E104A (12) : 1733 - 1738