DBSD: DUAL branches network using semantic and detail information for infrared and visible image fusion

被引:0
|
作者
Wang, Xuejiao [1 ]
Hua, Zhen [1 ,2 ]
Li, Jinjiang [1 ,2 ]
机构
[1] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Dual branches network; Semantic branch; Detail branch; Full-scale skip connections; CONNECTION;
D O I
10.1016/j.infrared.2023.104769
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Infrared and visible image fusion is of great importance in all-weather target detection and surveillance work. However, the existing fusion algorithms have problems such as missing information and vague details. Aiming at the above problems, this paper proposes a dual-branch fusion network based on semantic and detail information (DBSD). The dual-branch structure is used to fully acquire the structural and textural features of multi-modal images to obtain the images with complete features and clear details. The network adds multi -receptive blocks and large kernel blocks in semantic branches and uses full-scale skip connections to achieve multi-directional and multi-scale feature extraction. Densely connected blocks are used in detail branches to improve the reusability of features. The fusion block based on channel and spatial attention mechanisms is used to integrate multi-scale semantic and detail features to enhance key features in the fusion results. Through a series of experiments conducted on three publicly available datasets to verify the superiority of DBSD.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] SDFuse: Semantic-injected dual-flow learning for infrared and visible image fusion
    Wang, Enlong
    Li, Jiawei
    Lei, Jia
    Liu, Jinyuan
    Zhou, Shihua
    Wang, Bin
    Kasabov, Nikola K.
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [32] A dual-branch infrared and visible image fusion network using progressive image-wise feature transfer
    Xu, Shaoping
    Zhou, Changfei
    Xiao, Jian
    Tao, Wuyong
    Dai, Tianyu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 102
  • [33] VISIBLE AND INFRARED IMAGE FUSION USING ENCODER-DECODER NETWORK
    Ataman, Ferhat Can
    Bozdagi Akar, Gozde
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1779 - 1783
  • [34] MSFNet: MultiStage Fusion Network for infrared and visible image fusion
    Wang, Chenwu
    Wu, Junsheng
    Zhu, Zhixiang
    Chen, Hao
    NEUROCOMPUTING, 2022, 507 : 26 - 39
  • [35] DSMGN: Dual-Supervised Mask Generation Network for Infrared and Visible Image Fusion
    Yang, Yong
    Xia, Yukun
    Huang, Shuying
    Wan, Weiguo
    Sun, Xuemei
    IEEE MULTIMEDIA, 2023, 30 (04) : 82 - 90
  • [36] Lightweight infrared and visible image fusion network with edge-guided dual attention
    Zou, Xingyue
    Tang, Jiqiang
    Yang, Luqi
    Zhu, Zhenhang
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (06) : 63014
  • [37] TDDFusion: A Target-Driven Dual Branch Network for Infrared and Visible Image Fusion
    Lu, Siyu
    Ye, Xiangzhou
    Rao, Junmin
    Li, Fanming
    Liu, Shijian
    SENSORS, 2024, 24 (01)
  • [38] MDAN: Multilevel dual-branch attention network for infrared and visible image fusion
    Wang, Jiawei
    Jiang, Min
    Kong, Jun
    OPTICS AND LASERS IN ENGINEERING, 2024, 176
  • [39] Infrared and Visible Image Fusion Based on Improved Dual Path Generation Adversarial Network
    Yang, Shen
    Tian, Lifan
    Liang, Jiaming
    Huang, Zefeng
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 3012 - 3021
  • [40] Dual-Attention-Based Feature Aggregation Network for Infrared and Visible Image Fusion
    Tang, Zhimin
    Xiao, Guobao
    Guo, Junwen
    Wang, Shiping
    Ma, Jiayi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72