ACFNet: An adaptive cross-fusion network for infrared and visible image fusion

被引:0
|
作者
Chen, Xiaoxuan [1 ]
Xu, Shuwen [2 ]
Hu, Shaohai [1 ]
Ma, Xiaole [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp Sci & Technol, Visual Intellgence Int Cooperat Joint Lab MOE X, Beijing 100044, Peoples R China
[2] Res Inst TV & Electroacoust, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Object detection; Auto-encoder; Global features; Adaptive fusion method;
D O I
10.1016/j.patcog.2024.111098
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Considering the prospects for image fusion, it is necessary to guide the fusion to adapt to downstream vision tasks. In this paper, we propose an Adaptive Cross-Fusion Network (ACFNet) that utilizes an adaptive approach to fuse infrared and visible images, addressing cross-modal differences to enhance object detection performance. In ACFNet, a hierarchical cross-fusion module is designed to enrich the features at each level of the reconstructed images. In addition, a special adaptive gating selection module is proposed to realize feature fusion in an adaptive manner so as to obtain fused images without the interference of manual design. Extensive qualitative and quantitative experiments have demonstrated that ACFNet is superior to current state-of-the-art fusion methods and achieves excellent results in preserving target information and texture details. The fusion framework, when combined with the object detection framework, has the potential to significantly improve the precision of object detection in low-light conditions.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] IDFusion: An Infrared and Visible Image Fusion Network for Illuminating Darkness
    Lv, Guohua
    Wang, Xiyan
    Wei, Zhonghe
    Cheng, Jinyong
    Ma, Guangxiao
    Bao, Hanju
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 3140 - 3145
  • [42] Unsupervised densely attention network for infrared and visible image fusion
    Li, Yang
    Wang, Jixiao
    Miao, Zhuang
    Wang, Jiabao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (45-46) : 34685 - 34696
  • [43] A Multilevel Hybrid Transmission Network for Infrared and Visible Image Fusion
    Li, Qingqing
    Han, Guangliang
    Liu, Peixun
    Yang, Hang
    Chen, Dianbing
    Sun, Xinglong
    Wu, Jiajia
    Liu, Dongxu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [44] Unsupervised densely attention network for infrared and visible image fusion
    Yang Li
    Jixiao Wang
    Zhuang Miao
    Jiabao Wang
    Multimedia Tools and Applications, 2020, 79 : 34685 - 34696
  • [45] Infrared and visible image fusion of convolutional neural network and NSST
    Huan K.
    Li X.
    Cao Y.
    Chen X.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (03):
  • [46] Multiscale channel attention network for infrared and visible image fusion
    Zhu, Jiahui
    Dou, Qingyu
    Jian, Lihua
    Liu, Kai
    Hussain, Farhan
    Yang, Xiaomin
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (22):
  • [47] A cross-fusion of non-local attention network for infrared small target tracking
    Fan, Qiang
    Zou, Erbo
    Tai, Yuan
    Lai, Rui
    He, Yizhou
    INFRARED PHYSICS & TECHNOLOGY, 2024, 141
  • [48] Adjustable Visible and Infrared Image Fusion
    Wu, Boxiong
    Nie, Jiangtao
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13463 - 13477
  • [49] RESTORABLE VISIBLE AND INFRARED IMAGE FUSION
    Kang, Jihun
    Horita, Daichi
    Tsubota, Koki
    Aizawa, Kiyoharu
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1560 - 1564
  • [50] Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network
    Zhang, Jianming
    Lei, Wenxin
    Li, Shuyang
    Li, Zongping
    Li, Xudong
    INFRARED PHYSICS & TECHNOLOGY, 2023, 131