DFOSfusion: Infrared and visible image fusion based on multi-scale dynamic feature optimization

被引:0
作者
Ruan, Mianyao [1 ]
Liu, Gang [1 ]
Xing, Mengliang [1 ]
Xiao, Gang [2 ]
Xu, Hanlin [1 ]
Zhang, Xingfei [1 ]
机构
[1] Shanghai Univ Elect Power, Sch Automat Engn, Shanghai 200090, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Aeronaut & Astronaut, Shanghai 200030, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-scale dense blocks; Dynamic feature optimization system; Deep learning;
D O I
10.1016/j.neucom.2025.130321
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid advancement of deep learning technology, significant progress has been made in image fusion, which is crucial for applications like surveillance, remote sensing, and medical imaging. However, most existing methods fail to fully extract and optimize multi-scale features, often lacking fine detail preservation, global consistency, and effective redundancy minimization, thus limiting overall visual quality. In this paper, we introduce DFOSfusion, an innovative image fusion framework specifically designed to address these challenges. DFOSfusion combines Multi-Scale Dense Blocks (MSD) with a Dynamic Feature Optimization System (DFOS), where the MSD module captures multi-scale local details, and the DFOS dynamically enhances global features via cross-layer spatial and channel optimization, effectively minimizing redundancy and promoting feature consistency. An adaptive texture-aware loss function further ensures that texture and structural details are consistently preserved during the fusion process. Extensive experiments reveal that DFOSfusion not only delivers superior visual quality but also consistently outperforms state-of-the-art methods, excelling in feature optimization and image coherence across multiple challenging benchmark datasets.
引用
收藏
页数:13
相关论文
共 38 条
[1]  
Ali A., 2023, Biomed. Signal Process. Control., V81, DOI [10.1016/j.bspc.2022.104463, DOI 10.1016/J.BSPC.2022.104463]
[2]  
Ali A., 2023, Biomed. Signal Process. Control., V81, DOI [10.1016/j.bspc.2022.104435, DOI 10.1016/J.BSPC.2022.104435]
[3]   Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting [J].
Chen, Jun ;
Li, Xuejiao ;
Luo, Linbo ;
Ma, Jiayi .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :655-667
[4]  
Cheng M., 2020, IEEE Trans. Image Process., V29, P454
[5]  
Fu H., 2021, IEEE Trans. Image Process., V30, P2336
[6]  
Guo J., 2022, IEEE Trans. Image Process., V31, P1294
[7]  
He K., 2021, IEEE Trans. Pattern Anal. Mach. Intell., V43, P1947
[8]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[9]  
Huang G., 2019, IEEE Trans. Pattern Anal. Mach. Intell., V41, P646
[10]   Medical Imaging Fusion Techniques: A Survey Benchmark Analysis, Open Challenges and Recommendations [J].
Khan, Sajid Ali ;
Khan, Muhammad Attique ;
Song, Oh-Young ;
Nazir, Muhammad .
JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2020, 10 (11) :2523-2531