EdgeFusion: Infrared and Visible Image Fusion Algorithm in Low Light

被引:0
作者
Song, Zikun [1 ]
Qin, Pinle [1 ]
Zeng, Jianchao [1 ]
Zhai, Shuangjiao [1 ]
Chai, Rui [1 ]
Yan, Junyi [1 ]
机构
[1] North Univ China, Taiyuan, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT I | 2024年 / 14425卷
关键词
Image fusion; Convolution network; Multiscale gradient retention module; MULTISCALE DECOMPOSITION; NETWORK; NEST;
D O I
10.1007/978-981-99-8429-9_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Under low-light conditions, visible light imaging technology exhibits poor imaging performance, whereas infrared thermal imaging technology can effectively detect and identify targets. To solve the target imaging problem in low-light environments, multimodal image fusion technology can combine the advantages of both aforementioned methods. Existing fusion methods focus excessively on information from infrared images, obscuring the original texture details of the targets and resulting in low-quality images. Therefore, in this study, we propose a multiscale edge-fusion network for infrared and visible images called EdgeFusion, which can produce an edge-fusion image. Specifically, the network utilises infrared multiscale gradient information to enhance the edges of the thermal targets, thereby improving the ability to identify them. By designing a balanced loss, EdgeFusion suppresses the global information from infrared images that obscured the fine texture details of the original images. In addition, a residual gradient method is introduced to enhance the textural details of the generated images. After extensive experimentation on the public datasets LLVIP and TNO, the results indicate that EdgeFusion outperforms existing state-of-the-art methods in preserving fine-grained infrared edges and enhanced image texture details.
引用
收藏
页码:259 / 270
页数:12
相关论文
共 24 条
[1]  
Das S, 2000, TRANSPORT RES REC, P40
[2]   From Multi-Scale Decomposition to Non-Multi-Scale Decomposition Methods: A Comprehensive Survey of Image Fusion Techniques and Its Applications [J].
Dogra, Ayush ;
Goyal, Bhawna ;
Agrawal, Sunil .
IEEE ACCESS, 2017, 5 :16040-16067
[3]  
Ha Q, 2017, IEEE INT C INT ROBOT, P5108, DOI 10.1109/IROS.2017.8206396
[4]   LLVIP: A Visible-infrared Paired Dataset for Low-light Vision [J].
Jia, Xinyu ;
Zhu, Chuang ;
Li, Minzhen ;
Tang, Wenqi ;
Zhou, Wenli .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :3489-3497
[5]   RFN-Nest: An end-to-end residual fusion network for infrared and visible images [J].
Li, Hui ;
Wu, Xiao-Jun ;
Kittler, Josef .
INFORMATION FUSION, 2021, 73 :72-86
[6]   NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models [J].
Li, Hui ;
Wu, Xiao-Jun ;
Durrani, Tariq .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (12) :9645-9656
[7]   Fast infrared and visible image fusion with structural decomposition [J].
Li, Hui ;
Qi, Xianbiao ;
Xie, Wuyuan .
KNOWLEDGE-BASED SYSTEMS, 2020, 204
[8]   Infrared and visible image fusion with ResNet and zero-phase component analysis [J].
Li, Hui ;
Wu, Xiao-jun ;
Durrani, Tariq S. .
INFRARED PHYSICS & TECHNOLOGY, 2019, 102
[9]  
Liu D, 2018, Arxiv, DOI arXiv:1706.04284
[10]   RXDNFuse: A aggregated residual dense network for infrared and visible image fusion [J].
Long, Yongzhi ;
Jia, Haitao ;
Zhong, Yida ;
Jiang, Yadong ;
Jia, Yuming .
INFORMATION FUSION, 2021, 69 :128-141