Infrared and Visible Image Fusion Technology and Application: A Review

被引:91
作者
Ma, Weihong [1 ]
Wang, Kun [2 ]
Li, Jiawei [1 ]
Yang, Simon X. [3 ]
Li, Junfei [3 ]
Song, Lepeng [2 ]
Li, Qifeng [1 ]
机构
[1] Beijing Acad Agr & Forestry Sci, Informat Technol Res Ctr, Beijing 100097, Peoples R China
[2] Chongqing Univ Sci & Technol, Sch Elect Engn, Chongqing 401331, Peoples R China
[3] Univ Guelph, Sch Engn, Adv Robot & Intelligent Syst Lab, Guelph, ON N1G 2W1, Canada
关键词
infrared and visible light image; image fusion; evaluation index; SHEARLET TRANSFORM; MULTI-FOCUS; INFORMATION; ALGORITHM; WAVELET; DECOMPOSITION; FRAMEWORK; NETWORK; DESIGN; NEST;
D O I
10.3390/s23020599
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The images acquired by a single visible light sensor are very susceptible to light conditions, weather changes, and other factors, while the images acquired by a single infrared light sensor generally have poor resolution, low contrast, low signal-to-noise ratio, and blurred visual effects. The fusion of visible and infrared light can avoid the disadvantages of two single sensors and, in fusing the advantages of both sensors, significantly improve the quality of the images. The fusion of infrared and visible images is widely used in agriculture, industry, medicine, and other fields. In this study, firstly, the architecture of mainstream infrared and visible image fusion technology and application was reviewed; secondly, the application status in robot vision, medical imaging, agricultural remote sensing, and industrial defect detection fields was discussed; thirdly, the evaluation indicators of the main image fusion methods were combined into the subjective evaluation and the objective evaluation, the properties of current mainstream technologies were then specifically analyzed and compared, and the outlook for image fusion was assessed; finally, infrared and visible image fusion was summarized. The results show that the definition and efficiency of the fused infrared and visible image had been improved significantly. However, there were still some problems, such as the poor accuracy of the fused image, and irretrievably lost pixels. There is a need to improve the adaptive design of the traditional algorithm parameters, to combine the innovation of the fusion algorithm and the optimization of the neural network, so as to further improve the image fusion accuracy, reduce noise interference, and improve the real-time performance of the algorithm.
引用
收藏
页数:23
相关论文
共 94 条
[1]   Two-scale image fusion of visible and infrared images using saliency detection [J].
Bavirisetti, Durga Prasad ;
Dhuli, Ravindra .
INFRARED PHYSICS & TECHNOLOGY, 2016, 76 :52-64
[2]   Spatiotemporal Image Fusion in Remote Sensing [J].
Belgiu, Mariana ;
Stein, Alfred .
REMOTE SENSING, 2019, 11 (07)
[3]   Privacy-aware supervised classification: An informative subspace based multi-objective approach [J].
Biswas, Chandan ;
Ganguly, Debasis ;
Mukherjee, Partha Sarathi ;
Bhattacharya, Ujjwal ;
Hou, Yufang .
PATTERN RECOGNITION, 2022, 122
[4]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[5]   Fusion of infrared and visible images based on nonsubsampled contourlet transform and sparse K-SVD dictionary learning [J].
Cai, Jiajun ;
Cheng, Qimin ;
Peng, Mingjun ;
Song, Yang .
INFRARED PHYSICS & TECHNOLOGY, 2017, 82 :85-95
[6]   Fusing concurrent visible and infrared videos for improved tracking performance [J].
Chan, Alex Lipchen ;
Schnelle, Stephen R. .
OPTICAL ENGINEERING, 2013, 52 (01)
[7]   End-to-End Ship Detection in SAR Images for Complex Scenes Based on Deep CNNs [J].
Chen, Yao ;
Duan, Tao ;
Wang, Changyuan ;
Zhang, Yuanyuan ;
Huang, Mo .
JOURNAL OF SENSORS, 2021, 2021
[8]   Defect inspection technologies for additive manufacturing [J].
Chen, Yao ;
Peng, Xing ;
Kong, Lingbao ;
Dong, Guangxi ;
Remani, Afaf ;
Leach, Richard .
INTERNATIONAL JOURNAL OF EXTREME MANUFACTURING, 2021, 3 (02)
[9]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797
[10]  
Cvejic N., 2006, Proc. IEEE 9th Int'l. conf. Information Fusion, V2, P1