FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery

被引:22
作者
Ciprian-Sanchez, J. F. [1 ]
Ochoa-Ruiz, G. [2 ]
Gonzalez-Mendoza, M. [2 ]
Rossi, L. [3 ]
机构
[1] Tecnol Monterrey, Sch Engn & Sci, Av Lago Guadalupe KM 3-5, Margarita Maza De Juarez 52926, Cd Lopez Mateos, Mexico
[2] Tecnol Monterrey, Sch Engn & Sci, Av Eugenio Garza Sada 2501, Monterrey 64849, NL, Mexico
[3] Univ Corsica, Lab Sci Environm, Campus Grimaldi BP 52, F-20250 Corte, France
关键词
Image fusion; Fire; Wildfires; Deep learning; Visible; Infrared; COMPUTER VISION; NETWORK;
D O I
10.1007/s00521-021-06691-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. In this regard, the fusion of thermal and visible information into a single image can potentially increase the robustness and accuracy of wildfire detection models. In the field of visible-infrared image fusion, there is a growing interest in Deep Learning (DL)-based image fusion techniques due to their reduced complexity; however, the most DL-based image fusion methods have not been evaluated in the domain of fire imagery. Additionally, to the best of our knowledge, no publicly available dataset contains visible-infrared fused fire images. In the present work, we select three state-of-the-art (SOTA) DL-based image fusion techniques and evaluate them for the specific task of fire image fusion, and compare the performance of these methods on selected metrics. Finally, we also present an extension to one of the said methods, that we called FIRe-GAN, that improves the generation of artificial infrared and fused images.
引用
收藏
页码:18201 / 18213
页数:13
相关论文
共 24 条
[1]  
[Anonymous], The SSIM Index for Image Quality Assessment
[2]  
[Anonymous], INFRARED VISIBLE IMA
[3]  
[Anonymous], CODES FUSIONGAN GAN
[4]   An intelligent system for false alarm reduction in infrared forest-fire detection [J].
Arrue, BC ;
Ollero, A ;
de Dios, JRM .
IEEE INTELLIGENT SYSTEMS & THEIR APPLICATIONS, 2000, 15 (03) :64-73
[5]  
Brown M, 2011, PROC CVPR IEEE, P177, DOI 10.1109/CVPR.2011.5995637
[6]   Video fire detection - Review [J].
Cetin, A. Enis ;
Dimitropoulos, Kosmas ;
Gouverneur, Benedict ;
Grammalidis, Nikos ;
Gunay, Osman ;
Habiboglu, Y. Hakan ;
Toreyin, B. Ugur ;
Verstockt, Steven .
DIGITAL SIGNAL PROCESSING, 2013, 23 (06) :1827-1843
[7]   Computer vision techniques for forest fire perception [J].
Dios, J. R. Martinez-de ;
Arrue, B. C. ;
Ollero, A. ;
Merino, L. ;
Gomez-Rodriguez, F. .
IMAGE AND VISION COMPUTING, 2008, 26 (04) :550-562
[8]  
Feng R, 2020, IMAGE DECOMPOSITION
[9]  
Heusel Martin, 2017, ADV NEURAL INFORM PR
[10]  
ISOLA P, 2017, PROC CVPR IEEE, P5967, DOI DOI 10.1109/CVPR.2017.632