Intelligent segmentation of wildfire region and interpretation of fire front in visible light images from the viewpoint of an unmanned aerial vehicle (UAV)

被引:0
作者
Li, Jianwei [1 ]
Wan, Jiali [1 ]
Sun, Long [2 ]
Hu, Tongxin [2 ]
Li, Xingdong [3 ]
Zheng, Huiru [4 ]
机构
[1] Fuzhou Univ, Coll Phys & Informat Engn, Fuzhou 350116, Peoples R China
[2] Northeast Forestry Univ, Coll Forestry, Key Lab Sustainable Forest Ecosyst Management, Harbin 150040, Peoples R China
[3] Northeast Forestry Univ, Coll Mech & Elect Engn, 26 Hexing Rd, Harbin 150040, Peoples R China
[4] Ulster Univ, Sch Comp, Belfast BT15 1ED, North Ireland
基金
中国博士后科学基金;
关键词
Attention mechanism; Convolutional neural network; Deep learning; Wildfire segmentation; Fire front interpretation; Unmanned aerial vehicle; ALGORITHM; SPREAD; YOLO;
D O I
10.1016/j.isprsjprs.2024.12.025
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
The acceleration of global warming and intensifying global climate anomalies have led to a rise in the frequency of wildfires. However, most existing research on wildfire fields focuses primarily on wildfire identification and prediction, with limited attention given to the intelligent interpretation of detailed information, such as fire front within fire region. To address this gap, advance the analysis of fire front in UAV-captured visible images, and facilitate future calculations of fire behavior parameters, a new method is proposed for the intelligent segmentation and fire front interpretation of wildfire regions. This proposed method comprises three key steps: deep learning-based fire segmentation, boundary tracking of wildfire regions, and fire front interpretation. Specifically, the YOLOv7-tiny model is enhanced with a Convolutional Block Attention Module (CBAM), which integrates channel and spatial attention mechanisms to improve the model's focus on wildfire regions and boost the segmentation precision. Experimental results show that the proposed method improved detection and segmentation precision by 3.8 % and 3.6 %, respectively, compared to existing approaches, and achieved an average segmentation frame rate of 64.72 Hz, which is well above the 30 Hz threshold required for real-time fire segmentation. Furthermore, the method's effectiveness in boundary tracking and fire front interpreting was validated using an outdoor grassland fire fusion experiment's real fire image data. Additional tests were conducted in southern New South Wales, Australia, using data that confirmed the robustness of the method in accurately interpreting the fire front. The findings of this research have potential applications in dynamic data-driven forest fire spread modeling and fire digital twinning areas. The code and dataset are publicly available at https://github.com/makemoneyokk/fire-segmentation-interpretation.git.
引用
收藏
页码:473 / 489
页数:17
相关论文
共 53 条
  • [1] Airborne Optical and Thermal Remote Sensing for Wildfire Detection and Monitoring
    Allison, Robert S.
    Johnston, Joshua M.
    Craig, Gregory
    Jennings, Sion
    [J]. SENSORS, 2016, 16 (08)
  • [2] EdgeFireSmoke plus plus : A novel lightweight algorithm for real-time forest fire detection and visualization using internet of things-human machine interface
    Almeida, Jefferson S.
    Jagatheesaperumal, Senthil Kumar
    Nogueira, Fabricio G.
    de Albuquerque, Victor Hugo C.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 221
  • [3] IC-GAN: An Improved Conditional Generative Adversarial Network for RGB-to-IR image translation with applications to forest fire monitoring
    Boroujeni, Sayed Pedram Haeri
    Razi, Abolfazl
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [4] Particle Image Velocimetry Based on a Deep Learning Motion Estimator
    Cai, Shengze
    Liang, Jiaming
    Gao, Qi
    Xu, Chao
    Wei, Runjie
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (06) : 3538 - 3554
  • [5] YOLO-SF: YOLO for Fire Segmentation Detection
    Cao, Xianghong
    Su, Yixuan
    Geng, Xin
    Wang, Yongdong
    [J]. IEEE ACCESS, 2023, 11 : 111079 - 111092
  • [6] Unprecedented wildfires in Korea: Historical evidence of increasing wildfire activity due to climate change
    Chang, Dong Yeong
    Jeong, Sujong
    Park, Chang-Eui
    Park, Hoonyoung
    Shin, Jaewon
    Bae, Yeon
    Park, Hayoung
    Park, Chan Ryul
    [J]. AGRICULTURAL AND FOREST METEOROLOGY, 2024, 348
  • [7] FlameTransNet: Advancing Forest Flame Segmentation with Fusion and Augmentation Techniques
    Chen, Beiqi
    Bai, Di
    Lin, Haifeng
    Jiao, Wanguo
    [J]. FORESTS, 2023, 14 (09):
  • [8] Fire identification based on improved multi feature fusion of YCbCr and regional growth
    Chen, Xijiang
    An, Qing
    Yu, Kegen
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 241
  • [9] A Novel Fire Identification Algorithm Based on Improved Color Segmentation and Enhanced Feature Data
    Chen, Xijiang
    An, Qing
    Yu, Kegen
    Ban, Ya
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [10] Methods and datasets on semantic segmentation for Unmanned Aerial Vehicle remote sensing images: A review
    Cheng, Jian
    Deng, Changjian
    Su, Yanzhou
    An, Zeyu
    Wang, Qi
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 211 : 1 - 34