An efficient deep learning architecture for effective fire detection in smart surveillance

被引:12
|
作者
Yar, Hikmat [1 ]
Khan, Zulfiqar Ahmad [1 ]
Rida, Imad [2 ]
Ullah, Waseem [1 ]
Kim, Min Je [1 ]
Baik, Sung Wook [1 ]
机构
[1] Sejong Univ, Seoul 143747, South Korea
[2] Univ Technol Compiegne, Ctr Rech Royallieu, Lab Biomecan & Bioingn UMR7338, Compiegne, France
基金
新加坡国家研究基金会;
关键词
Aerial view; Attention mechanism; Convolutional neural network; Environment monitoring; Fire detection; Remote sensing; CONVOLUTIONAL NEURAL-NETWORKS; COLOR; SHAPE;
D O I
10.1016/j.imavis.2024.104989
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The threat of fire is pervasive, poses significant risks to the environment, and may include potential fatalities, property devastation, and socioeconomic disruption. Successfully mitigating these risks relies on the prompt identification of fires, a process in which soft computing methodologies play a pivotal role. Although, these fire detection methodologies neglected to explore the relationships among fire-indicative features, which are important to enable a model to learn more representative and robust features in remote sensing scenarios. In the context of small fire detection from aerial view using satellite imagery or unmanned arial vehicle (UAVs) presents challenges to capture rich spatial detail, hinder the model ability for accurate fire scene classification. Furthermore, it is significant to manage model complexity effectively to facilitate deployment on UAVs for fast and accurate responses in an emergency situation. To cope with these challenges, we propose an advanced model integrated a modified soft attention mechanism (MSAM) and a 3D convolution operation with a MobileNet architecture to overcome obstacles related to optimising features and controlling model complexity. The MSAM enabling the model to selectively emphasise essential features during the training process which acts as a selective filter. This adaptive attention mechanism enhances sensitivity and allowing the model to prioritise relevant patterns for accurate fire detection. Concurrently, the integration of a 3D convolutional operation extends the model spatial awareness, to capture intricate details across multiple scales, and particularly in small regions observed from aerial viewpoints. Benchmark evaluations of the proposed model over the FD, DFAN, and ADSF datasets reveal superior performance with enhanced accuracy (ACR) compared to existing methods. Our model surpassed the state-of-the-art models with an average ACR improvement of 0.54%, 2.64%, and 1.20% on the FD, ADSF, and DFAN datasets, respectively. Furthermore, the use of an explainable artificial intelligence (XAI) technique enhances the validation of the model visual emphasis on critical regions of the image, providing valuable insights into its decision-making process.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Efficient Deep Learning Framework for Fire Detection in Complex Surveillance Environment
    Dilshad N.
    Khan T.
    Song J.
    Computer Systems Science and Engineering, 2023, 46 (01): : 749 - 764
  • [2] A modified vision transformer architecture with scratch learning capabilities for effective fire detection
    Yar, Hikmat
    Khan, Zulfiqar Ahmad
    Hussain, Tanveer
    Baik, Sung Wook
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [3] Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications
    Muhammad, Khan
    Ahmad, Jamil
    Lv, Zhihan
    Bellavista, Paolo
    Yang, Po
    Baik, Sung Wook
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (07): : 1419 - 1434
  • [4] A modified YOLOv5 architecture for efficient fire detection in smart cities
    Yar, Hikmat
    Khan, Zulfiqar Ahmad
    Ullah, Fath U. Min
    Ullah, Waseem
    Baik, Sung Wook
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [5] Deep Learning Based Fire Detection System for Surveillance Videos
    Wang, Hao
    Pan, Zhiying
    Zhang, Zhifei
    Song, Hongzhang
    Zhang, Shaobo
    Zhang, Jianhua
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT II, 2019, 11741 : 318 - 328
  • [6] Efficient Fire Detection for Uncertain Surveillance Environment
    Muhammad, Khan
    Khan, Selman
    Elhoseny, Mohamed
    Ahmed, Syed Hassan
    Baik, Sung Wook
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (05) : 3113 - 3122
  • [7] MtlrNet: An Effective Deep Multitask Learning Architecture for Rail Crack Detection
    Meng, Shijin
    Kuang, Senyun
    Ma, Zheng
    Wu, Yanliang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [8] An Effective Attention-based CNN Model for Fire Detection in Adverse Weather Conditions
    Yar, Hikmat
    Ullah, Waseem
    Khan, Zulfiqar Ahmad
    Baik, Sung Wook
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 206 (335-346) : 335 - 346
  • [9] Fire Detection Method in Smart City Environments Using a Deep-Learning-Based Approach
    Avazov, Kuldoshbay
    Mukhiddinov, Mukhriddin
    Makhmudov, Fazliddin
    Cho, Young Im
    ELECTRONICS, 2022, 11 (01)
  • [10] Visual Intelligence in Smart Cities: A Lightweight Deep Learning Model for Fire Detection in an IoT Environment
    Nadeem, Muhammad
    Dilshad, Naqqash
    Alghamdi, Norah Saleh
    Dang, L. Minh
    Song, Hyoung-Kyu
    Nam, Junyoung
    Moon, Hyeonjoon
    SMART CITIES, 2023, 6 (05): : 2245 - 2259