FireMatch: A semi-supervised video fire detection network based on consistency and distribution alignment

被引:6
|
作者
Lin, Qinghua [1 ]
Li, Zuoyong [2 ]
Zeng, Kun [2 ]
Fan, Haoyi [3 ]
Li, Wei [1 ]
Zhou, Xiaoguang [4 ,5 ]
机构
[1] Fujian Univ Technol, Sch Comp Sci & Math, Fuzhou 350118, Peoples R China
[2] Minjiang Univ, Coll Comp & Control Engn, Fujian Prov Key Lab Informat Proc & Intelligent Co, Fuzhou 350121, Peoples R China
[3] Zhengzhou Univ, Sch Comp & Artificial Intelligence, Zhengzhou 450001, Peoples R China
[4] Beijing Univ Post & Telecommun, Sch Automat, Beijing 100876, Peoples R China
[5] Minjiang Univ, Sch Econ & Management, Fuzhou 350121, Fujian, Peoples R China
基金
中国国家自然科学基金;
关键词
Fire detection; Semi-supervised learning; Consistency regularization; Adversarial distribution alignment; COMBINATION;
D O I
10.1016/j.eswa.2024.123409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning techniques have greatly enhanced the performance of fire detection in videos. However, videobased fire detection models heavily rely on labeled data, and the process of data labeling is particularly costly and time-consuming, especially when dealing with videos. Considering the limited quantity of labeled video data, we propose a semi -supervised fire detection model called FireMatch, which is based on consistency regularization and adversarial distribution alignment. Specifically, we first combine consistency regularization with pseudo -label. For unlabeled data, we design video data augmentation to obtain corresponding weakly augmented and strongly augmented samples. The proposed model predicts weakly augmented samples and retains pseudo -label above a threshold, while training on strongly augmented samples to predict these pseudolabels for learning more robust feature representations. Secondly, we generate video cross -set augmented samples by adversarial distribution alignment to expand the training data and alleviate the decline in classification performance caused by insufficient labeled data. Finally, we introduce a fairness loss to help the model produce diverse predictions for input samples, thereby addressing the issue of high confidence with the non -fire class in fire classification scenarios. The FireMatch achieved an accuracy of 76.92% and 91.80% on two real -world fire datasets, respectively. The experimental results demonstrate that the proposed method outperforms the current state-of-the-art semi -supervised classification methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Semi-supervised wildfire smoke detection based on smoke-aware consistency
    Wang, Chuansheng
    Grau, Antoni
    Guerra, Edmundo
    Shen, Zhiguo
    Hu, Jinxing
    Fan, Haoyi
    FRONTIERS IN PLANT SCIENCE, 2022, 13
  • [2] A Lightweight Semi-Supervised Learning Method Based on Consistency Regularization for Intrusion Detection
    Zhao, Ruijie
    Tang, Tiantian
    Gui, Guan
    Xue, Zhi
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3124 - 3129
  • [3] ConsE: Consistency Exploitation for Semi-Supervised Anomaly Detection in Graphs
    Chang, Wenjing
    Yu, Jianjun
    Zhou, Xiaojun
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [4] Consistency-based semi-supervised learning for oriented object detection
    Fu, Ronghao
    Chen, Chengcheng
    Yan, Shuang
    Wang, Xianchang
    Chen, Huiling
    KNOWLEDGE-BASED SYSTEMS, 2024, 304
  • [5] Semi-supervised Learning Method for Object Detection based on Adjacent Frame Consistency Measurement
    Miao, Yinxiao
    Cheng, Zhonghao
    Zhang, Xiujian
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6452 - 6457
  • [6] Rotation-fused Consistency Semi-supervised Learning for Object Detection
    Xu, Peiyi
    Cui, Lingguo
    Cheng, Zhonghao
    Chai, Senchun
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 8216 - 8221
  • [7] RCT: Random Consistency Training for Semi-Supervised Sound Event Detection
    Shao, Nian
    Loweimi, Erfan
    Li, Xiaofei
    INTERSPEECH 2022, 2022, : 1541 - 1545
  • [8] Cycle Self-Training for Semi-Supervised Object Detection with Distribution Consistency Reweighting
    Liu, Hao
    Chen, Bin
    Wang, Bo
    Wu, Chunpeng
    Dai, Feng
    Wu, Peng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6569 - 6578
  • [9] FMixAugment for Semi-supervised Learning with Consistency Regularization
    Lin, Huibin
    Wang, Shiping
    Liu, Zhanghui
    Xiao, Shunxin
    Du, Shide
    Guo, Wenzhong
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 127 - 139
  • [10] Interpolation consistency training for semi-supervised learning
    Verma, Vikas
    Kawaguchi, Kenji
    Lamb, Alex
    Kannala, Juho
    Solin, Arno
    Bengio, Yoshua
    Lopez-Paz, David
    NEURAL NETWORKS, 2022, 145 : 90 - 106