FireMatch: A semi-supervised video fire detection network based on consistency and distribution alignment

被引:8
作者
Lin, Qinghua [1 ]
Li, Zuoyong [2 ]
Zeng, Kun [2 ]
Fan, Haoyi [3 ]
Li, Wei [1 ]
Zhou, Xiaoguang [4 ,5 ]
机构
[1] Fujian Univ Technol, Sch Comp Sci & Math, Fuzhou 350118, Peoples R China
[2] Minjiang Univ, Coll Comp & Control Engn, Fujian Prov Key Lab Informat Proc & Intelligent Co, Fuzhou 350121, Peoples R China
[3] Zhengzhou Univ, Sch Comp & Artificial Intelligence, Zhengzhou 450001, Peoples R China
[4] Beijing Univ Post & Telecommun, Sch Automat, Beijing 100876, Peoples R China
[5] Minjiang Univ, Sch Econ & Management, Fuzhou 350121, Fujian, Peoples R China
基金
中国国家自然科学基金;
关键词
Fire detection; Semi-supervised learning; Consistency regularization; Adversarial distribution alignment; COMBINATION;
D O I
10.1016/j.eswa.2024.123409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning techniques have greatly enhanced the performance of fire detection in videos. However, videobased fire detection models heavily rely on labeled data, and the process of data labeling is particularly costly and time-consuming, especially when dealing with videos. Considering the limited quantity of labeled video data, we propose a semi -supervised fire detection model called FireMatch, which is based on consistency regularization and adversarial distribution alignment. Specifically, we first combine consistency regularization with pseudo -label. For unlabeled data, we design video data augmentation to obtain corresponding weakly augmented and strongly augmented samples. The proposed model predicts weakly augmented samples and retains pseudo -label above a threshold, while training on strongly augmented samples to predict these pseudolabels for learning more robust feature representations. Secondly, we generate video cross -set augmented samples by adversarial distribution alignment to expand the training data and alleviate the decline in classification performance caused by insufficient labeled data. Finally, we introduce a fairness loss to help the model produce diverse predictions for input samples, thereby addressing the issue of high confidence with the non -fire class in fire classification scenarios. The FireMatch achieved an accuracy of 76.92% and 91.80% on two real -world fire datasets, respectively. The experimental results demonstrate that the proposed method outperforms the current state-of-the-art semi -supervised classification methods.
引用
收藏
页数:13
相关论文
共 50 条
[41]   Adaptive Weighted Losses With Distribution Approximation for Efficient Consistency-Based Semi-Supervised Learning [J].
Li, Di ;
Liu, Yang ;
Song, Liang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) :7832-7842
[42]   Semi-supervised learning with local and global consistency [J].
Gui, Jie ;
Hu, Rongxiang ;
Zhao, Zhongqiu ;
Jia, Wei .
INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2014, 91 (11) :2389-2402
[43]   Semi-Supervised Learning With Heterogeneous Distribution Consistency for Visible Infrared Person Re-Identification [J].
Wei, Ziyu ;
Yang, Xi ;
Wang, Nannan ;
Gao, Xinbo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 :3880-3892
[44]   Posterior consistency of semi-supervised regression on graphs [J].
Bertozzi, Andrea L. ;
Hosseini, Bamdad ;
Li, Hao ;
Miller, Kevin ;
Stuart, Andrew M. .
INVERSE PROBLEMS, 2021, 37 (10)
[45]   Revisiting Consistency for Semi-Supervised Semantic Segmentation [J].
Grubisic, Ivan ;
Orsic, Marin ;
Segvic, Sinisa .
SENSORS, 2023, 23 (02)
[46]   MaxMatch: Semi-Supervised Learning With Worst-Case Consistency [J].
Jiang, Yangbangyan ;
Li, Xiaodan ;
Chen, Yuefeng ;
He, Yuan ;
Xu, Qianqian ;
Yang, Zhiyong ;
Cao, Xiaochun ;
Huang, Qingming .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) :5970-5987
[47]   Semi-supervised cross-modal retrieval with graph-based semantic alignment network [J].
Zhang, Lei ;
Chen, Leiting ;
Ou, Weihua ;
Zhou, Chuan .
COMPUTERS & ELECTRICAL ENGINEERING, 2022, 102
[48]   Analysis of Network Intrusion Detection Based on Semi-Supervised and SS-DGM [J].
Yu, Xiao ;
Liu, Chang ;
Wang, Jie ;
Liu, Chang ;
Tian, Li ;
Zhou, Liang .
IEEE ACCESS, 2024, 12 :170148-170160
[49]   The Optimization Method of Wireless Network Attacks Detection Based on Semi-Supervised Learning [J].
Wang T. ;
Wang N. ;
Cui Y. ;
Li H. .
Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (04) :791-802
[50]   Semi-supervised log anomaly detection based on bidirectional temporal convolution network [J].
Yin, Zhichao ;
Kong, Xian ;
Yin, Chunyong .
COMPUTERS & SECURITY, 2024, 140