Network Fault Lightweight Prediction Algorithm Based on Continuous Knowledge Distillation

被引:0
|
作者
Huang, Wei [1 ,2 ]
Huang, Jie [1 ]
Fan, Chengwen [3 ]
Yang, Yang [3 ]
机构
[1] Southeast Univ, Sch Cyber Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] CETC, Res Inst 54, Shijiazhuang, Hebei, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
关键词
Knowledge distillation; Fault prediction; Lightweight method; BiLSTM;
D O I
10.1007/978-981-99-9247-8_31
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Network fault prediction is one of the important means to ensure network security and stable operation. Efficient fault prediction can improve the ability of operation and maintenance personnel to deal with faults and reduce losses caused by faults. In edge scenarios, device resources may be limited by hardware resources, such as storage space, memory, processing power. They may also be limited by unstable network connections, such as limited bandwidth, high packet loss rate, and large delay. This paper investigates the research status of network fault prediction at home and abroad. Currently, commonly used network fault prediction methods include methods based on statistics, based on machine learning, and based on deep learning. These network fault prediction methods can learn the characteristics of network faults and have achieved good results in network fault prediction tasks. However, the methods based on neural networks have a large computational resource overhead and are easily limited by device performance in edge scenarios. The methods based on statistics and machine learning have low cost but low accuracy. In this paper, an edge side network fault prediction model based on improved BiLSTM is designed, and improve the continuous distillation technology to design Stage Continuous Knowledge Distillation (SCKD). The simulation experiments prove that the student model performs similarly to the teacher model in terms of accuracy and F1-Score, and has lower memory usage and parameter volume.
引用
收藏
页码:316 / 325
页数:10
相关论文
共 50 条
  • [21] Multiassistant Knowledge Distillation for Lightweight Bearing Fault Diagnosis Based on Decreasing Threshold Channel Pruning
    Zhong, Hongyu
    Yu, Samson
    Trinh, Hieu
    Lv, Yong
    Yuan, Rui
    Wang, Yanan
    IEEE SENSORS JOURNAL, 2024, 24 (01) : 486 - 494
  • [22] Lightweight Knowledge Distillation-Based Transfer Learning Framework for Rolling Bearing Fault Diagnosis
    Lu, Ruijia
    Liu, Shuzhi
    Gong, Zisu
    Xu, Chengcheng
    Ma, Zonghe
    Zhong, Yiqi
    Li, Baojian
    SENSORS, 2024, 24 (06)
  • [23] Network Equipment Fault Prediction Based on CUSUM Algorithm
    Liu Peishun
    Lin LiFang
    Zhao Changjian
    Jia Peiwei
    PROCEEDINGS OF THE 2015 4TH NATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING ( NCEECE 2015), 2016, 47 : 1596 - 1600
  • [24] A Lightweight SHM Framework Based on Adaptive Multisensor Fusion Network and Multigeneration Knowledge Distillation
    Li, Sijue
    Liu, Fengyi
    Peng, Gaoliang
    Cheng, Feng
    Zhao, Benqi
    Ji, Mengyu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [25] KD-LightNet: A Lightweight Network Based on Knowledge Distillation for Industrial Defect Detection
    Liu, Jinhai
    Li, Hengguang
    Zuo, Fengyuan
    Zhao, Zhen
    Lu, Senxiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [26] HS-KDNet: A Lightweight Network Based on Hierarchical-Split Block and Knowledge Distillation for Fault Diagnosis With Extremely Imbalanced Data
    Deng, Jin
    Jiang, Wenjuan
    Zhang, Ye
    Wang, Gong
    Li, Sheng
    Fang, Hairui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [27] A Lightweight Graph Neural Network Algorithm for Action Recognition Based on Self-Distillation
    Feng, Miao
    Meunier, Jean
    ALGORITHMS, 2023, 16 (12)
  • [28] A Lightweight Malware Detection Model Based on Knowledge Distillation
    Miao, Chunyu
    Kou, Liang
    Zhang, Jilin
    Dong, Guozhong
    MATHEMATICS, 2024, 12 (24)
  • [29] Adaptive Knowledge Distillation-Based Lightweight Intelligent Fault Diagnosis Framework in IoT Edge Computing
    Wang, Yanzhi
    Yu, Ziyang
    Wu, Jinhong
    Wang, Chu
    Zhou, Qi
    Hu, Jiexiang
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (13): : 23156 - 23169
  • [30] Focus-RCNet: a lightweight recyclable waste classification algorithm based on focus and knowledge distillation
    Dashun Zheng
    Rongsheng Wang
    Yaofei Duan
    Patrick Cheong-Iao Pang
    Tao Tan
    Visual Computing for Industry, Biomedicine, and Art, 6