PUNet: A Semi-Supervised Anomaly Detection Model for Network Anomaly Detection Based on Positive Unlabeled Data

被引:0
|
作者
Long, Gang [1 ]
Zhang, Zhaoxin [1 ]
机构
[1] Harbin Inst Technol, Fac Comp, Harbin 150000, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 01期
关键词
Network anomaly detection; representation learning; candidate set; CatBoost;
D O I
10.32604/cmc.2024.054558
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Network anomaly detection plays a vital role in safeguarding network security. However, the existing network anomaly detection task is typically based on the one-class zero-positive scenario. This approach is susceptible to overfitting during the training process due to discrepancies in data distribution between the training set and the test set. This phenomenon is known as prediction drift. Additionally, the rarity of anomaly data, often masked by normal data, further complicates network anomaly detection. To address these challenges, we propose the PUNet network, which ingeniously combines the strengths of traditional machine learning and deep learning techniques for anomaly detection. Specifically, PUNet employs a reconstruction-based autoencoder to pre-train normal data, enabling the network to capture potential features and correlations within the data. Subsequently, PUNet integrates a sampling algorithm to construct a pseudo-label candidate set among the outliers based on the reconstruction loss of the samples. This approach effectively mitigates the prediction drift problem by incorporating abnormal samples. Furthermore, PUNet utilizes the CatBoost classifier for anomaly detection to tackle potential data imbalance issues within the candidate set. Extensive experimental evaluations demonstrate that PUNet effectively resolves the prediction drift and data imbalance problems, significantly outperforming competing methods.
引用
收藏
页码:327 / 343
页数:17
相关论文
共 50 条
  • [31] Statistical approaches for semi-supervised anomaly detection in machining
    Denkena, B.
    Dittrich, M-A
    Noske, H.
    Witt, M.
    PRODUCTION ENGINEERING-RESEARCH AND DEVELOPMENT, 2020, 14 (03): : 385 - 393
  • [32] Anomaly and Novelty detection for robust semi-supervised learning
    Cappozzo, Andrea
    Greselin, Francesca
    Murphy, Thomas Brendan
    STATISTICS AND COMPUTING, 2020, 30 (05) : 1545 - 1571
  • [33] Semi-Supervised Anomaly Detection Via Neural Process
    Zhou, Fan
    Wang, Guanyu
    Zhang, Kunpeng
    Liu, Siyuan
    Zhong, Ting
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (10) : 10423 - 10435
  • [34] Semi-supervised anomaly detection in dynamic communication networks
    Meng, Xuying
    Wang, Suhang
    Liang, Zhimin
    Yao, Di
    Zhou, Jihua
    Zhang, Yujun
    Information Sciences, 2021, 571 : 527 - 542
  • [35] Semi-supervised Anomaly Detection with an Application to Water Analytics
    Vercruyssen, Vincent
    Meert, Wannes
    Verbruggen, Gust
    Maes, Koen
    Baumer, Ruben
    Davis, Jesse
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 527 - 536
  • [36] Semi-supervised anomaly detection in dynamic communication networks
    Meng, Xuying
    Wang, Suhang
    Liang, Zhimin
    Yao, Di
    Zhou, Jihua
    Zhang, Yujun
    INFORMATION SCIENCES, 2021, 571 : 527 - 542
  • [37] Anomaly and Novelty detection for robust semi-supervised learning
    Andrea Cappozzo
    Francesca Greselin
    Thomas Brendan Murphy
    Statistics and Computing, 2020, 30 : 1545 - 1571
  • [38] Semi-supervised anomaly detection in video surveillance by inpainting
    Liu, Wei
    Gao, Mingqiang
    Duan, Shuaidong
    Wei, Longsheng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) : 47677 - 47698
  • [39] Semi-Supervised Active Learning for Anomaly Detection in Aviation
    Memarzadeh, Milad
    Matthews, Bryan
    Templin, Thomas
    Sharif Rohani, Aida
    Weckler, Daniel
    JOURNAL OF AEROSPACE INFORMATION SYSTEMS, 2023, 20 (04): : 181 - 194
  • [40] Semi-supervised Bolt Anomaly Detection in Haphazard Environment
    Liu, Chuangwei
    Yan, Yi
    Ma, Nachuan
    Peng, Yun
    Liu, Chengju
    Chen, Qijun
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2022, : 882 - 887