An Anomaly Detection Algorithm for Microservice Architecture Based on Robust Principal Component Analysis

被引:24
|
作者
Jin, Mingxu [1 ]
Lv, Aoran [1 ]
Zhu, Yuanpeng [1 ]
Wen, Zijiang [2 ]
Zhong, Yubin [2 ]
Zhao, Zexin [1 ]
Wu, Jiang [1 ]
Li, Hejie [1 ]
He, Hanheng [1 ]
Chen, Fengyi [3 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510641, Peoples R China
[2] JOYY Inc, Guangzhou 511442, Peoples R China
[3] Guangdong Ind Polytech, Sch Management Adm, Guangzhou 510330, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
基金
中国国家自然科学基金;
关键词
Anomaly detection; Standards; Topology; Machine learning algorithms; Signal processing algorithms; Licenses; Containers; Microservice architecture; root cause analysis; anomaly detection; PCA;
D O I
10.1109/ACCESS.2020.3044610
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture (MSA) is a new software architecture, which divides a large single application and service into dozens of supporting microservices. With the increasingly popularity of MSA, the security issues of MSA get a lot of attention. In this paper, we propose an algorithm for mining causality and the root cause. Our algorithm consists of two parts: invocation chain anomaly analysis based on robust principal component analysis (RPCA) and a single indicator anomaly detection algorithm. The single indicator anomaly detection algorithm is composed of Isolation Forest (IF) algorithm, One-Class Support Vector Machine (SVM) algorithm, Local Outlier Factor (LOF) algorithm, and 3 sigma principle. For general and network time-consuming anomaly in the process of the MSA, we formulate different anomaly time-consuming detection strategies. We select a batch of sample data and three batches of test data of the 2020 International AIOps Challenge to debug our algorithm. According to the scoring criteria of the competition organizers, our algorithm has an average score of 0.8304 (The full score is 1) in the four batches of data. Our proposed algorithm has higher accuracy than some traditional machine learning algorithms in anomaly detection.
引用
收藏
页码:226397 / 226408
页数:12
相关论文
共 50 条
  • [22] Anomaly Detection of Spacecraft Attitude Control System Based on Principal Component Analysis
    Feng Bingqing
    Hu Shaolin
    Li Chuan
    Miao Yangfan
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 1220 - 1225
  • [23] Anomaly Detection for Charging Voltage Profiles in Battery Cells in an Energy Storage Station Based on Robust Principal Component Analysis
    Yu, Jiaqi
    Guo, Yanjie
    Zhang, Wenjie
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [24] An iterative algorithm for robust kernel principal component analysis
    Wang, Lei
    Pang, Yan-Wei
    Shen, Dao-Yi
    Yu, Neng-Hai
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 3484 - +
  • [25] An iterative algorithm for robust kernel principal component analysis
    Huang, Hsin-Hsiung
    Yeh, Yi-Ren
    NEUROCOMPUTING, 2011, 74 (18) : 3921 - 3930
  • [26] Fast Principal Component Analysis Based on Hardware Architecture of Generalized Hebbian Algorithm
    Lin, Shiow-Jyu
    Hung, Yi-Tsan
    Hwang, Wen-Jyi
    ADVANCES IN COMPUTATION AND INTELLIGENCE, 2010, 6382 : 505 - 515
  • [27] A Robust Principal Component Analysis Algorithm for EEG-Based Vigilance Estimation
    Shi, Li-Chen
    Duan, Ruo-Nan
    Lu, Bao-Liang
    2013 35TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2013, : 6623 - 6626
  • [28] Anomaly Detection via Online Oversampling Principal Component Analysis
    Lee, Yuh-Jye
    Yeh, Yi-Ren
    Wang, Yu-Chiang Frank
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (07) : 1460 - 1470
  • [29] Anomaly Detection in Wind Tunnel Experiments by Principal Component Analysis
    Defreitas, Aaron
    Nathan Alexander, W.
    Devenport, William
    Merkes, Sierra
    Leman, Scotland
    Smith, Eric
    Borgoltz, Aurelien
    AIAA JOURNAL, 2021, 60 (04) : 2297 - 2307
  • [30] Fault detection and isolation with robust principal component analysis
    Tharrault, Yvon
    Mourot, Gilles
    Ragot, Jose
    2008 MEDITERRANEAN CONFERENCE ON CONTROL AUTOMATION, VOLS 1-4, 2008, : 1538 - 1543