An Anomaly Detection Algorithm for Microservice Architecture Based on Robust Principal Component Analysis

被引:24
|
作者
Jin, Mingxu [1 ]
Lv, Aoran [1 ]
Zhu, Yuanpeng [1 ]
Wen, Zijiang [2 ]
Zhong, Yubin [2 ]
Zhao, Zexin [1 ]
Wu, Jiang [1 ]
Li, Hejie [1 ]
He, Hanheng [1 ]
Chen, Fengyi [3 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510641, Peoples R China
[2] JOYY Inc, Guangzhou 511442, Peoples R China
[3] Guangdong Ind Polytech, Sch Management Adm, Guangzhou 510330, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
基金
中国国家自然科学基金;
关键词
Anomaly detection; Standards; Topology; Machine learning algorithms; Signal processing algorithms; Licenses; Containers; Microservice architecture; root cause analysis; anomaly detection; PCA;
D O I
10.1109/ACCESS.2020.3044610
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture (MSA) is a new software architecture, which divides a large single application and service into dozens of supporting microservices. With the increasingly popularity of MSA, the security issues of MSA get a lot of attention. In this paper, we propose an algorithm for mining causality and the root cause. Our algorithm consists of two parts: invocation chain anomaly analysis based on robust principal component analysis (RPCA) and a single indicator anomaly detection algorithm. The single indicator anomaly detection algorithm is composed of Isolation Forest (IF) algorithm, One-Class Support Vector Machine (SVM) algorithm, Local Outlier Factor (LOF) algorithm, and 3 sigma principle. For general and network time-consuming anomaly in the process of the MSA, we formulate different anomaly time-consuming detection strategies. We select a batch of sample data and three batches of test data of the 2020 International AIOps Challenge to debug our algorithm. According to the scoring criteria of the competition organizers, our algorithm has an average score of 0.8304 (The full score is 1) in the four batches of data. Our proposed algorithm has higher accuracy than some traditional machine learning algorithms in anomaly detection.
引用
收藏
页码:226397 / 226408
页数:12
相关论文
共 50 条
  • [31] A SAR image change detection algorithm based on principal component analysis
    College of Electronic Engineering, UESTC, Chengdu 610054, China
    Dianzi Yu Xinxi Xuebao, 2008, 7 (1727-1730):
  • [32] FAULT DETECTION AND ISOLATION WITH ROBUST PRINCIPAL COMPONENT ANALYSIS
    Tharrault, Yvon
    Mourot, Gilles
    Ragot, Jose
    Maquin, Didier
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2008, 18 (04) : 429 - 442
  • [33] Robust Principal Component Analysis based on Purity
    Pan, Jinyan
    Cai, Yingqi
    Xie, Youwei
    Lin, Tingting
    Gao, Yunlong
    Cao, Chao
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 2017 - 2023
  • [34] Anomaly detection on OpenStack logs based on an improved robust principal component analysis model and its projection onto column space
    Kalaki, Parisa Sadat
    Shameli-Sendi, Alireza
    Abbasi, Behzad Khalaji Emamzadeh
    SOFTWARE-PRACTICE & EXPERIENCE, 2023, 53 (03): : 665 - 681
  • [35] Probabilistic principal component analysis-based anomaly detection for structures with missing data
    Ma, Zhi
    Yun, Chung-Bang
    Wan, Hua-Ping
    Shen, Yanbin
    Yu, Feng
    Luo, Yaozhi
    STRUCTURAL CONTROL & HEALTH MONITORING, 2021, 28 (05):
  • [36] Anomaly Detection Based on Information Granulation and Principal Component Analysis for Geological Drilling Process
    Huang, Cheng
    Du, Sheng
    Fan, Haipeng
    Wu, Min
    Cao, Weihua
    2024 43RD CHINESE CONTROL CONFERENCE, CCC 2024, 2024, : 2750 - 2755
  • [37] Robust Principal Component Analysis-Based Infrared Small Target Detection
    Chen, Qiwei
    Wu, Cheng
    Wang, Yiming
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9925 - 9926
  • [38] Change Detection in UWB SAR Images Based on Robust Principal Component Analysis
    Schwartz, Christofer
    Ramos, Lucas P.
    Duarte, Leonardo T.
    Pinho, Marcelo da S.
    Pettersson, Mats I.
    Vu, Viet T.
    Machado, Renato
    REMOTE SENSING, 2020, 12 (12)
  • [39] Robust principal component analysis via ES-algorithm
    Lim, Yaeji
    Park, Yeonjoo
    Oh, Hee-Seok
    JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2014, 43 (01) : 149 - 159
  • [40] Robust sparse principal component analysis by DC programming algorithm
    Li, Jieya
    Yang, Liming
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (03) : 3183 - 3193