MFCD:A Deep Learning Method with Fuzzy Clustering for Time Series Anomaly Detection

被引:0
作者
Luo, Kaisheng [1 ]
Liu, Chang [1 ]
Chen, Baiyang [1 ]
Li, Xuedong
Peng, Dezhong [1 ,2 ,3 ]
Yuan, Zhong [1 ]
机构
[1] Sichuan Univ, Chengdu 610041, Peoples R China
[2] Chengdu Univ Informat Technol, Chengdu 610225, Peoples R China
[3] Sichuan Univ, Chengdu Ruibei Yingte Informat Technol Co Ltd, Chengdu 610041, Peoples R China
来源
WEB AND BIG DATA, APWEB-WAIM 2024, PT III | 2024年 / 14963卷
基金
中国国家自然科学基金;
关键词
Anomaly detection; Multivariate time series; Self-supervised learning; Deep neural network; Fuzzy clustering; SUPPORT;
D O I
10.1007/978-981-97-7238-4_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The problem of unsupervised anomaly detection in time series is very challenging. In recent years, deep learning based methods have been widely used. However, existing methods still struggle to effectively detect certain specific types of anomalies such as collective anomalies. Therefore, in this paper, we propose a novel method based on reconstruction. We apply fuzzy clustering to the deep features of time series and calculate the sum of distances between sample points and all cluster centers, and then train the model by combining the reconstruction error. In addition, an anomaly criterion applicable to fuzzy clustering called Fuzzy Anomaly Distance (FAD) is devised to further amplify the difference between anomalies and normal points. We named the model MFCD, and its average anomaly detection F1 score on 7 datasets (including 4 real-world applications) is 96.07%, which is significantly better than previous state-of-the-art methods.
引用
收藏
页码:62 / 77
页数:16
相关论文
共 34 条
[1]   Practical Approach to Asynchronous Multivariate Time Series Anomaly Detection and Localization [J].
Abdulaal, Ahmed ;
Liu, Zhuanghua ;
Lancewicki, Tomer .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :2485-2494
[2]  
Angryk R., 2020, SWAN-SF
[3]  
Ayoub Mniai, 2023, International Conference on Advanced Intelligent Systems for Sustainable Development: Advanced Intelligent Systems on Artificial Intelligence, Software, and Data Science. Lecture Notes in Networks and Systems (637), P411, DOI 10.1007/978-3-031-26384-2_35
[4]  
Bai Shaojie, 2018, ARXIV
[5]   FCM - THE FUZZY C-MEANS CLUSTERING-ALGORITHM [J].
BEZDEK, JC ;
EHRLICH, R ;
FULL, W .
COMPUTERS & GEOSCIENCES, 1984, 10 (2-3) :191-203
[6]  
Bin Z, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4433
[7]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104
[8]  
Daehyung Park, 2018, IEEE Robotics and Automation Letters, V3, P1544, DOI 10.1109/LRA.2018.2801475
[9]  
Elsayed S., 2021, Do we really need deep learning models for time series forecasting?
[10]   A Comparison of TCN and LSTM Models in Detecting Anomalies in Time Series Data [J].
Gopali, Saroj ;
Abri, Faranak ;
Siami-Namini, Sima ;
Namin, Akbar Siami .
2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, :2415-2420