A clustering algorithm for detecting differential deviations in the multivariate time-series IoT data based on sensor relationship

被引:0
作者
Idrees, Rabbia [1 ]
Maiti, Ananda [2 ]
Garg, Saurabh [1 ]
机构
[1] Univ Tasmania, Sch Informat & Commun Technol, Sandy Bay, Tas 7005, Australia
[2] Deakin Univ, Sch Informat Technol, Geelong, Vic 3216, Australia
关键词
Multivariate time series; Deviations; Outlier detection; Clustering; Sensor relationship; Anomaly detection;
D O I
10.1007/s10115-024-02303-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Internet-of-things (IoT) applications involve a large number of sensors reporting data as a set of time series. Often these data are related to each other based on the relationship of the sensors in the actual application. Any small deviations could indicate a change in the operation of the IoT system and potential problems with the IoT application's goals. It is often difficult to detect such deviations with respect to the relationship between the sensors. This paper presents the clustering algorithm that can efficiently detect all the deviations small or large in the complex and evolving IoT data streams with the help of sensor relationships. We have demonstrated with the help of experiments that our algorithm can efficiently handle high-dimensional data and accurately detect all the deviations. In this paper, we have presented two more algorithms, anomaly detection and outlier detection, that can efficiently categorize the deviations detected by our proposed clustering algorithm into anomalous or normal deviations. We have evaluated the performance and accuracy of our proposed algorithms on synthetic and real-world datasets. Furthermore, to check the effectiveness of our algorithms in terms of efficiency, we have prepared synthetic datasets in which we have increased the complexity of the deviations to show that our algorithm can handle complex IoT data streams efficiently.
引用
收藏
页码:2641 / 2690
页数:50
相关论文
共 50 条
[21]   Genetic algorithm-based fuzzy clustering applied to multivariate time series [J].
Ribeiro, Karine do Prado ;
Fontes, Cristiano Hora ;
Alves de Melo, Gabriel Jesus .
EVOLUTIONARY INTELLIGENCE, 2021, 14 (04) :1547-1563
[22]   Genetic algorithm-based fuzzy clustering applied to multivariate time series [J].
Karine do Prado Ribeiro ;
Cristiano Hora Fontes ;
Gabriel Jesus Alves de Melo .
Evolutionary Intelligence, 2021, 14 :1547-1563
[23]   Large Deviations Anomaly Detection (LAD) for collection of multivariate time series data: Applications to COVID-19 data [J].
Guggilam, Sreelekha ;
Chandola, Varun ;
Patra, Abani K. .
JOURNAL OF COMPUTATIONAL SCIENCE, 2023, 72
[24]   Time-Series Clustering for Data Analysis in Smart Grid [J].
Maurya, Akanksha ;
Akyurek, Alper Sinan ;
Aksanli, Baris ;
Rosing, Tajana Simunic .
2016 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM), 2016,
[25]   Clustering Multivariate Time Series from Large Sensor Networks [J].
Liang, Jianning ;
Zhou, Yan .
2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, :563-567
[26]   Multivariate Time-Series Anomaly Detection in IoT with a Bi-Dual GM GRU Autoencoder [J].
Yu, Yuan-Cheng ;
Ouyang, Yen-Chieh ;
Wu, Ling-Wei ;
Lin, Chun-An ;
Tsai, Kuo-Yu .
2024 IEEE 48TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC 2024, 2024, :746-754
[27]   A new Clustering Algorithm for sensor Data Streams in an Agricultural IoT [J].
Wu, Mingze ;
Wang, Yitong ;
Liao, Zhichao .
2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, :2373-2378
[28]   Machine learning approach of detecting anomalies and forecasting time-series of IoT devices [J].
Malki, Amer ;
Atlam, El-Sayed ;
Gad, Ibrahim .
ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (11) :8973-8986
[29]   Multivariate Time-Series Anomaly Detection in IoT Using Attention-Based Gated Recurrent Unit [J].
Tan, Yifeng ;
Li, Guobing ;
Chen, Yuxuan ;
Zhang, Guomei .
2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, :604-609
[30]   A MULTIVARIATE TIME-SERIES ANALYSIS OF SOME FLOUR PRICE DATA [J].
GRUBB, H .
APPLIED STATISTICS-JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C, 1992, 41 (01) :95-107