Abnormal Electricity Detection of Users Based on Improved Canopy-Kmeans and Isolation Forest Algorithms

被引:4
作者
Wang, Jianyuan [1 ]
Li, Xiaoyao [1 ]
机构
[1] Northeast Elect Power Univ, Key Lab Modern Power Syst Simulat & Control & Rene, Minist Educ, Jilin 132012, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Electricity; Clustering algorithms; Classification algorithms; Anomaly detection; Forestry; Prediction algorithms; Feature extraction; Detection algorithms; Energy consumption; Unsupervised learning; Abnormal detection of electricity consumption by users; Canopy-Kmeans algorithm; isolation forest algorithm; unsupervised learning; weighted density;
D O I
10.1109/ACCESS.2024.3429304
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the existing user abnormal electricity consumption detection methods that have the problem of difficult classification of user similar electricity consumption patterns, this paper proposes an unsupervised isolation forest abnormal electricity consumption detection model based on the Canopy-Kmeans algorithm with weighted density improvement. To start, we propose a composite parameter analysis method for user electricity consumption patterns, volatility, trends, and correlations using Irish smart meter data. This method involves joint data cleaning, interpolation, and feature construction. Additionally, principal component analysis is introduced to fuse features across layers and reduce dimensionality in user electricity consumption. Subsequently, we introduce the weighted density improvement Canopy-Kmeans clustering algorithm. This algorithm determines the K value and clustering centers using the maximum weight product method, based on definitions of sample density, average intra-class sample distance, and inter-class distance in the multilayer fusion feature data. Finally, we propose a fusion mechanism of weighted density improvement Canopy-Kmeans and isolation forest algorithms to jointly construct a model for detecting abnormal power usage based on multilayer fusion feature data analysis. The results demonstrate that multilayer fusion feature parameters vary in size and discretization among different user types, enabling classification of users with diverse electricity consumption patterns. Moreover, the anomaly detection model based on multilayer fusion feature data analysis improves accuracy rates, recall rates, and F1 scores compared to other algorithms.
引用
收藏
页码:99110 / 99121
页数:12
相关论文
共 50 条
  • [41] Isolation Forest-based semi-supervised Anomaly Detection of multiple classes
    Melquiades, Caio
    de Lima Neto, Fernando Buarque
    2022 17TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI), 2022,
  • [42] OPHiForest: Order Preserving Hashing Based Isolation Forest for Robust and Scalable Anomaly Detection
    Xiang, Haolong
    Salcic, Zoran
    Dou, Wanchun
    Xu, Xiaolong
    Qi, Lianyong
    Zhang, Xuyun
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 1655 - 1664
  • [43] Anomaly Detection for Data Streams Based on Isolation Forest Using Scikit-Multiflow
    Togbe, Maurras Ulbricht
    Barry, Mariam
    Boly, Aliou
    Chabchoub, Yousra
    Chiky, Raja
    Montiel, Jacob
    Tran, Vinh-Thuy
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS, ICCSA 2020, PART IV, 2020, 12252 : 15 - 30
  • [44] Insider Threat Detection Model Using Anomaly-Based Isolation Forest Algorithm
    Al-Shehari, Taher
    Al-Razgan, Muna
    Alfakih, Taha
    Alsowail, Rakan A.
    Pandiaraj, Saravanan
    IEEE ACCESS, 2023, 11 : 118170 - 118185
  • [45] Two-Step Electricity Theft Detection Strategy Considering Economic Return Based on Convolutional Autoencoder and Improved Regression Algorithm
    Cui, Xueyuan
    Liu, Shengyuan
    Lin, Zhenzhi
    Ma, Jien
    Wen, Fushuan
    Ding, Yi
    Yang, Li
    Guo, Wenchong
    Feng, Xiaofeng
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (03) : 2346 - 2359
  • [46] Transfer learning based graph convolutional network with self-attention mechanism for abnormal electricity consumption detection
    Meng, Songping
    Li, Chengdong
    Tian, Chongyi
    Peng, Wei
    Tian, Chenlu
    ENERGY REPORTS, 2023, 9 : 5647 - 5658
  • [47] An Unsupervised Anomaly Detection in Electricity Consumption Using Reinforcement Learning and Time Series Forest Based Framework
    Ghanim, Jihan
    Awad, Mariette
    JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2025, 15 (01) : 5 - 24
  • [48] Mathematical modelling of abnormal account detection on social media platform based on improved edge weight
    Han Y.
    International Journal of Web Based Communities, 2023, 19 (2-3) : 187 - 197
  • [49] Improved LSTM-Based Abnormal Stream Data Detection and Correction System for Internet of Things
    Liu, Jun
    Bai, Jingpan
    Li, Huahua
    Sun, Bo
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (02) : 1282 - 1290
  • [50] Active Learning-based Isolation Forest (ALIF): Enhancing anomaly detection with expert feedback
    Marcelli, Elisa
    Barbariol, Tommaso
    Sartor, Davide
    Susto, Gian Antonio
    INFORMATION SCIENCES, 2024, 678