Abnormal Electricity Detection of Users Based on Improved Canopy-Kmeans and Isolation Forest Algorithms

被引:4
|
作者
Wang, Jianyuan [1 ]
Li, Xiaoyao [1 ]
机构
[1] Northeast Elect Power Univ, Key Lab Modern Power Syst Simulat & Control & Rene, Minist Educ, Jilin 132012, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Electricity; Clustering algorithms; Classification algorithms; Anomaly detection; Forestry; Prediction algorithms; Feature extraction; Detection algorithms; Energy consumption; Unsupervised learning; Abnormal detection of electricity consumption by users; Canopy-Kmeans algorithm; isolation forest algorithm; unsupervised learning; weighted density;
D O I
10.1109/ACCESS.2024.3429304
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the existing user abnormal electricity consumption detection methods that have the problem of difficult classification of user similar electricity consumption patterns, this paper proposes an unsupervised isolation forest abnormal electricity consumption detection model based on the Canopy-Kmeans algorithm with weighted density improvement. To start, we propose a composite parameter analysis method for user electricity consumption patterns, volatility, trends, and correlations using Irish smart meter data. This method involves joint data cleaning, interpolation, and feature construction. Additionally, principal component analysis is introduced to fuse features across layers and reduce dimensionality in user electricity consumption. Subsequently, we introduce the weighted density improvement Canopy-Kmeans clustering algorithm. This algorithm determines the K value and clustering centers using the maximum weight product method, based on definitions of sample density, average intra-class sample distance, and inter-class distance in the multilayer fusion feature data. Finally, we propose a fusion mechanism of weighted density improvement Canopy-Kmeans and isolation forest algorithms to jointly construct a model for detecting abnormal power usage based on multilayer fusion feature data analysis. The results demonstrate that multilayer fusion feature parameters vary in size and discretization among different user types, enabling classification of users with diverse electricity consumption patterns. Moreover, the anomaly detection model based on multilayer fusion feature data analysis improves accuracy rates, recall rates, and F1 scores compared to other algorithms.
引用
收藏
页码:99110 / 99121
页数:12
相关论文
共 50 条
  • [1] Improved Optimization of Canopy-Kmeans Clustering Algorithm Based on Hadoop Platform
    Zhou, Gongjian
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND ELECTRICAL ENGINEERING 2018 (ICITEE '18), 2018,
  • [2] Unsupervised Detection of Abnormal Electricity Consumption Behavior Based on Feature Engineering
    Zhang, Wei
    Dong, Xiaowei
    Li, Huaibao
    Xu, Jin
    Wang, Dan
    IEEE ACCESS, 2020, 8 : 55483 - 55500
  • [3] Spectral-Spatial Anomaly Detection of Hyperspectral Data Based on Improved Isolation Forest
    Song, Xiangyu
    Aryal, Sunil
    Ting, Kai Ming
    Liu, Zhen
    He, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Epileptic Seizure Detection by Cascading Isolation Forest-Based Anomaly Screening and EasyEnsemble
    Guo, Yao
    Jiang, Xinyu
    Tao, Linkai
    Meng, Long
    Dai, Chenyun
    Long, Xi
    Wan, Feng
    Zhang, Yuan
    van Dijk, Johannes
    Aarts, Ronald M.
    Chen, Wei
    Chen, Chen
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 : 915 - 924
  • [5] Magnetic Anomaly Detection Method Based on Feature Fusion and Isolation Forest Algorithm
    Zhang, Ning
    Liu, Yifei
    Xu, Lei
    Lin, Pengfei
    Zhao, Heda
    Chang, Ming
    IEEE ACCESS, 2022, 10 : 84444 - 84457
  • [6] Hyperspectral Anomaly Detection With Otsu-Based Isolation Forest
    Zhang, Yuxiang
    Dong, Yanni
    Wu, Ke
    Chen, Tao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 9079 - 9088
  • [7] Improved Anomaly Detection by Using the Attention-Based Isolation Forest
    Utkin, Lev
    Ageev, Andrey
    Konstantinov, Andrei
    Muliukha, Vladimir
    ALGORITHMS, 2023, 16 (01)
  • [8] Real-Time Synchrophasor Data Anomaly Detection and Classification Using Isolation Forest, KMeans, and LoOP
    Khaledian, Ehdieh
    Pandey, Shikhar
    Kundu, Pratim
    Srivastava, Anurag K.
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (03) : 2378 - 2388
  • [9] An Anomaly Detection Method for Wireless Sensor Networks Based on the Improved Isolation Forest
    Chen, Junxiang
    Zhang, Jilin
    Qian, Ruixiang
    Yuan, Junfeng
    Ren, Yongjian
    APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [10] Abnormal electricity consumption detection based on ensemble learning
    Fang, Zhou
    Cheng, Qing
    Mou, Li
    Qin, Hongyun
    Zhou, Houpan
    Cao, Jiuwen
    2019 9TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST2019), 2019, : 175 - 182