Abnormal Electricity Detection of Users Based on Improved Canopy-Kmeans and Isolation Forest Algorithms

被引:4
|
作者
Wang, Jianyuan [1 ]
Li, Xiaoyao [1 ]
机构
[1] Northeast Elect Power Univ, Key Lab Modern Power Syst Simulat & Control & Rene, Minist Educ, Jilin 132012, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Electricity; Clustering algorithms; Classification algorithms; Anomaly detection; Forestry; Prediction algorithms; Feature extraction; Detection algorithms; Energy consumption; Unsupervised learning; Abnormal detection of electricity consumption by users; Canopy-Kmeans algorithm; isolation forest algorithm; unsupervised learning; weighted density;
D O I
10.1109/ACCESS.2024.3429304
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the existing user abnormal electricity consumption detection methods that have the problem of difficult classification of user similar electricity consumption patterns, this paper proposes an unsupervised isolation forest abnormal electricity consumption detection model based on the Canopy-Kmeans algorithm with weighted density improvement. To start, we propose a composite parameter analysis method for user electricity consumption patterns, volatility, trends, and correlations using Irish smart meter data. This method involves joint data cleaning, interpolation, and feature construction. Additionally, principal component analysis is introduced to fuse features across layers and reduce dimensionality in user electricity consumption. Subsequently, we introduce the weighted density improvement Canopy-Kmeans clustering algorithm. This algorithm determines the K value and clustering centers using the maximum weight product method, based on definitions of sample density, average intra-class sample distance, and inter-class distance in the multilayer fusion feature data. Finally, we propose a fusion mechanism of weighted density improvement Canopy-Kmeans and isolation forest algorithms to jointly construct a model for detecting abnormal power usage based on multilayer fusion feature data analysis. The results demonstrate that multilayer fusion feature parameters vary in size and discretization among different user types, enabling classification of users with diverse electricity consumption patterns. Moreover, the anomaly detection model based on multilayer fusion feature data analysis improves accuracy rates, recall rates, and F1 scores compared to other algorithms.
引用
收藏
页码:99110 / 99121
页数:12
相关论文
共 50 条
  • [11] Cluster-Based Improved Isolation Forest
    Shao, Chen
    Du, Xusheng
    Yu, Jiong
    Chen, Jiaying
    ENTROPY, 2022, 24 (05)
  • [12] Online Environment Abnormal Expression Detection Based on Improved Autoencoder
    Deng, Jinwei
    Wang, Xiaopu
    Zhang, Huiquan
    2021 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS DASC/PICOM/CBDCOM/CYBERSCITECH 2021, 2021, : 554 - 559
  • [13] Two-Stream Isolation Forest Based on Deep Features for Hyperspectral Anomaly Detection
    Cheng, Xi
    Zhang, Min
    Lin, Sheng
    Zhou, Kexue
    Zhao, Shaobo
    Wang, Hai
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [14] Interpretable Anomaly Detection with DIFFI: Depth-based feature importance of Isolation Forest
    Carletti, Mattia
    Terzi, Matteo
    Susto, Gian Antonio
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
  • [15] Traffic Anomaly Detection Method Based on Improved GRU and EFMS-Kmeans Clustering
    Huo, Yonghua
    Cao, Yi
    Wang, Zhihao
    Yan, Yu
    Ge, Zhongdi
    Yang, Yang
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2021, 126 (03): : 1053 - 1091
  • [16] Distribution Forest: An Anomaly Detection Method Based on Isolation Forest
    Yao, Chengfei
    Ma, Xiaoqing
    Chen, Biao
    Zhao, Xiaosong
    Bai, Gang
    ADVANCED PARALLEL PROCESSING TECHNOLOGIES (APPT 2019), 2019, 11719 : 135 - 147
  • [17] Enhancing early attack detection: novel hybrid density-based isolation forest for improved anomaly detection
    Nalini, M.
    Yamini, B.
    Ambhika, C.
    Siva Subramanian, R.
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [18] Sea-Surface Floating Small Target Detection by Multifeature Detector Based on Isolation Forest
    Xu, Shuwen
    Zhu, Jianan
    Jiang, Junzheng
    Shui, Penglang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 704 - 715
  • [19] Abnormal Electricity Consumption Detection Method for Smart Grid Using Fusion Matrix Completion and Improved Clustering Algorithm
    Zhang, Ning
    Zhu, Liang
    IEEE ACCESS, 2024, 12 : 76634 - 76647
  • [20] Electricity Theft Detection Based on Stacked Autoencoder and the Undersampling and Resampling Based Random Forest Algorithm
    Lin, Guoying
    Feng, Xiaofeng
    Guo, Wenchong
    Cui, Xueyuan
    Liu, Shengyuan
    Jin, Weichao
    Lin, Zhenzhi
    Ding, Yi
    IEEE ACCESS, 2021, 9 (09): : 124044 - 124058