Abnormal Electricity Detection of Users Based on Improved Canopy-Kmeans and Isolation Forest Algorithms

被引:4
作者
Wang, Jianyuan [1 ]
Li, Xiaoyao [1 ]
机构
[1] Northeast Elect Power Univ, Key Lab Modern Power Syst Simulat & Control & Rene, Minist Educ, Jilin 132012, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Electricity; Clustering algorithms; Classification algorithms; Anomaly detection; Forestry; Prediction algorithms; Feature extraction; Detection algorithms; Energy consumption; Unsupervised learning; Abnormal detection of electricity consumption by users; Canopy-Kmeans algorithm; isolation forest algorithm; unsupervised learning; weighted density;
D O I
10.1109/ACCESS.2024.3429304
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the existing user abnormal electricity consumption detection methods that have the problem of difficult classification of user similar electricity consumption patterns, this paper proposes an unsupervised isolation forest abnormal electricity consumption detection model based on the Canopy-Kmeans algorithm with weighted density improvement. To start, we propose a composite parameter analysis method for user electricity consumption patterns, volatility, trends, and correlations using Irish smart meter data. This method involves joint data cleaning, interpolation, and feature construction. Additionally, principal component analysis is introduced to fuse features across layers and reduce dimensionality in user electricity consumption. Subsequently, we introduce the weighted density improvement Canopy-Kmeans clustering algorithm. This algorithm determines the K value and clustering centers using the maximum weight product method, based on definitions of sample density, average intra-class sample distance, and inter-class distance in the multilayer fusion feature data. Finally, we propose a fusion mechanism of weighted density improvement Canopy-Kmeans and isolation forest algorithms to jointly construct a model for detecting abnormal power usage based on multilayer fusion feature data analysis. The results demonstrate that multilayer fusion feature parameters vary in size and discretization among different user types, enabling classification of users with diverse electricity consumption patterns. Moreover, the anomaly detection model based on multilayer fusion feature data analysis improves accuracy rates, recall rates, and F1 scores compared to other algorithms.
引用
收藏
页码:99110 / 99121
页数:12
相关论文
共 50 条
  • [31] Research on Abnormal Detection Based on Improved Combination of K - means and SVDD
    Hao Xiaohong
    Zhang Xiaofeng
    2017 INTERNATIONAL CONFERENCE ON POWER AND ENERGY ENGINEERING, 2018, 114
  • [32] Anomaly Detection of Storage Battery Based on Isolation Forest and Hyperparameter Tuning
    Lee, Chun-Hsiang
    Lu, Xu
    Lin, Xiunao
    Tao, Hongfeng
    Xue, Yaolei
    Wu, Chao
    2020 5TH INTERNATIONAL CONFERENCE ON MATHEMATICS AND ARTIFICIAL INTELLIGENCE (ICMAI 2020), 2020, : 229 - 233
  • [33] DeepiForest: A Deep Anomaly Detection Framework with Hashing Based Isolation Forest
    Xiang, Haolong
    Hu, Hongsheng
    Zhang, Xuyun
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, : 1251 - 1256
  • [34] Hydrological Time Series Anomaly Pattern Detection based on Isolation Forest
    Qin, Yu
    Lou, YuanSheng
    PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 1706 - 1710
  • [35] A parallel algorithm for network traffic anomaly detection based on Isolation Forest
    Tao, Xiaoling
    Peng, Yang
    Zhao, Feng
    Zhao, Peichao
    Wang, Yong
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2018, 14 (11)
  • [36] Anomaly electricity detection method based on entropy weight method and isolated forest algorithm
    Wang, Jianyuan
    Gu, Chengcheng
    Liu, Kechen
    FRONTIERS IN ENERGY RESEARCH, 2022, 10
  • [37] Intelligent Video Analysis-based Forest Fires Smoke Detection Algorithms
    Cai, Min
    Lu, Xiaobo
    Wu, Xuehui
    Feng, Yifei
    2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1504 - 1508
  • [38] Isolation Forest Based Anomaly Detection Framework on Non-IID Data
    Xiang, Haolong
    Wang, Jiayu
    Ramamohanarao, Kotagiri
    Salcic, Zoran
    Dou, Wanchun
    Zhang, Xuyun
    IEEE INTELLIGENT SYSTEMS, 2021, 36 (03) : 31 - 40
  • [39] Tree-Based Credit Card Fraud Detection Using Isolation Forest, Spectral Residual, and Knowledge Graph
    Tang, Phat Loi
    Le Pham, Thuy-Dung
    Dinh, Tien Ba
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2022, PT II, 2023, 13811 : 326 - 340
  • [40] Anomaly detection model based on multi-grained cascade isolation forest algorithm
    Yang X.
    Zhang S.
    Tongxin Xuebao/Journal on Communications, 2019, 40 (08): : 133 - 142