An Efficient Sequential Decentralized Federated Progressive Channel Pruning Strategy for Smart Grid Electricity Theft Detection

被引:0
作者
Guo, Fanghong [1 ]
Li, Shengwei [1 ]
Yang, Hao [1 ]
Dong, Chen [1 ]
Chen, Yifang [2 ]
Li, Guoqi [3 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou 310023, Peoples R China
[2] Hangzhou Power Supply Co, State Grid Zhejiang Elect Power Co Ltd, Hangzhou 310016, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Data models; Computational modeling; Training; Servers; Biological system modeling; Data privacy; Electricity; Adaptation models; Costs; Distributed databases; Decentralized federated learning (FL); electricity theft detection (ETD); model pruning; privacy protection; smart grid; ALGORITHM; SECURITY;
D O I
10.1109/TII.2024.3507183
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article aims to develop a lightweight, decentralized federated learning (FL)-based strategy for electricity theft detection (ETD). Different from most of the existing ETD solutions, which typically deploy centralized deep learning models, our proposed method utilizes well-pruned lightweight networks and operates in a completely decentralized manner while maintaining the performance of the ETD model. Specifically, to protect data privacy, a novel sequential decentralized FL (SDFL) framework was designed, eliminating the centralized parameter aggregation node in traditional FL. Each client communicates model parameters only with its neighbors and trains its model locally. In addition, to facilitate deployment on edge devices, model pruning techniques are integrated with the sequential transmission characteristics of the SDFL framework. A progressive channel pruning technique is proposed, gradually reducing the number of model channels during training to promote model compression and simplify field deployment. Experiments demonstrate that our strategy compressed the model floating point operations from 18.32 to 3.60M and reduced the number of parameters from 8.61 to 3.47M, while protecting user privacy, and maintaining good performance. Deployment results on the edge devices, i.e., Raspberry Pi, indicate that our proposed strategy reduces the model inference time from 329.35 to 141.50 s, enhancing the detection efficiency by 57.04%.
引用
收藏
页码:2393 / 2402
页数:10
相关论文
共 30 条
[1]   Review of various modeling techniques for the detection of electricity theft in smart grid environment [J].
Ahmad, Tanveer ;
Chen, Huanxin ;
Wang, Jiangyu ;
Guo, Yabin .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2018, 82 :2916-2933
[2]   PEPPER: Empowering User-Centric Recommender Systems over Gossip Learning [J].
Belal, Yacine ;
Bellet, Aurelien ;
Ben Mokhtar, Sonia ;
Nitu, Vlad .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (03)
[3]   Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey [J].
Deng, Lei ;
Li, Guoqi ;
Han, Song ;
Shi, Luping ;
Xie, Yuan .
PROCEEDINGS OF THE IEEE, 2020, 108 (04) :485-532
[4]  
Dineshkumar K, 2015, 2015 INTERNATIONAL CONFERENCED ON CIRCUITS, POWER AND COMPUTING TECHNOLOGIES (ICCPCT-2015)
[5]   FPETD: Fault-Tolerant and Privacy-Preserving Electricity Theft Detection [J].
Dong, Siliang ;
Zeng, Zhixin ;
Liu, Yining .
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
[6]   A distributed hierarchical algorithm for multi-cluster constrained optimization [J].
Guo, Fanghong ;
Wen, Changyun ;
Mao, Jianfeng ;
Li, Guoqi ;
Song, Yong-Duan .
AUTOMATICA, 2017, 77 :230-238
[7]   EIE: Efficient Inference Engine on Compressed Deep Neural Network [J].
Han, Song ;
Liu, Xingyu ;
Mao, Huizi ;
Pu, Jing ;
Pedram, Ardavan ;
Horowitz, Mark A. ;
Dally, William J. .
2016 ACM/IEEE 43RD ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA), 2016, :243-254
[8]   Electricity Theft Detection in Smart Grid Systems: A CNN-LSTM Based Approach [J].
Hasan, Md. Nazmul ;
Toma, Rafia Nishat ;
Abdullah-Al Nahid ;
Islam, M. M. Manjurul ;
Kim, Jong-Myon .
ENERGIES, 2019, 12 (17)
[9]   Privacy-preserving and Efficient Decentralized Federated Learning-based Energy Theft Detector [J].
Ibrahem, Mohamed I. ;
Mahmoud, Mohamed ;
Fouda, Mostafa M. ;
ElHalawany, Basem M. ;
Alasmary, Waleed .
2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, :287-292
[10]   Model Pruning Enables Efficient Federated Learning on Edge Devices [J].
Jiang, Yuang ;
Wang, Shiqiang ;
Valls, Victor ;
Ko, Bong Jun ;
Lee, Wei-Han ;
Leung, Kin K. ;
Tassiulas, Leandros .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) :10374-10386