Privacy reinforcement learning for faults detection in the smart grid

被引:26
作者
Belhadi, Asma [1 ]
Djenouri, Youcef [2 ]
Srivastava, Gautam [3 ,4 ]
Jolfaei, Alireza [5 ]
Lin, Jerry Chun-Wei [6 ]
机构
[1] Kristiania Univ Coll, Oslo, Norway
[2] SINTEF Digital, Math & Cybernet, Oslo, Norway
[3] Brandon Univ, Dept Math & Comp Sci, Brandon, MB, Canada
[4] China Med Univ, Res Ctr Interneural Comp, Taichung, Taiwan
[5] Macquarie Univ, Dept Comp, Sydney, NSW, Australia
[6] Western Norway Univ Appl Sci, Dept Comp Sci Elect Engn & Math Sci, Bergen, Norway
关键词
Energy systems; Privacy learning; Reinforcement learning; Anomaly detection; Smart grid; INDUSTRIAL INTERNET; OUTLIER DETECTION; BLOCKCHAIN; THINGS;
D O I
10.1016/j.adhoc.2021.102541
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent anticipated advancements in ad hoc Wireless Mesh Networks (WMN) have made them strong natural candidates for Smart Grid's Neighborhood Area Network (NAN) and the ongoing work on Advanced Metering Infrastructure (AMI). Fault detection in these types of energy systems has recently shown lots of interest in the data science community, where anomalous behavior from energy platforms is identified. This paper develops a new framework based on privacy reinforcement learning to accurately identify anomalous patterns in a distributed and heterogeneous energy environment. The local outlier factor is first performed to derive the local simple anomalous patterns in each site of the distributed energy platform. A reinforcement privacy learning is then established using blockchain technology to merge the local anomalous patterns into global complex anomalous patterns. Besides, different optimization strategies are suggested to improve the whole outlier detection process. To demonstrate the applicability of the proposed framework, intensive experiments have been carried out on well-known CASAS (Center of Advanced Studies in Adaptive Systems) platform. Our results show that our proposed framework outperforms the baseline fault detection solutions. Recent anticipated advancements in ad hoc Wireless Mesh Networks (WMN) have made them strong natural candidates for Smart Grid's Neighborhood Area Network (NAN) and the ongoing work on Advanced Metering Infrastructure (AMI). Fault detection in these types of energy systems has recently shown lots of interest in the data science community, where anomalous behavior from energy platforms is identified. This paper develops a new framework based on privacy reinforcement learning to accurately identify anomalous patterns in a distributed and heterogeneous energy environment. The local outlier factor is first performed to derive the local simple anomalous patterns in each site of the distributed energy platform. A reinforcement privacy learning is then established using blockchain technology to merge the local anomalous patterns into global complex anomalous patterns. Besides, different optimization strategies are suggested to improve the whole outlier detection process. To demonstrate the applicability of the proposed framework, intensive experiments have been carried out on well-known CASAS (Center of Advanced Studies in Adaptive Systems) platform. Our results show that our proposed framework outperforms the baseline fault detection solutions.
引用
收藏
页数:8
相关论文
共 39 条
[1]   A fair and distributed congestion control mechanism for smart grid neighborhood area networks [J].
Astudillo Leon, Juan Pablo ;
Begin, Thomas ;
Busson, Anthony ;
de la Cruz Llopis, Luis J. .
AD HOC NETWORKS, 2020, 104
[2]   A Hierarchical Blockchain-Enabled Federated Learning Algorithm for Knowledge Sharing in Internet of Vehicles [J].
Chai, Haoye ;
Leng, Supeng ;
Chen, Yijin ;
Zhang, Ke .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (07) :3975-3986
[3]   Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks [J].
Dai, Yueyue ;
Xu, Du ;
Zhang, Ke ;
Maharjan, Sabita ;
Zhang, Yan .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (04) :4312-4324
[4]   Blockchain and Deep Reinforcement Learning Empowered Intelligent 5G Beyond [J].
Dai, Yueyue ;
Xu, Du ;
Maharjan, Sabita ;
Chen, Zhuang ;
He, Qian ;
Zhang, Yan .
IEEE NETWORK, 2019, 33 (03) :10-17
[5]   Machine Learning for Smart Building Applications: Review and Taxonomy [J].
Djenouri, Djamel ;
Laidi, Roufaida ;
Djenouri, Youcef ;
Balasingham, Ilangko .
ACM COMPUTING SURVEYS, 2019, 52 (02)
[6]   Fast and Accurate Convolution Neural Network for Detecting Manufacturing Data [J].
Djenouri, Youcef ;
Srivastava, Gautam ;
Lin, Jerry Chun-Wei .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (04) :2947-2955
[7]   Outlier Detection in Urban Traffic Flow Distributions [J].
Djenouri, Youcef ;
Zimek, Arthur ;
Chiarandini, Marco .
2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, :935-940
[8]   On the lifetime analysis of energy harvesting sensor nodes in smart grid environments [J].
Erdem, H. E. ;
Gungor, V. C. .
AD HOC NETWORKS, 2018, 75-76 :98-105
[9]   Pattern-Based Anomaly Detection in Mixed-Type Time Series [J].
Feremans, Len ;
Vercruyssen, Vincent ;
Cule, Boris ;
Meert, Wannes ;
Goethals, Bart .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT I, 2020, 11906 :240-256
[10]   Deep Learning-Based Forecasting Approach in Smart Grids With Microclustering and Bidirectional LSTM Network [J].
Jahangir, Hamidreza ;
Tayarani, Hanif ;
Gougheri, Saleh Sadeghi ;
Golkar, Masoud Aliakbar ;
Ahmadian, Ali ;
Elkamel, Ali .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (09) :8298-8309