Detecting State of Charge False Reporting Attacks via Reinforcement Learning Approach

被引:7
|
作者
Alomrani, Mhd Ali [1 ]
Tushar, Mosaddek Hossain Kamal [2 ,3 ]
Kundur, Deepa [2 ]
机构
[1] Huawei Noahs Ark lab, Toronto, ON L3R 5Y1, Canada
[2] Univ Toronto, Dept Elect & Comp Engn, Toronto, ON M5S, Canada
[3] Univ Dhaka, Dept Comp Sci & Engn, Dhaka 1000, Bangladesh
基金
加拿大自然科学与工程研究理事会;
关键词
~Cybersecurity; deep learning; reinforcement learning; EV charging; MODEL;
D O I
10.1109/TITS.2023.3281476
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The increased push for green transportation has been apparent to address the alarming increase in atmospheric CO2 levels, especially in the last five years. The success and popularity of Electric Vehicles (EVs) have led many carmakers to shift to developing clean cars in the next decade. Moreover, many countries around the globe have set aggressive EV target adoption numbers, with some even aiming to ban gasoline cars by 2050. Unlike their gasoline-based counterparts, EVs comprise many sensors, communication channels, and decision-making components vulnerable to cyberattacks. Hence, the unprecedented demand for EVs requires developing robust defenses against these increasingly sophisticated attacks. In particular, recently proposed cyberattacks demonstrate how malicious owners may mislead EV charging networks by sending false data to unlawfully receive higher charging priorities, congest charging schedules, and steal power. This paper proposes a learning-based detection model that can identify deceptive electric vehicles. The model is trained on an original dataset using real driving traces and a malicious dataset generated from a reinforcement learning agent. The Reinforcement Learning (RL) agent is trained to create intelligent and stealthy attacks that can evade simple detection rules while also giving a malicious EV high charging priority. We evaluate the effectiveness of the generated attacks compared to handcrafted attacks. Moreover, our detection model trained with RL-generated attacks displays greater robustness to intelligent and stealthy attacks.
引用
收藏
页码:10467 / 10476
页数:10
相关论文
共 50 条
  • [1] Securing Smart Grids: Deep Reinforcement Learning Approach for Detecting Cyber-Attacks
    El-Toukhy, Ahmed T.
    Elgarhy, Islam
    Badr, Mahmoud M.
    Mahmoud, Mohamed
    Fouda, Mostafa M.
    Ibrahem, Mohamed I.
    Amsaad, Fathi
    2024 INTERNATIONAL CONFERENCE ON SMART APPLICATIONS, COMMUNICATIONS AND NETWORKING, SMARTNETS-2024, 2024,
  • [2] Detecting False Data Injection Attacks in Smart Grids: A Semi-Supervised Deep Learning Approach
    Zhang, Ying
    Wang, Jianhui
    Chen, Bo
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (01) : 623 - 634
  • [3] A Reinforcement Learning Approach to Undetectable Attacks Against Automatic Generation Control
    Shereen, Ezzeldin
    Kazari, Kiarash
    Dan, Gyorgy
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (01) : 959 - 972
  • [4] Power System Security Under False Data Injection Attacks With Exploitation and Exploration Based on Reinforcement Learning
    Wang, Zhisheng
    Chen, Ying
    Liu, Feng
    Xia, Yue
    Zhang, Xuemin
    IEEE ACCESS, 2018, 6 : 48785 - 48796
  • [5] Adversarial Attacks on Graph Neural Networks via Node Injections: A Hierarchical Reinforcement Learning Approach
    Sun, Yiwei
    Wang, Suhang
    Tang, Xianfeng
    Hsieh, Tsung-Yu
    Honavar, Vasant
    WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 673 - 683
  • [6] Detecting False Data Injection Attacks Against Power System State Estimation With Fast Go-Decomposition Approach
    Li, Boda
    Ding, Tao
    Huang, Can
    Zhao, Junbo
    Yang, Yongheng
    Chen, Ying
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (05) : 2892 - 2904
  • [7] Policy Teaching in Reinforcement Learning via Environment Poisoning Attacks
    Rakhsha, Amin
    Radanovic, Goran
    Devidze, Rati
    Zhu, Xiaojin
    Singla, Adish
    JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22
  • [8] Load frequency control based on reinforcement learning for microgrids under false data attacks
    Abouzeid, Said I.
    Chen, Y.
    Zaery, Mohamed
    Abido, Mohammad A.
    Raza, Asif
    Abdelhameed, Esam H.
    COMPUTERS & ELECTRICAL ENGINEERING, 2025, 123
  • [9] Counterfactual state explanations for reinforcement learning agents via generative deep learning
    Olson, Matthew L.
    Khanna, Roli
    Neal, Lawrence
    Li, Fuxin
    Wong, Weng-Keen
    ARTIFICIAL INTELLIGENCE, 2021, 295
  • [10] Detecting Stealthy False Data Injection Attacks in Power Grids Using Deep Learning
    Ashrafuzzaman, Mohammad
    Chakhchoukh, Yacine
    Jillepalli, Ananth A.
    Tosic, Predrag T.
    de Leon, Daniel Conte
    Sheldon, Frederick T.
    Johnson, Brian K.
    2018 14TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2018, : 219 - 225