Fast Detection of Advanced Persistent Threats for Smart Grids: A Deep Reinforcement Learning Approach

被引:2
|
作者
Yu, Shi [1 ]
机构
[1] Xiamen Univ, Dept Informat & Commun Engn, Xiamen, Peoples R China
来源
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022) | 2022年
基金
中国国家自然科学基金;
关键词
Smart grids; advanced persistent threat; reinforcement learning; GAME; DEFENSE;
D O I
10.1109/ICC45855.2022.9838858
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Data management systems in smart grids have to address advanced persistent threats (APTs), where malware injection methods are performed by the attacker to launch stealthy attacks and thus steal more data for illegal advantages. In this paper, we present a hierarchical deep reinforcement learning based APT detection scheme for smart grids, which enables the control center of the data management system to choose the APT detection policy to reduce the detection delay and improve the data protection level without knowing the attack model. Based on the state that consists of the size of the gathered power usage data, the priority level of the data, and the detection history, this scheme develops a two-level hierarchical structure to compress the high-dimensional action space and designs four deep dueling networks to accelerate the optimization speed with less over-estimation. Detection performance bound is provided and simulation results show that the proposed scheme improves both the data protection level and the utility of the control center with less detection delay.
引用
收藏
页码:2676 / 2681
页数:6
相关论文
共 50 条
  • [21] Deep Reinforcement Learning Approach for Cyberattack Detection
    Tareq, Imad
    Elbagoury, Bassant Mohamed
    El-Regaily, Salsabil Amin
    El-Horbaty, El-Sayed M.
    INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2024, 20 (05) : 15 - 30
  • [22] Detection of Advanced Persistent Threats using Artificial Intelligence for Deep Packet Inspection
    Dijk, Allard
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 2092 - 2097
  • [23] Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters
    Sun, Shuxian
    Liu, Chunyu
    Zhu, Yiqun
    He, Haihang
    Xiao, Shuai
    Wen, Jiabao
    SENSORS, 2022, 22 (21)
  • [24] Ensemble learning approach for advanced metering infrastructure in future smart grids
    Irfan, Muhammad
    Ayub, Nasir
    Althobiani, Faisal
    Masood, Sabeen
    Arbab Ahmed, Qazi
    Saeed, Muhammad Hamza
    Rahman, Saifur
    Abdushkour, Hesham
    Gommosani, Mohammad E.
    Shamji, V. R.
    Faraj Mursal, Salim Nasar
    PLOS ONE, 2023, 18 (10):
  • [25] Adversarial Attack Detection in Smart Grids Using Deep Learning Architectures
    Ness, Stephanie
    IEEE ACCESS, 2025, 13 : 16314 - 16323
  • [26] Deep reinforcement learning approach towards a smart parking architecture
    Kamran Sattar Awaisi
    Assad Abbas
    Hasan Ali Khattak
    Arsalan Ahmad
    Mazhar Ali
    Abbas Khalid
    Cluster Computing, 2023, 26 : 255 - 266
  • [27] Deep Reinforcement Learning for Optimal Energy Management of Multi-energy Smart Grids
    Bousnina, Dhekra
    Guerassimoff, Gilles
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE (LOD 2021), PT II, 2022, 13164 : 15 - 30
  • [28] Deep reinforcement learning approach towards a smart parking architecture
    Awaisi, Kamran Sattar
    Abbas, Assad
    Khattak, Hasan Ali
    Ahmad, Arsalan
    Ali, Mazhar
    Khalid, Abbas
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2023, 26 (01): : 255 - 266
  • [29] Smart Grids False Data Injection Identification: a Deep Learning Approach
    Alves, Helton do Nascimento
    Bretas, Newton G.
    Bretas, Arturo S.
    Matthews, Ben-Hur
    PROCEEDINGS OF 2019 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES EUROPE (ISGT-EUROPE), 2019,
  • [30] Empowering Grid Stability: An Advanced Hybrid Deep Learning Model for Smart Grids
    Selvi, M. Senthamil
    Kumar, C. Ranjeeth
    Kalaiarasu, M.
    Rajaram, A.
    INTERNATIONAL JOURNAL OF RENEWABLE ENERGY RESEARCH, 2024, 14 (02): : 261 - 274