Deep-attack over the deep reinforcement learning

被引:9
|
作者
Li, Yang [1 ]
Pan, Quan [1 ]
Cambria, Erik [2 ]
机构
[1] Northwestern Polytech Univ, Xian, Peoples R China
[2] Nanyang Technol Univ, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Adversarial attack; Deep reinforcement learning; Adversarial training;
D O I
10.1016/j.knosys.2022.108965
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent adversarial attack developments have made reinforcement learning more vulnerable, and different approaches exist to deploy attacks against it, where the key is how to choose the right timing of the attack. Some work tries to design an attack evaluation function to select critical points that will be attacked if the value is greater than a certain threshold. This approach makes it difficult to find the right place to deploy an attack without considering the long-term impact. In addition, there is a lack of appropriate indicators of assessment during attacks. To make the attacks more intelligent as well as to remedy the existing problems, we propose the reinforcement learning-based attacking framework by considering the effectiveness and stealthy spontaneously, while we also propose a new metric to evaluate the performance of the attack model in these two aspects. Experimental results show the effectiveness of our proposed model and the goodness of our proposed evaluation metric. Furthermore, we validate the transferability of the model, and also its robustness under the adversarial training. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Adversarial Attack for Deep Reinforcement Learning Based Demand Response
    Wan, Zhiqiang
    Li, Hepeng
    Shuai, Hang
    Sun, Yan
    He, Haibo
    2021 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2021,
  • [2] A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
    Morales, Eduardo F.
    Murrieta-Cid, Rafael
    Becerra, Israel
    Esquivel-Basaldua, Marco A.
    INTELLIGENT SERVICE ROBOTICS, 2021, 14 (05) : 773 - 805
  • [3] A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
    Eduardo F. Morales
    Rafael Murrieta-Cid
    Israel Becerra
    Marco A. Esquivel-Basaldua
    Intelligent Service Robotics, 2021, 14 : 773 - 805
  • [4] A Temporal-Pattern Backdoor Attack to Deep Reinforcement Learning
    Yu, Yinbo
    Liu, Jiajia
    Li, Shouqing
    Huang, Kepu
    Feng, Xudong
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2710 - 2715
  • [5] Improving Robustness of Deep Reinforcement Learning Agents: Environment Attack based on the Critic Network
    Schott, Lucas
    Hajri, Hatem
    Lamprier, Sylvain
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [6] A Black-Box Adversarial Attack via Deep Reinforcement Learning on the Feature Space
    Li, Lyue
    Rezapour, Amir
    Tzeng, Wen-Guey
    2021 IEEE CONFERENCE ON DEPENDABLE AND SECURE COMPUTING (DSC), 2021,
  • [7] Deep Reinforcement Learning for Distribution System Cyber Attack Defense with DERs
    Selim, Alaa
    Zhao, Junbo
    Ding, Fei
    Miao, Fei
    Park, Sung-Yeul
    2023 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE, ISGT, 2023,
  • [8] Destabilizing Attack and Robust Defense for Inverter-Based Microgrids by Adversarial Deep Reinforcement Learning
    Wang, Yu
    Pal, Bikash C.
    IEEE TRANSACTIONS ON SMART GRID, 2023, 14 (06) : 4839 - 4850
  • [9] Empirical study of privacy inference attack against deep reinforcement learning models
    Zhou, Huaicheng
    Mo, Kanghua
    Huang, Teng
    Li, Yongjin
    CONNECTION SCIENCE, 2023, 35 (01)
  • [10] Deep Reinforcement Learning for Partially Observable Data Poisoning Attack in Crowdsensing Systems
    Li, Mohan
    Sun, Yanbin
    Lu, Hui
    Maharjan, Sabita
    Tian, Zhihong
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 6266 - 6278