Trust-Evaluation-Based Intrusion Detection and Reinforcement Learning in Autonomous Driving

被引:24
|
作者
Xing, Rui [1 ]
Su, Zhou [2 ]
Zhang, Ning [4 ]
Peng, Yan [3 ]
Pu, Huayan [1 ]
Luo, Jun [2 ]
机构
[1] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai, Peoples R China
[2] Shanghai Univ, Shanghai, Peoples R China
[3] Shanghai Univ, Res Inst USV Engn, Shanghai, Peoples R China
[4] Texas A&M Univ Christi, Corpus Christi, TX USA
来源
IEEE NETWORK | 2019年 / 33卷 / 05期
关键词
Intrusion detection; Reinforcement learning; Autonomous vehicles; Servers; Accidents; Vehicle safety; Internet of Things; SCHEME;
D O I
10.1109/MNET.001.1800535
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With ever-increasing penetration of autonomous driving vehicles (ADVs), security becomes of significant essence to autonomous vehicular networks (AVNs). On one hand, although cryptographic systems help deal with various attacks, they cannot resolve inside attacks from compromised or malfunctioning ADVs. On the other hand, ADVs with higher automated levels are easier to attack because the automated components onboard are vulnerable to inside attacks. These issues can be mitigated well by trust-based intrusion detection. Therefore,this article presents an efficient trust-based intrusion detection framework for AVNs. First, we propose a novel trust evaluation model for ADVs, in which all the trust evaluation information of a given ADV is utilized to compute its trust value. Then, based on the trust evaluation model, a two-level intrusion detection framework is presented. In the framework, the trustworthiness of an accident or attack warning is established not only based on trust evaluation with the coverage of a roadside unit (RSU), but also the information exchanged between RSUs through the cloud server. Afterward, we propose a reinforcement-learning-based incentive mechanism to stimulate ADVs to report warnings. Through the case study, the proposed framework outperforms the conventional mechanism and can reach a higher warning detection ratio than the conventional methods.
引用
收藏
页码:54 / 60
页数:7
相关论文
共 50 条
  • [41] DeFIX: Detecting and Fixing Failure Scenarios with Reinforcement Learning in Imitation Learning Based Autonomous Driving
    Dagdanov, Resul
    Eksen, Feyza
    Durmus, Halil
    Yurdakul, Ferhat
    Ure, Nazim Kemal
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 4215 - 4220
  • [42] Multi-Input Autonomous Driving Based on Deep Reinforcement Learning With Double Bias Experience Replay
    Cui, Jianping
    Yuan, Liang
    He, Li
    Xiao, Wendong
    Ran, Teng
    Zhang, Jianbo
    IEEE SENSORS JOURNAL, 2023, 23 (11) : 11253 - 11261
  • [43] Robustness and Adaptability of Reinforcement Learning-Based Cooperative Autonomous Driving in Mixed-Autonomy Traffic
    Valiente, Rodolfo
    Toghi, Behrad
    Pedarsani, Ramtin
    Fallah, Yaser P.
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 3 : 397 - 410
  • [44] Autonomous Driving for Natural Paths Using an Improved Deep Reinforcement Learning Algorithm
    Tseng, Kuo-Kun
    Yang, Hong
    Wang, Haoyang
    Yung, Kai Leung
    Lin, Regina Fang-Ying
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2022, 58 (06) : 5118 - 5128
  • [45] Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making
    Gao, Fei
    Wang, Xiaodong
    Fan, Yuze
    Gao, Zhenhai
    Zhao, Rui
    IEEE ACCESS, 2024, 12 : 128007 - 128023
  • [46] Intrusion Detection Based on Adaptive Sample Distribution Dual-Experience Replay Reinforcement Learning
    Tan, Haonan
    Wang, Le
    Zhu, Dong
    Deng, Jianyu
    MATHEMATICS, 2024, 12 (07)
  • [47] Reinforcement Learning-Based Voting for Feature Drift-Aware Intrusion Detection: An Incremental Learning Framework
    Shyaa, Methaq A.
    Ibrahim, Noor Farizah
    Zainol, Zurinahni Binti
    Abdullah, Rosni
    Anbar, Mohammed
    IEEE Access, 2025, 13 : 37872 - 37903
  • [48] Intrusion Detection Based on Generative Adversarial Network of Reinforcement Learning Strategy for Wireless Sensor Networks
    Tu J.
    Ogola W.
    Xu D.
    Xie W.
    International Journal of Circuits, Systems and Signal Processing, 2022, 16 : 478 - 482
  • [49] Deep Q-Learning Based Reinforcement Learning Approach for Network Intrusion Detection
    Alavizadeh, Hooman
    Alavizadeh, Hootan
    Jang-Jaccard, Julian
    COMPUTERS, 2022, 11 (03)
  • [50] Reinforcement Learning for Intrusion Detection: More Model Longness and Fewer Updates
    dos Santos, Roger R.
    Viegas, Eduardo K.
    Santin, Altair O.
    Cogo, Vinicius V.
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (02): : 2040 - 2055