Towards End-to-End Chase in Urban Autonomous Driving Using Reinforcement Learning

被引:1
|
作者
Kolomanski, Michal [1 ]
Sakhai, Mustafa [1 ]
Nowak, Jakub [1 ]
Wielgosz, Maciej [1 ,2 ]
机构
[1] AGH Univ Sci & Technol, Fac Comp Sci Elect & Telecommun, Al Adama Mickiewicza 30, PL-30059 Krakow, Poland
[2] ACC Cyfronet AGH, Nawojki 11, PL-30950 Krakow, Poland
来源
INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 3 | 2023年 / 544卷
关键词
Autonomous vehicle; Reinforcement Learning; Autonomous chase; VEHICLES;
D O I
10.1007/978-3-031-16075-2_29
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the challenging task of developing an autonomous chase protocol. First, training of an autonomous vehicle capable of driving autonomously from point A to B was developed to proceed with a chase protocol as a second step. A dedicated driving setup, based on a discrete action space and a single RGB camera, was developed through a series of experiments. A dedicated curriculum learning agenda allowed to train the model capable of performing all fundamental road maneuvers. Several reward functions were proposed, which enabled effective training of the agent. In the subsequent experiments, we selected the reward function and model that produced the most significant outcome, guaranteeing that the chasing car was within 25 m of a runaway car for 63% of the episode duration. To the best of our knowledge, this work is the first one that addressed the task of the chase in urban driving using the Reinforcement Learning approach.
引用
收藏
页码:408 / 426
页数:19
相关论文
共 50 条
  • [1] Towards End-to-End Escape in Urban Autonomous Driving Using Reinforcement Learning
    Sakhai, Mustafa
    Wielgosz, Maciej
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 21 - 40
  • [2] Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning
    Chen, Jianyu
    Li, Shengbo Eben
    Tomizuka, Masayoshi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 5068 - 5078
  • [3] End-to-End Urban Driving by Imitating a Reinforcement Learning Coach
    Zhang, Zhejun
    Liniger, Alexander
    Dai, Dengxin
    Yu, Fisher
    Van Gool, Luc
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15202 - 15212
  • [4] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [5] End-to-end Autonomous Driving in Heterogeneous Traffic Scenario Using Deep Reinforcement Learning
    Chakraborty, Soumyajit
    Kumar, Subhadeep
    Bhatt, Nirav
    Pasumarthy, Ramkrishna
    2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [6] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [7] Complex Network Cognition-Based Federated Reinforcement Learning for End-to-End Urban Autonomous Driving
    Cai, Yingfeng
    Lu, Sikai
    Wang, Hai
    Lian, Yubo
    Chen, Long
    Liu, Qingchao
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (03): : 7513 - 7525
  • [8] Stabilization Approaches for Reinforcement Learning-Based End-to-End Autonomous Driving
    Chen, Siyuan
    Wang, Meiling
    Song, Wenjie
    Yang, Yi
    Li, Yujun
    Fu, Mengyin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (05) : 4740 - 4750
  • [9] Autonomous Driving Control Using End-to-End Deep Learning
    Lee, Myoung-jae
    Ha, Young-guk
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 470 - 473
  • [10] End-to-End Urban Autonomous Driving With Safety Constraints
    Hou, Changmeng
    Zhang, Wei
    IEEE ACCESS, 2024, 12 : 132198 - 132209