Towards End-to-End Chase in Urban Autonomous Driving Using Reinforcement Learning

被引:1
|
作者
Kolomanski, Michal [1 ]
Sakhai, Mustafa [1 ]
Nowak, Jakub [1 ]
Wielgosz, Maciej [1 ,2 ]
机构
[1] AGH Univ Sci & Technol, Fac Comp Sci Elect & Telecommun, Al Adama Mickiewicza 30, PL-30059 Krakow, Poland
[2] ACC Cyfronet AGH, Nawojki 11, PL-30950 Krakow, Poland
来源
INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 3 | 2023年 / 544卷
关键词
Autonomous vehicle; Reinforcement Learning; Autonomous chase; VEHICLES;
D O I
10.1007/978-3-031-16075-2_29
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the challenging task of developing an autonomous chase protocol. First, training of an autonomous vehicle capable of driving autonomously from point A to B was developed to proceed with a chase protocol as a second step. A dedicated driving setup, based on a discrete action space and a single RGB camera, was developed through a series of experiments. A dedicated curriculum learning agenda allowed to train the model capable of performing all fundamental road maneuvers. Several reward functions were proposed, which enabled effective training of the agent. In the subsequent experiments, we selected the reward function and model that produced the most significant outcome, guaranteeing that the chasing car was within 25 m of a runaway car for 63% of the episode duration. To the best of our knowledge, this work is the first one that addressed the task of the chase in urban driving using the Reinforcement Learning approach.
引用
收藏
页码:408 / 426
页数:19
相关论文
共 50 条
  • [21] Incremental End-to-End Learning for Lateral Control in Autonomous Driving
    Kwon, Jaerock
    Khalil, Aws
    Kim, Donghyun
    Nam, Haewoon
    IEEE ACCESS, 2022, 10 : 33771 - 33786
  • [22] End-to-End Reinforcement Learning for Self-driving Car
    Chopra, Rohan
    Roy, Sanjiban Sekhar
    ADVANCED COMPUTING AND INTELLIGENT ENGINEERING, 2020, 1082 : 53 - 61
  • [23] Hierarchical Interpretable Imitation Learning for End-to-End Autonomous Driving
    Teng, Siyu
    Chen, Long
    Ai, Yunfeng
    Zhou, Yuanye
    Xuanyuan, Zhe
    Hu, Xuemin
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 673 - 683
  • [24] End-to-End Deep Conditional Imitation Learning for Autonomous Driving
    Abdou, Mohammed
    Kamal, Hanan
    El-Tantawy, Samah
    Abdelkhalek, Ali
    Adel, Omar
    Hamdy, Karim
    Abaas, Mustafa
    31ST INTERNATIONAL CONFERENCE ON MICROELECTRONICS (IEEE ICM 2019), 2019, : 346 - 350
  • [25] An End-to-End Curriculum Learning Approach for Autonomous Driving Scenarios
    Anzalone, Luca
    Barra, Paola
    Barra, Silvio
    Castiglione, Aniello
    Nappi, Michele
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19817 - 19826
  • [26] Explaining Autonomous Driving by Learning End-to-End Visual Attention
    Cultrera, Luca
    Seidenari, Lorenzo
    Becattini, Federico
    Pala, Pietro
    Del Bimbo, Alberto
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1389 - 1398
  • [27] Multimodal End-to-End Autonomous Driving
    Xiao, Yi
    Codevilla, Felipe
    Gurram, Akhil
    Urfalioglu, Onay
    Lopez, Antonio M.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (01) : 537 - 547
  • [28] Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving
    Jia, Xiaosong
    Wu, Penghao
    Chen, Li
    Xie, Jiangwei
    He, Conghui
    Yan, Junchi
    Li, Hongyang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21983 - 21994
  • [29] Adversarial Driving: Attacking End-to-End Autonomous Driving
    Wu, Han
    Yunas, Syed
    Rowlands, Sareh
    Ruan, Wenjie
    Wahlstrom, Johan
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [30] Evaluation of End-To-End Learning for Autonomous Driving: The Good, the Bad and the Ugly
    Varisteas, Georgios
    Frank, Raphael
    Alamdari, Seyed Amin Sajadi
    Voos, Holger
    State, Radu
    2019 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2019), 2019, : 110 - 117