Unity-Based Autonomous Driving Environment: A Platform for Validating Reinforcement Learning Agents

被引:0
|
作者
Gonzalez-Santocildes, Asier [1 ]
Vazquez, Juan-Ignacio [1 ]
机构
[1] Univ Deusto, Fac Engn, Avda Univ 24, Bilbao 48007, Spain
来源
HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, PT II, HAIS 2024 | 2025年 / 14858卷
关键词
Artificial Intelligence; Reinforcement Learning; Development of Intelligent Environments; Autonomous Driving;
D O I
10.1007/978-3-031-74186-9_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Our aim in this research is to develop from scratch a unique racing environment in Unity with the goal of implementing and validating various reinforcement learning algorithms. Once the environment is designed, research efforts will be focused on exploring solutions through different RL (Reinforcement Learning) algorithms by modifying rewards, behaviors, and algorithms. To facilitate the implementation of a broader range of algorithms, a Wrapper will be created to allow testing of algorithms using the Stable Baselines 3 library. Additionally, the research will explore the application of different reinforcement learning techniques, such as imitation learning or curriculum learning. After achieving promising results with training a single agent, the research will explore the possibility of training multiple agents simultaneously in the environment to observe how agents learn to interact with each other. Finally, an instructional application will be developed to consolidate the knowledge generated by the various algorithms, enabling users to visually observe the agents' learning progress. In this application, each algorithm will be represented by a car, allowing users to clearly see the performance of different algorithms in races and laps around the track, highlighting their strengths and weaknesses. In summary, the entire research aims to create an instructive and interactive application where the majority of reinforcement learning algorithms can be visually validated in an environment specifically created for the research.
引用
收藏
页码:280 / 291
页数:12
相关论文
共 50 条
  • [41] Development of a Duct Cleaning Robot Algorithm Using Reinforcement Learning-based Autonomous Driving
    Yi, Sarang
    Noh, Eunsol
    Hong, Seokmoo
    TRANSACTIONS OF THE KOREAN SOCIETY OF MECHANICAL ENGINEERS A, 2021, 45 (01) : 9 - 16
  • [42] Fear-Neuro-Inspired Reinforcement Learning for Safe Autonomous Driving
    He, Xiangkun
    Wu, Jingda
    Huang, Zhiyu
    Hu, Zhongxu
    Wang, Jun
    Sangiovanni-Vincentelli, Alberto
    Lv, Chen
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (01) : 267 - 279
  • [43] Deep Reinforcement Learning for Autonomous Driving in Amazon Web Services DeepRacer
    Petryshyn, Bohdan
    Postupaiev, Serhii
    Ben Bari, Soufiane
    Ostreika, Armantas
    INFORMATION, 2024, 15 (02)
  • [44] A Comprehensive Survey on the Application of Deep and Reinforcement Learning Approaches in Autonomous Driving
    Ben Elallid, Badr
    Benamar, Nabil
    Hafid, Abdelhakim Senhaji
    Rachidi, Tajjeeddine
    Mrani, Nabil
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (09) : 7366 - 7390
  • [45] Efficient Deep Reinforcement Learning With Imitative Expert Priors for Autonomous Driving
    Huang, Zhiyu
    Wu, Jingda
    Lv, Chen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7391 - 7403
  • [46] reinforcement learning, autonomous agents, neural networks
    Parker-Holder, Jack
    Rajan, Raghu
    Song, Xingyou
    Biedenkapp, Andre
    Miao, Yingjie
    Eimer, Theresa
    Zhang, Baohe
    Nguyen, Vu
    Calandra, Roberto
    Faust, Aleksandra
    Hutter, Frank
    Lindauer, Marius
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2022, 74 : 517 - 568
  • [47] Trust-Evaluation-Based Intrusion Detection and Reinforcement Learning in Autonomous Driving
    Xing, Rui
    Su, Zhou
    Zhang, Ning
    Peng, Yan
    Pu, Huayan
    Luo, Jun
    IEEE NETWORK, 2019, 33 (05): : 54 - 60
  • [48] Deep Reinforcement Learning with Noisy Exploration for Autonomous Driving
    Li, Ruyang
    Zhang, Yaqiang
    Zhao, Yaqian
    Wei, Hui
    Xu, Zhe
    Zhao, Kun
    PROCEEDINGS OF 2022 THE 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING, ICMLSC 20222, 2022, : 8 - 14
  • [49] A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning
    Zhang, Xiaohui
    Sun, Jie
    Wang, Yunpeng
    Sun, Jian
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 4 : 626 - 638
  • [50] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719