Unity-Based Autonomous Driving Environment: A Platform for Validating Reinforcement Learning Agents

被引:0
|
作者
Gonzalez-Santocildes, Asier [1 ]
Vazquez, Juan-Ignacio [1 ]
机构
[1] Univ Deusto, Fac Engn, Avda Univ 24, Bilbao 48007, Spain
来源
HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, PT II, HAIS 2024 | 2025年 / 14858卷
关键词
Artificial Intelligence; Reinforcement Learning; Development of Intelligent Environments; Autonomous Driving;
D O I
10.1007/978-3-031-74186-9_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Our aim in this research is to develop from scratch a unique racing environment in Unity with the goal of implementing and validating various reinforcement learning algorithms. Once the environment is designed, research efforts will be focused on exploring solutions through different RL (Reinforcement Learning) algorithms by modifying rewards, behaviors, and algorithms. To facilitate the implementation of a broader range of algorithms, a Wrapper will be created to allow testing of algorithms using the Stable Baselines 3 library. Additionally, the research will explore the application of different reinforcement learning techniques, such as imitation learning or curriculum learning. After achieving promising results with training a single agent, the research will explore the possibility of training multiple agents simultaneously in the environment to observe how agents learn to interact with each other. Finally, an instructional application will be developed to consolidate the knowledge generated by the various algorithms, enabling users to visually observe the agents' learning progress. In this application, each algorithm will be represented by a car, allowing users to clearly see the performance of different algorithms in races and laps around the track, highlighting their strengths and weaknesses. In summary, the entire research aims to create an instructive and interactive application where the majority of reinforcement learning algorithms can be visually validated in an environment specifically created for the research.
引用
收藏
页码:280 / 291
页数:12
相关论文
共 50 条
  • [1] Application of Reinforcement Learning in the Autonomous Driving Platform of the DeepRacer
    Zhu, Wenjie
    Du, Haikuo
    Zhu, Moyan
    Liu, Yanbo
    Lin, Chaoting
    Wang, Shaobo
    Sun, Weiqi
    Yan, Huaming
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 5345 - 5352
  • [2] Simulated Autonomous Driving Using Reinforcement Learning: A Comparative Study on Unity's ML-Agents Framework
    Savid, Yusef
    Mahmoudi, Reza
    Maskeliunas, Rytis
    Damasevicius, Robertas
    INFORMATION, 2023, 14 (05)
  • [3] Anticheat System Based on Reinforcement Learning Agents in Unity
    Lukas, Mihael
    Tomicic, Igor
    Bernik, Andrija
    INFORMATION, 2022, 13 (04)
  • [4] Simulated Autonomous Driving in a Realistic Driving Environment using Deep Reinforcement Learning and a Deterministic Finite State Machine
    Klose, Patrick
    Mester, Rudolf
    PROCEEDINGS OF 2ND INTERNATIONAL CONFERENCE ON APPLICATIONS OF INTELLIGENT SYSTEMS (APPIS 2019), 2019,
  • [5] Applications and Challenges of Reinforcement Learning in Autonomous Driving Technology
    He Y.
    Lin H.
    Liu Y.
    Yang L.
    Qu X.
    Tongji Daxue Xuebao/Journal of Tongji University, 2024, 52 (04): : 520 - 531
  • [6] Reinforcement-Learning-Based Trajectory Learning in Frenet Frame for Autonomous Driving
    Yoon, Sangho
    Kwon, Youngjoon
    Ryu, Jaesung
    Kim, Sungkwan
    Choi, Sungwoo
    Lee, Kyungjae
    APPLIED SCIENCES-BASEL, 2024, 14 (16):
  • [7] Deep Reinforcement Learning for Autonomous Driving: A Survey
    Kiran, B. Ravi
    Sobh, Ibrahim
    Talpaert, Victor
    Mannion, Patrick
    Al Sallab, Ahmad A.
    Yogamani, Senthil
    Perez, Patrick
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 4909 - 4926
  • [8] Policy-Based Reinforcement Learning for Training Autonomous Driving Agents in Urban Areas With Affordance Learning
    Ahmed, Marwa
    Abobakr, Ahmed
    Lim, Chee Peng
    Nahavandi, Saeid
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) : 12562 - 12571
  • [9] Path tracking control based on Deep reinforcement learning in Autonomous driving
    Jiang, Le
    Wang, Yafei
    Wang, Lin
    Wu, Jingkai
    2019 3RD CONFERENCE ON VEHICLE CONTROL AND INTELLIGENCE (CVCI), 2019, : 414 - 419
  • [10] Deep Reinforcement Learning for Autonomous Driving Based on Safety Experience Replay
    Huang, Xiaohan
    Cheng, Yuhu
    Yu, Qiang
    Wang, Xuesong
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (06) : 2070 - 2084