End-to-End Reinforcement Learning for Self-driving Car

被引:12
|
作者
Chopra, Rohan [1 ]
Roy, Sanjiban Sekhar [1 ]
机构
[1] VIT Univ, Sch Comp Sci & Engn, Vellore, Tamil Nadu, India
来源
ADVANCED COMPUTING AND INTELLIGENT ENGINEERING | 2020年 / 1082卷
关键词
Deep learning; Reinforcement learning; TORCS; CNN; Deep Q network;
D O I
10.1007/978-981-15-1081-6_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the current self-driving cars make use of multiple algorithms to drive. Furthermore, most of the approaches use supervised learning to train a model to drive the car autonomously. This approach leads to human bias being incorporated into the model. We implement the Deep Q-Learning algorithm to control a simulated car, end-to-end, autonomously. The algorithm is based on reinforcement learning which teaches machines what to do through interactions with the environment. The application of reinforcement learning for driving is of high relevance as it is highly dependent on interactions with the environment. Our model incorporates a CNN as the deep Q network. The system was tested on an open-source car-racing simulator called TORCS. The Deep Q-Learning approach allows the system to be more efficient and robust than a system that has been trained solely through supervised training. Our simulation results show that the system is able to drive autonomously and maneuver complex curves.
引用
收藏
页码:53 / 61
页数:9
相关论文
共 50 条
  • [1] Data Augmentation Technology Driven By Image Style Transfer in Self-Driving Car Based on End-to-End Learning
    Liu, Dongjie
    Zhao, Jin
    Xi, Axin
    Wang, Chao
    Huang, Xinnian
    Lai, Kuncheng
    Liu, Chang
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2020, 122 (02): : 593 - 617
  • [2] End to End Learning based Self-Driving using JacintoNet
    Viswanath, Prashanth
    Nagori, Soyeb
    Mody, Mihir
    Mathew, Manu
    Swami, Pramod
    2018 IEEE 8TH INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - BERLIN (ICCE-BERLIN), 2018,
  • [3] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [4] CNN based Reinforcement Learning for Driving Behavior of Simulated Self-Driving Car
    Cho Y.
    Lee J.
    Lee K.
    Transactions of the Korean Institute of Electrical Engineers, 2020, 69 (11): : 1740 - 1749
  • [5] A Comprehensive Review on Deep Learning-Based Motion Planning and End-to-End Learning for Self-Driving Vehicle
    Ganesan, Manikandan
    Kandhasamy, Sivanathan
    Chokkalingam, Bharatiraja
    Mihet-Popa, Lucian
    IEEE ACCESS, 2024, 12 : 66031 - 66067
  • [6] Deep Reinforcement Learning with external control: Self-driving car application
    Youssef, Fenjiro
    Houda, Benbrahim
    4TH INTERNATIONAL CONFERENCE ON SMART CITY APPLICATIONS (SCA' 19), 2019,
  • [7] SDC-Net: End-to-End Multitask Self-Driving Car Camera Cocoon IoT-Based System
    Abdou, Mohammed
    Kamal, Hanan Ahmed
    SENSORS, 2022, 22 (23)
  • [8] Improvement of End-to-end Automatic Driving Algorithm Based on Reinforcement Learning
    Tang, Jianlin
    Li, Lingyun
    Ai, Yunfeng
    Zhao, Bin
    Ren, Liangcai
    Tian, Bin
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 5086 - 5091
  • [9] Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning
    Chen, Jianyu
    Li, Shengbo Eben
    Tomizuka, Masayoshi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 5068 - 5078
  • [10] Towards End-to-End Chase in Urban Autonomous Driving Using Reinforcement Learning
    Kolomanski, Michal
    Sakhai, Mustafa
    Nowak, Jakub
    Wielgosz, Maciej
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 3, 2023, 544 : 408 - 426