An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms

被引:78
|
作者
Kocic, Jelena [1 ]
Jovicic, Nenad [1 ]
Drndarevic, Vujo [1 ]
机构
[1] Univ Belgrade, Sch Elect Engn, Belgrade 11120, Serbia
关键词
autonomous driving; camera; convolutional neural network; deep neural network; embedded systems; end-to-end learning; machine learning; ARCHITECTURES;
D O I
10.3390/s19092064
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this paper, one solution for an end-to-end deep neural network for autonomous driving is presented. The main objective of our work was to achieve autonomous driving with a light deep neural network suitable for deployment on embedded automotive platforms. There are several end-to-end deep neural networks used for autonomous driving, where the input to the machine learning algorithm are camera images and the output is the steering angle prediction, but those convolutional neural networks are significantly more complex than the network architecture we are proposing. The network architecture, computational complexity, and performance evaluation during autonomous driving using our network are compared with two other convolutional neural networks that we re-implemented with the aim to have an objective evaluation of the proposed network. The trained model of the proposed network is four times smaller than the PilotNet model and about 250 times smaller than AlexNet model. While complexity and size of the novel network are reduced in comparison to other models, which leads to lower latency and higher frame rate during inference, our network maintained the performance, achieving successful autonomous driving with similar efficiency compared to autonomous driving using two other models. Moreover, the proposed deep neural network downsized the needs for real-time inference hardware in terms of computational power, cost, and size.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] End-to-end Learning Approach for Autonomous Driving: A Convolutional Neural Network Model
    Wang, Yaqin
    Liu, Dongfang
    Jeon, Hyewon
    Chu, Zhiwei
    Matson, Eric T.
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 833 - 839
  • [2] Robust Neural Network for Sim-to-Real Gap in End-to-End Autonomous Driving
    Pareigis, Stephan
    Maass, Fynn Luca
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS (ICINCO), 2022, : 113 - 119
  • [3] End-to-End Deep Neural Network Architectures for Speed and Steering Wheel Angle Prediction in Autonomous Driving
    Navarro, Pedro J.
    Miller, Leanne
    Rosique, Francisca
    Fernandez-Isla, Carlos
    Gila-Navarro, Alberto
    ELECTRONICS, 2021, 10 (11)
  • [4] End-to-End Deep Conditional Imitation Learning for Autonomous Driving
    Abdou, Mohammed
    Kamal, Hanan
    El-Tantawy, Samah
    Abdelkhalek, Ali
    Adel, Omar
    Hamdy, Karim
    Abaas, Mustafa
    31ST INTERNATIONAL CONFERENCE ON MICROELECTRONICS (IEEE ICM 2019), 2019, : 346 - 350
  • [5] EdgeNet: An End-to-End Deep Neural Network Pretrained with Synthetic Data for a Real-World Autonomous Driving Application
    Miller, Leanne
    Navarro, Pedro J.
    Rosique, Francisca
    SENSORS, 2025, 25 (01)
  • [6] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [7] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [8] Adversarial Driving: Attacking End-to-End Autonomous Driving
    Wu, Han
    Yunas, Syed
    Rowlands, Sareh
    Ruan, Wenjie
    Wahlstrom, Johan
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [9] Multi-Modal Sensor Fusion-Based Deep Neural Network for End-to-End Autonomous Driving With Scene Understanding
    Huang, Zhiyu
    Lv, Chen
    Xing, Yang
    Wu, Jingda
    IEEE SENSORS JOURNAL, 2021, 21 (10) : 11781 - 11790
  • [10] End-to-End Autonomous Driving: Challenges and Frontiers
    Chen, Li
    Wu, Penghao
    Chitta, Kashyap
    Jaeger, Bernhard
    Geiger, Andreas
    Li, Hongyang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 10164 - 10183