An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms

被引:78
|
作者
Kocic, Jelena [1 ]
Jovicic, Nenad [1 ]
Drndarevic, Vujo [1 ]
机构
[1] Univ Belgrade, Sch Elect Engn, Belgrade 11120, Serbia
关键词
autonomous driving; camera; convolutional neural network; deep neural network; embedded systems; end-to-end learning; machine learning; ARCHITECTURES;
D O I
10.3390/s19092064
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this paper, one solution for an end-to-end deep neural network for autonomous driving is presented. The main objective of our work was to achieve autonomous driving with a light deep neural network suitable for deployment on embedded automotive platforms. There are several end-to-end deep neural networks used for autonomous driving, where the input to the machine learning algorithm are camera images and the output is the steering angle prediction, but those convolutional neural networks are significantly more complex than the network architecture we are proposing. The network architecture, computational complexity, and performance evaluation during autonomous driving using our network are compared with two other convolutional neural networks that we re-implemented with the aim to have an objective evaluation of the proposed network. The trained model of the proposed network is four times smaller than the PilotNet model and about 250 times smaller than AlexNet model. While complexity and size of the novel network are reduced in comparison to other models, which leads to lower latency and higher frame rate during inference, our network maintained the performance, achieving successful autonomous driving with similar efficiency compared to autonomous driving using two other models. Moreover, the proposed deep neural network downsized the needs for real-time inference hardware in terms of computational power, cost, and size.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] Hierarchical Interpretable Imitation Learning for End-to-End Autonomous Driving
    Teng, Siyu
    Chen, Long
    Ai, Yunfeng
    Zhou, Yuanye
    Xuanyuan, Zhe
    Hu, Xuemin
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 673 - 683
  • [32] An End-to-End Curriculum Learning Approach for Autonomous Driving Scenarios
    Anzalone, Luca
    Barra, Paola
    Barra, Silvio
    Castiglione, Aniello
    Nappi, Michele
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19817 - 19826
  • [33] End-to-End Neural Network for Autonomous Steering using LiDAR Point Cloud Data
    Yi, Xianyong
    Ghazzai, Hakim
    Massoud, Yehia
    2022 IEEE 65TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS 2022), 2022,
  • [34] MPNET: An End-to-End Deep Neural Network for Object Detection in Surveillance Video
    Wang, Hanyu
    Wang, Ping
    Qian, Xueming
    IEEE ACCESS, 2018, 6 : 30296 - 30308
  • [35] Direct Reconstruction of Ultrasound Elastography Using an End-to-End Deep Neural Network
    Wu, Sitong
    Gao, Zhifan
    Liu, Zhi
    Luo, Jianwen
    Zhang, Heye
    Li, Shuo
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 374 - 382
  • [36] CNN-based End-to-end Autonomous Driving on FPGA Using TVM and VTA
    Uetsuki Toshihiro
    Okuyama Yuichi
    Shin Jungpil
    2021 IEEE 14TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP (MCSOC 2021), 2021, : 140 - 144
  • [37] End-to-End Learning with Memory Models for Complex Autonomous Driving Tasks in Indoor Environments
    Zhihui Lai
    Thomas Bräunl
    Journal of Intelligent & Robotic Systems, 2023, 107
  • [38] End-to-End Autonomous Driving With Semantic Depth Cloud Mapping and Multi-Agent
    Natan, Oskar
    Miura, Jun
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 557 - 571
  • [39] End-to-End Learning with Memory Models for Complex Autonomous Driving Tasks in Indoor Environments
    Lai, Zhihui
    Braunl, Thomas
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2023, 107 (03)
  • [40] Performance optimization of autonomous driving control under end-to-end deadlines
    Bai, Yunhao
    Li, Li
    Wang, Zejiang
    Wang, Xiaorui
    Wang, Junmin
    REAL-TIME SYSTEMS, 2022, 58 (04) : 509 - 547