An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms

被引:78
|
作者
Kocic, Jelena [1 ]
Jovicic, Nenad [1 ]
Drndarevic, Vujo [1 ]
机构
[1] Univ Belgrade, Sch Elect Engn, Belgrade 11120, Serbia
关键词
autonomous driving; camera; convolutional neural network; deep neural network; embedded systems; end-to-end learning; machine learning; ARCHITECTURES;
D O I
10.3390/s19092064
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this paper, one solution for an end-to-end deep neural network for autonomous driving is presented. The main objective of our work was to achieve autonomous driving with a light deep neural network suitable for deployment on embedded automotive platforms. There are several end-to-end deep neural networks used for autonomous driving, where the input to the machine learning algorithm are camera images and the output is the steering angle prediction, but those convolutional neural networks are significantly more complex than the network architecture we are proposing. The network architecture, computational complexity, and performance evaluation during autonomous driving using our network are compared with two other convolutional neural networks that we re-implemented with the aim to have an objective evaluation of the proposed network. The trained model of the proposed network is four times smaller than the PilotNet model and about 250 times smaller than AlexNet model. While complexity and size of the novel network are reduced in comparison to other models, which leads to lower latency and higher frame rate during inference, our network maintained the performance, achieving successful autonomous driving with similar efficiency compared to autonomous driving using two other models. Moreover, the proposed deep neural network downsized the needs for real-time inference hardware in terms of computational power, cost, and size.
引用
收藏
页数:26
相关论文
共 50 条
  • [21] End-to-end deep learning of lane detection and path prediction for real-time autonomous driving
    Lee, Der-Hau
    Liu, Jinn-Liang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (01) : 199 - 205
  • [22] End-to-end deep learning of lane detection and path prediction for real-time autonomous driving
    Der-Hau Lee
    Jinn-Liang Liu
    Signal, Image and Video Processing, 2023, 17 : 199 - 205
  • [23] A Review of End-to-End Autonomous Driving in Urban Environments
    Coelho, Daniel
    Oliveira, Miguel
    IEEE ACCESS, 2022, 10 : 75296 - 75311
  • [24] End-to-End Federated Learning for Autonomous Driving Vehicles
    Zhang, Hongyi
    Bosch, Jan
    Olsson, Helena Holmstrom
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [25] Evaluation of End-To-End Learning for Autonomous Driving: The Good, the Bad and the Ugly
    Varisteas, Georgios
    Frank, Raphael
    Alamdari, Seyed Amin Sajadi
    Voos, Holger
    State, Radu
    2019 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2019), 2019, : 110 - 117
  • [26] End-to-end Spatiotemporal Attention Model for Autonomous Driving
    Zhao, Ruijie
    Zhang, Yanxin
    Huang, Zhiqing
    Yin, Chenkun
    PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 2649 - 2653
  • [27] SEECAD: Semantic End-to-End Communication for Autonomous Driving
    Ribouh, Soheyb
    Hadid, Abdenour
    2024 35TH IEEE INTELLIGENT VEHICLES SYMPOSIUM, IEEE IV 2024, 2024, : 1808 - 1813
  • [28] End-to-end deep learning-based autonomous driving control for high-speed environment
    Kim, Cheol-jin
    Lee, Myung-jae
    Hwang, Kyu-hong
    Ha, Young-guk
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (02) : 1961 - 1982
  • [29] Polynomial and Differential Networks for End-to-End Autonomous Driving
    Cho, Youngseong
    Lim, Kyoungil
    IEEE ACCESS, 2025, 13 : 69492 - 69499
  • [30] FOSNet: An End-to-End Trainable Deep Neural Network for Scene Recognition
    Seong, Hongje
    Hyun, Junhyuk
    Kim, Euntai
    IEEE ACCESS, 2020, 8 (08) : 82066 - 82077