An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms

被引:78
|
作者
Kocic, Jelena [1 ]
Jovicic, Nenad [1 ]
Drndarevic, Vujo [1 ]
机构
[1] Univ Belgrade, Sch Elect Engn, Belgrade 11120, Serbia
关键词
autonomous driving; camera; convolutional neural network; deep neural network; embedded systems; end-to-end learning; machine learning; ARCHITECTURES;
D O I
10.3390/s19092064
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this paper, one solution for an end-to-end deep neural network for autonomous driving is presented. The main objective of our work was to achieve autonomous driving with a light deep neural network suitable for deployment on embedded automotive platforms. There are several end-to-end deep neural networks used for autonomous driving, where the input to the machine learning algorithm are camera images and the output is the steering angle prediction, but those convolutional neural networks are significantly more complex than the network architecture we are proposing. The network architecture, computational complexity, and performance evaluation during autonomous driving using our network are compared with two other convolutional neural networks that we re-implemented with the aim to have an objective evaluation of the proposed network. The trained model of the proposed network is four times smaller than the PilotNet model and about 250 times smaller than AlexNet model. While complexity and size of the novel network are reduced in comparison to other models, which leads to lower latency and higher frame rate during inference, our network maintained the performance, achieving successful autonomous driving with similar efficiency compared to autonomous driving using two other models. Moreover, the proposed deep neural network downsized the needs for real-time inference hardware in terms of computational power, cost, and size.
引用
收藏
页数:26
相关论文
共 50 条
  • [41] Intermediate Tasks Enhanced End-to-End Autonomous Driving with Uncertainty Estimation
    Huang, Xuean
    Su, Jianmei
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 133 - 138
  • [42] Performance optimization of autonomous driving control under end-to-end deadlines
    Yunhao Bai
    Li Li
    Zejiang Wang
    Xiaorui Wang
    Junmin Wang
    Real-Time Systems, 2022, 58 : 509 - 547
  • [43] Movement Control with Vehicle-to-Vehicle Communication by using End-to-End Deep Learning for Autonomous Driving
    Zhang, Zelin
    Ohya, Jun
    PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM), 2021, : 377 - 385
  • [44] Multi-modal policy fusion for end-to-end autonomous driving
    Huang, Zhenbo
    Sun, Shiliang
    Zhao, Jing
    Mao, Liang
    INFORMATION FUSION, 2023, 98
  • [45] Target-point Attention Transformer: A novel trajectory predict network for end-to-end autonomous driving
    Zhao, Yang
    Du, Jingyu
    Deng, Ruoyu
    Cheng, Hong
    2024 35TH IEEE INTELLIGENT VEHICLES SYMPOSIUM, IEEE IV 2024, 2024, : 2325 - 2330
  • [46] Precise grabbing of overlapping objects system based on end-to-end deep neural network
    Sun, Hongyu
    Cui, Xining
    Song, Zhan
    Gu, Feifei
    COMPUTER COMMUNICATIONS, 2021, 176 : 138 - 145
  • [47] HybridTE2: Hybrid Transformer-based End-to-End Learning for Autonomous Driving
    Rayakota, Haritha Prasad
    Huang, Pei-Chi
    2024 IEEE 7TH INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER-PHYSICAL SYSTEMS, ICPS 2024, 2024,
  • [48] Assuring the Safety of End-to-End Learning-Based Autonomous Driving through Runtime Monitoring
    Grieser, Joerg
    Zhang, Meng
    Warnecke, Tim
    Rausch, Andreas
    2020 23RD EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD 2020), 2020, : 476 - 483
  • [49] Generative Adversarial Imitation Learning for End-to-End Autonomous Driving on Urban Environments
    Karl Couto, Gustavo Claudio
    Antonelo, Eric Aislan
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [50] End-to-End Autonomous Driving Risk Analysis: A Behavioural Anomaly Detection Approach
    Ryan, Cian
    Murphy, Finbarr
    Mullins, Martin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (03) : 1650 - 1662