EdgeNet: An End-to-End Deep Neural Network Pretrained with Synthetic Data for a Real-World Autonomous Driving Application

被引:0
|
作者
Miller, Leanne [1 ]
Navarro, Pedro J. [1 ]
Rosique, Francisca [1 ]
机构
[1] Univ Politecn Cartagena, Div Sistemas & Ingn Elect DSIE, Campus Muralla del Mar S-N, Cartagena 30202, Spain
关键词
end-to-end architectures; multimodal synthetic dataset; autonomous driving;
D O I
10.3390/s25010089
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel end-to-end architecture based on edge detection for autonomous driving. The architecture has been designed to bridge the domain gap between synthetic and real-world images for end-to-end autonomous driving applications and includes custom edge detection layers before the Efficient Net convolutional module. To train the architecture, RGB and depth images were used together with inertial data as inputs to predict the driving speed and steering wheel angle. To pretrain the architecture, a synthetic multimodal dataset for autonomous driving applications was created. The dataset includes driving data from 100 diverse weather and traffic scenarios, gathered from multiple sensors including cameras and an IMU as well as from vehicle control variables. The results show that including edge detection layers in the architecture improves performance for transfer learning when using synthetic and real-world data. In addition, pretraining with synthetic data reduces training time and enhances model performance when using real-world data.
引用
收藏
页数:18
相关论文
共 25 条
  • [1] Robust Neural Network for Sim-to-Real Gap in End-to-End Autonomous Driving
    Pareigis, Stephan
    Maass, Fynn Luca
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS (ICINCO), 2022, : 113 - 119
  • [2] An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms
    Kocic, Jelena
    Jovicic, Nenad
    Drndarevic, Vujo
    SENSORS, 2019, 19 (09)
  • [3] End-to-End Deep Neural Network Architectures for Speed and Steering Wheel Angle Prediction in Autonomous Driving
    Navarro, Pedro J.
    Miller, Leanne
    Rosique, Francisca
    Fernandez-Isla, Carlos
    Gila-Navarro, Alberto
    ELECTRONICS, 2021, 10 (11)
  • [4] End-to-end Learning Approach for Autonomous Driving: A Convolutional Neural Network Model
    Wang, Yaqin
    Liu, Dongfang
    Jeon, Hyewon
    Chu, Zhiwei
    Matson, Eric T.
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 833 - 839
  • [5] End-to-End Deep Conditional Imitation Learning for Autonomous Driving
    Abdou, Mohammed
    Kamal, Hanan
    El-Tantawy, Samah
    Abdelkhalek, Ali
    Adel, Omar
    Hamdy, Karim
    Abaas, Mustafa
    31ST INTERNATIONAL CONFERENCE ON MICROELECTRONICS (IEEE ICM 2019), 2019, : 346 - 350
  • [6] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [7] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [8] End-to-end deep learning of lane detection and path prediction for real-time autonomous driving
    Lee, Der-Hau
    Liu, Jinn-Liang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (01) : 199 - 205
  • [9] End-to-end deep learning of lane detection and path prediction for real-time autonomous driving
    Der-Hau Lee
    Jinn-Liang Liu
    Signal, Image and Video Processing, 2023, 17 : 199 - 205
  • [10] End-to-End Neural Network for Autonomous Steering using LiDAR Point Cloud Data
    Yi, Xianyong
    Ghazzai, Hakim
    Massoud, Yehia
    2022 IEEE 65TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS 2022), 2022,