EdgeNet: An End-to-End Deep Neural Network Pretrained with Synthetic Data for a Real-World Autonomous Driving Application

被引:0
|
作者
Miller, Leanne [1 ]
Navarro, Pedro J. [1 ]
Rosique, Francisca [1 ]
机构
[1] Univ Politecn Cartagena, Div Sistemas & Ingn Elect DSIE, Campus Muralla del Mar S-N, Cartagena 30202, Spain
关键词
end-to-end architectures; multimodal synthetic dataset; autonomous driving;
D O I
10.3390/s25010089
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel end-to-end architecture based on edge detection for autonomous driving. The architecture has been designed to bridge the domain gap between synthetic and real-world images for end-to-end autonomous driving applications and includes custom edge detection layers before the Efficient Net convolutional module. To train the architecture, RGB and depth images were used together with inertial data as inputs to predict the driving speed and steering wheel angle. To pretrain the architecture, a synthetic multimodal dataset for autonomous driving applications was created. The dataset includes driving data from 100 diverse weather and traffic scenarios, gathered from multiple sensors including cameras and an IMU as well as from vehicle control variables. The results show that including edge detection layers in the architecture improves performance for transfer learning when using synthetic and real-world data. In addition, pretraining with synthetic data reduces training time and enhances model performance when using real-world data.
引用
收藏
页数:18
相关论文
共 25 条
  • [21] SEAE: Stable end-to-end autonomous driving using event-triggered attention and exploration-driven deep reinforcement learning
    Cui, Jianping
    Yuan, Liang
    Xiao, Wendong
    Ran, Teng
    He, Li
    Zhang, Jianbo
    DISPLAYS, 2025, 87
  • [22] End-to-End Real-Time Obstacle Detection Network for Safe Self-Driving via Multi-Task Learning
    Song, Taek-Jin
    Jeong, Jongoh
    Kim, Jong-Hwan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) : 16318 - 16329
  • [23] SGLPER: A safe end-to-end autonomous driving decision framework combining deep reinforcement learning and expert demonstrations via prioritized experience replay and the Gipps model☆
    Cui, Jianping
    Yuan, Liang
    Xiao, Wendong
    Ran, Teng
    He, Li
    Zhang, Jianbo
    DISPLAYS, 2025, 88
  • [24] Synthetic Data Enhancement and Network Compression Technology of Monocular Depth Estimation for Real-Time Autonomous Driving System
    Jun, Woomin
    Yoo, Jisang
    Lee, Sungjin
    SENSORS, 2024, 24 (13)
  • [25] Real-Time Drift-Driving Control for an Autonomous Vehicle: Learning from Nonlinear Model Predictive Control via a Deep Neural Network
    Lee, Taekgyu
    Seo, Dongyoon
    Lee, Jinyoung
    Kang, Yeonsik
    ELECTRONICS, 2022, 11 (17)