Controllable Neural Reconstruction for Autonomous Driving

被引:0
|
作者
Toth, Mate [1 ]
Kovacs, Peter [1 ]
Bendefy, Zoltan [1 ]
Hortsin, Zoltan [1 ]
Matuszka, Tamas [1 ]
机构
[1] AiMotive, Budapest, Hungary
来源
PROCEEDINGS OF THE SIGGRAPH 2024 POSTERS | 2024年
关键词
D O I
10.1145/3641234.3671082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural scene reconstruction is gaining importance in autonomous driving, especially for closed-loop simulation of real-world recordings. This paper introduces an automated pipeline for training neural reconstruction models, utilizing sensor streams captured by a data collection vehicle. Subsequently, these models are deployed to replicate a virtual counterpart of the actual world. Additionally, the scene can be replayed or manipulated in a controlled manner. To achieve this, our in-house simulator is employed to augment the recreated static environment with dynamic agents, managing occlusion and lighting. The simulator's versatility allows for various parameter adjustments, including dynamic agent behavior and weather conditions.
引用
收藏
页数:2
相关论文
共 50 条
  • [1] Panacea: Panoramic and Controllable Video Generation for Autonomous Driving
    Wen, Yuqing
    Zhao, Yucheng
    Liu, Yingfei
    Jia, Fan
    Wang, Yanhui
    Luo, Chong
    Zhang, Chi
    Wang, Tiancai
    Sun, Xiaoyan
    Zhang, Xiangyu
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 6902 - 6912
  • [2] Neural Map Prior for Autonomous Driving
    Xiong, Xuan
    Liu, Yicheng
    Yuan, Tianyuan
    Wang, Yue
    Wang, Yilun
    Zhao, Hang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17535 - 17544
  • [3] NeuRAD: Neural Rendering for Autonomous Driving
    Tonderskis, Adam
    Lindstrom, Carl
    Hest, Georg
    Ljungberg, William
    Svensson, Lennart
    Petersson, Christoffer
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 14895 - 14904
  • [4] A road surface reconstruction dataset for autonomous driving
    Zhao, Tong
    Xie, Yichen
    Ding, Mingyu
    Yang, Lei
    Tomizuka, Masayoshi
    Wei, Yintao
    SCIENTIFIC DATA, 2024, 11 (01)
  • [5] Runtime Assurance for Autonomous Driving with Neural Reachability
    Bogomolov, Sergiy
    Hekal, Abdelrahman
    Hoxha, Bardh
    Yamaguchi, Tomoya
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2634 - 2641
  • [6] Neural Volumetric World Models for Autonomous Driving
    Huang, Zanming
    Zhang, Jimuyang
    Ohn-Bar, Eshed
    COMPUTER VISION - ECCV 2024, PT XVII, 2025, 15075 : 195 - 213
  • [7] Spiking neural networks for autonomous driving: A review
    Martinez, Fernando S.
    Casas-Roma, Jordi
    Subirats, Laia
    Parada, Raul
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 138
  • [8] SRNeRF: Super-Resolution Neural Radiance Fields for Autonomous Driving Scenario Reconstruction from Sparse Views
    Wang, Jun
    Zhu, Xiaojun
    Chen, Ziyu
    Li, Peng
    Jiang, Chunmao
    Zhang, Hui
    Yu, Chennian
    Yu, Biao
    WORLD ELECTRIC VEHICLE JOURNAL, 2025, 16 (02):
  • [9] Use of convolutional neural networks for autonomous driving maneuver
    Gonzalez-Miranda, Oscar
    Manuel Ibarra-Zannatha, Juan
    PROCEEDINGS OF THE 2021 XXIII ROBOTICS MEXICAN CONGRESS (COMROB), 2021, : 63 - 67
  • [10] Training of a convolutional neural network for autonomous vehicle Driving
    Morga Bonilla, Sergio Ivan
    Galvan Perez, Daniel
    Rivas Cambero, Ivan De Jesus
    Torres Jimenez, Jacinto
    2022 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC), 2022,