MonoSample: Synthetic 3D Data Augmentation Method in Monocular 3D Object Detection

被引:0
作者
Qiao, Junchao [1 ]
Liu, Biao [1 ]
Yang, Jiaqi [1 ]
Wang, Baohua [1 ]
Xiu, Sanmu [1 ]
Du, Xin [1 ]
Nie, Xiaobo [1 ]
机构
[1] Beijing Jiaotong Univ, Dept Elect Engn & Automat, Beijing 100082, Peoples R China
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 08期
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Training; Object detection; Data augmentation; Solid modeling; Uncertainty; Laser radar; Computer vision for transportation; deep learning for visual perception; object detection; VISION;
D O I
10.1109/LRA.2024.3414272
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In the context of autonomous driving, it is both critical and challenging to locate 3D objects by using a calibrated RGB image. Current methods typically utilize heteroscedastic aleatoric uncertainty loss to regress the depth of objects, thereby reducing the impact of noisy input while also ensuring the reliability of depth predictions. However, experimentation reveals that uncertainty loss can also lead to serious overfitting issue and performance degradation. To address this issue, we propose MonoSample, an augmentation method that collects samples from the dataset and places them randomly during training. MonoSample takes into account the occlusion relationships and applies strict restrictions to ensure the verisimilitude of the enhanced scenes. Furthermore, MonoSample avoids the complex conversion process between 2D and 3D, thereby enabling the extraction of a large number of samples and efficient operation. Experiments on different models have verified its effectiveness. Leveraging MonoSample in DID-M3D, our model achieves state-of-the-art (SOTA) performance on the KITTI 3D object detection benchmark.
引用
收藏
页码:7326 / 7332
页数:7
相关论文
共 50 条
  • [41] M3DGAF: Monocular 3D Object Detection With Geometric Appearance Awareness and Feature Fusion
    Chen, Mu
    Liu, Pengfei
    Zhao, Huaici
    IEEE SENSORS JOURNAL, 2023, 23 (11) : 11232 - 11240
  • [42] Towards Learning 3d Object Detection and 6d Pose Estimation from Synthetic Data
    Rudorfer, Martin
    Neumann, Lukas
    Krueger, Joerg
    2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1540 - 1543
  • [43] Model-based 3D object detection
    Biegelbauer, Georg
    Vincze, Markus
    Wohlkinger, Walter
    MACHINE VISION AND APPLICATIONS, 2010, 21 (04) : 497 - 516
  • [44] Relation Graph Network for 3D Object Detection in Point Clouds
    Feng, Mingtao
    Gilani, Syed Zulqarnain
    Wang, Yaonan
    Zhang, Liang
    Mian, Ajmal
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 92 - 107
  • [45] Multi-Modal 3D Object Detection by Box Matching
    Liu, Zhe
    Ye, Xiaoqing
    Zou, Zhikang
    He, Xinwei
    Tan, Xiao
    Ding, Errui
    Wang, Jingdong
    Bai, Xiang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 19917 - 19928
  • [46] An Efficient Intersection Over Union Algorithm for 3D Object Detection
    Mohammed, Sazan Ali Kamal
    Razak, Mohd Zulhakimi Ab
    Abd Rahman, Abdul Hadi
    Abu Bakar, Maria
    IEEE ACCESS, 2024, 12 : 169768 - 169786
  • [47] CAMRL: A Joint Method of Channel Attention and Multidimensional Regression Loss for 3D Object Detection in Automated Vehicles
    Gao, Honghao
    Fang, Danqing
    Xiao, Junsheng
    Hussain, Walayat
    Kim, Jung Yoon
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (08) : 8831 - 8845
  • [48] Focal Loss in 3D Object Detection
    Yun, Peng
    Tai, Lei
    Wang, Yuan
    Liu, Chengju
    Liu, Ming
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (02) : 1263 - 1270
  • [49] 3D Reconstruction and Object Detection for HoloLens
    Wu, Zequn
    Zhao, Tianhao
    Nguyen, Chuong
    2020 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2020,
  • [50] Geometry-Guided Point Generation for 3D Object Detection
    Wang, Kai
    Zhou, Mingliang
    Lin, Qing
    Niu, Guanglin
    Zhang, Xiaowei
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 136 - 140