CMD: A Cross Mechanism Domain Adaptation Dataset for 3D Object Detection

被引:1
|
作者
Deng, Jinhao [1 ,2 ]
Ye, Wei [1 ,2 ]
Wu, Hai [1 ,2 ]
Huang, Xun [1 ,2 ]
Xia, Qiming [1 ,2 ]
Li, Xin [4 ]
Fang, Jin [3 ]
Li, Wei [3 ]
Wen, Chenglu [1 ,2 ]
Wang, Cheng [1 ,2 ]
机构
[1] Xiamen Univ, Fujian Key Lab Sensing & Comp Smart Cities, Xiamen, Peoples R China
[2] Xiamen Univ, Key Lab Multimedia Trusted Percept & Efficient Co, Minist Educ China, Xiamen, Peoples R China
[3] Inceptio, Shanghai, Peoples R China
[4] Texas A&M Univ, Sect Visual Comp & Interact Media, College Stn, TX USA
来源
COMPUTER VISION-ECCV 2024, PT LVII | 2025年 / 15115卷
关键词
Dataset; 3D Object Detection; Domain Adaptation;
D O I
10.1007/978-3-031-72998-0_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud data, representing the precise 3D layout of the scene, quickly drives the research of 3D object detection. However, the challenge arises due to the rapid iteration of 3D sensors, which leads to significantly different distributions in point clouds. This, in turn, results in subpar performance of 3D cross-sensor object detection. This paper introduces a Cross Mechanism Dataset, named CMD, to support research tackling this challenge. CMD is the first domain adaptation dataset, comprehensively encompassing diverse mechanical sensors and various scenes for 3D object detection. In terms of sensors, CMD includes 32-beam LiDAR, 128-beam LiDAR, solid-state LiDAR, 4D millimeter-wave radar, and cameras, all of which are well-synchronized and calibrated. Regarding the scenes, CMD consists of 50 sequences collocated from different scenarios, ranging from campuses to highways. Furthermore, we validated the effectiveness of various domain adaptation methods in mitigating sensor-based domain differences. We also proposed a DIG method to reduce domain disparities from the perspectives of Density, Intensity, and Geometry, which effectively bridges the domain gap between different sensors. The experimental results on the CMD dataset show that our proposed DIG method outperforms the state-of-the-art techniques, demonstrating the effectiveness of our baseline method. The dataset and the corresponding code are available at https://github.com/im-djh/CMD.
引用
收藏
页码:219 / 236
页数:18
相关论文
共 50 条
  • [1] Unsupervised Domain Adaptation for Monocular 3D Object Detection via Self-training
    Li, Zhenyu
    Chen, Zehui
    Li, Ang
    Fang, Liangji
    Jiang, Qinhong
    Liu, Xianming
    Jiang, Junjun
    COMPUTER VISION, ECCV 2022, PT IX, 2022, 13669 : 245 - 262
  • [2] Automotive Radar Dataset for Deep Learning Based 3D Object Detection
    Meyer, Michael
    Kuschk, Georg
    2019 16TH EUROPEAN RADAR CONFERENCE (EURAD), 2019, : 129 - 132
  • [3] MA-ST3D: Motion Associated Self-Training for Unsupervised Domain Adaptation on 3D Object Detection
    Zhang, Chi
    Chen, Wenbo
    Wang, Wei
    Zhang, Zhaoxiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6227 - 6240
  • [4] Adaptation via Proxy: Building Instance-Aware Proxy for Unsupervised Domain Adaptive 3D Object Detection
    Li, Ziyu
    Yao, Yuncong
    Quan, Zhibin
    Qi, Lei
    Feng, Zhen-Hua
    Yang, Wankou
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (02): : 3478 - 3492
  • [5] Cross-Modal Learning for Domain Adaptation in 3D Semantic Segmentation
    Jaritz, Maximilian
    Tuan-Hung Vu
    de Charette, Raoul
    Wirbel, Emilie
    Perez, Patrick
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 1533 - 1544
  • [6] AWDA: Adversarial and Weighted Domain Adaptation for cross-dataset change detection
    Zhang, Xueting
    Huang, Xin
    Li, Jiayi
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2025, 224 : 398 - 409
  • [7] Cross-pollination of knowledge for object detection in domain adaptation for industrial automation
    Rehman, Anwar Ur
    Gallo, Ignazio
    INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2024,
  • [8] DUA: A Domain-Unified Approach for Cross-Dataset 3D Human Pose Estimation
    Manesco, Joao Renato Ribeiro
    Berretti, Stefano
    Marana, Aparecido Nilceu
    SENSORS, 2023, 23 (17)
  • [9] DOMAIN ADAPTATION METHOD FOR DOCUMENT OBJECT DETECTION
    Xiang Junlin
    2022 19TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2022,
  • [10] Unsupervised Domain Adaptation for 3D Human Pose Estimation
    Zhang, Xiheng
    Wong, Yongkang
    Kankanhalli, Mohan S.
    Geng, Weidong
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 926 - 934