CMD: A Cross Mechanism Domain Adaptation Dataset for 3D Object Detection

被引:1
|
作者
Deng, Jinhao [1 ,2 ]
Ye, Wei [1 ,2 ]
Wu, Hai [1 ,2 ]
Huang, Xun [1 ,2 ]
Xia, Qiming [1 ,2 ]
Li, Xin [4 ]
Fang, Jin [3 ]
Li, Wei [3 ]
Wen, Chenglu [1 ,2 ]
Wang, Cheng [1 ,2 ]
机构
[1] Xiamen Univ, Fujian Key Lab Sensing & Comp Smart Cities, Xiamen, Peoples R China
[2] Xiamen Univ, Key Lab Multimedia Trusted Percept & Efficient Co, Minist Educ China, Xiamen, Peoples R China
[3] Inceptio, Shanghai, Peoples R China
[4] Texas A&M Univ, Sect Visual Comp & Interact Media, College Stn, TX USA
来源
COMPUTER VISION-ECCV 2024, PT LVII | 2025年 / 15115卷
关键词
Dataset; 3D Object Detection; Domain Adaptation;
D O I
10.1007/978-3-031-72998-0_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud data, representing the precise 3D layout of the scene, quickly drives the research of 3D object detection. However, the challenge arises due to the rapid iteration of 3D sensors, which leads to significantly different distributions in point clouds. This, in turn, results in subpar performance of 3D cross-sensor object detection. This paper introduces a Cross Mechanism Dataset, named CMD, to support research tackling this challenge. CMD is the first domain adaptation dataset, comprehensively encompassing diverse mechanical sensors and various scenes for 3D object detection. In terms of sensors, CMD includes 32-beam LiDAR, 128-beam LiDAR, solid-state LiDAR, 4D millimeter-wave radar, and cameras, all of which are well-synchronized and calibrated. Regarding the scenes, CMD consists of 50 sequences collocated from different scenarios, ranging from campuses to highways. Furthermore, we validated the effectiveness of various domain adaptation methods in mitigating sensor-based domain differences. We also proposed a DIG method to reduce domain disparities from the perspectives of Density, Intensity, and Geometry, which effectively bridges the domain gap between different sensors. The experimental results on the CMD dataset show that our proposed DIG method outperforms the state-of-the-art techniques, demonstrating the effectiveness of our baseline method. The dataset and the corresponding code are available at https://github.com/im-djh/CMD.
引用
收藏
页码:219 / 236
页数:18
相关论文
共 50 条
  • [21] DASI: Learning Domain Adaptive Shape Impression for 3D Object Reconstruction
    Gao, Junna
    Kong, Dehui
    Wang, Shaofan
    Li, Jinghua
    Yin, Baocai
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5248 - 5262
  • [22] Unsupervised Domain Adaptation for 3D Keypoint Estimation via View Consistency
    Zhou, Xingyi
    Karpur, Arjun
    Gan, Chuang
    Luo, Linjie
    Huang, Qixing
    COMPUTER VISION - ECCV 2018, PT XII, 2018, 11216 : 141 - 157
  • [23] 3D bridge segmentation using semi-supervised domain adaptation
    Kellner, Maximilian
    Koenig, Timothy
    Jaekel, Jan-Iwo
    Klemt-Albert, Katharina
    Reiterer, Alexander
    AUTOMATION IN CONSTRUCTION, 2025, 172
  • [24] Multi-task Domain Adaptation for Language Grounding with 3D Objects
    Sun, Penglei
    Song, Yaoxian
    Pan, Xinglin
    Dong, Peijie
    Yang, Xiaofei
    Wang, Qiang
    Li, Zhixu
    Li, Tiefeng
    Chu, Xiaowen
    COMPUTER VISION - ECCV 2024, PT XXXIV, 2025, 15092 : 387 - 404
  • [25] A survey of 3D object detection algorithms for intelligent vehicles development
    Li, Zhen
    Du, Yuren
    Zhu, Miaomiao
    Zhou, Shi
    Zhang, Lifeng
    ARTIFICIAL LIFE AND ROBOTICS, 2022, 27 (01) : 115 - 122
  • [26] Towards Minimizing the LiDAR Sim-to-Real Domain Shift: Object-Level Local Domain Adaptation for 3D Point Clouds of Autonomous Vehicles
    Huch, Sebastian
    Lienkamp, Markus
    SENSORS, 2023, 23 (24)
  • [27] Strong-Weak Feature Alignment for 3D Object Detection
    Wang, Zhiyu
    Wang, Li
    Dai, Bin
    ELECTRONICS, 2021, 10 (10)
  • [28] Cross-Domain and Disentangled Face Manipulation With 3D Guidance
    Wang, Can
    Chai, Menglei
    He, Mingming
    Chen, Dongdong
    Liao, Jing
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (04) : 2053 - 2066
  • [29] A survey of 3D object detection algorithms for intelligent vehicles development
    Zhen Li
    Yuren Du
    Miaomiao Zhu
    Shi Zhou
    Lifeng Zhang
    Artificial Life and Robotics, 2022, 27 : 115 - 122
  • [30] A domain adaptation framework for cross-modality SAR 3D reconstruction point clouds segmentation utilizing LiDAR data
    Wang, Muhan
    Qiu, Xiaolan
    Zhang, Zhe
    Gao, Silin
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 133