Unsupervised Domain Adaptation for 3D Object Detection via Self-Training

被引:0
|
作者
Luo, Di [1 ]
机构
[1] Nankai Univ, Coll Comp Sci, Tianjin Key Lab Network & Data Secur Technol, Tianjin, Peoples R China
关键词
Autonomous driving; Point cloud; 3D object detection; Unsupervised domain adaptation;
D O I
10.1007/978-981-99-8432-9_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection based on point clouds plays a crucial role in autonomous driving. High quality detection results can provide reliable basis for subsequent stages such as trajectory prediction and path planning. Although many advanced 3D object detectors currently exist, when employing them to another domain, there is often a huge performance drop. In addition, existing domain adaptation methods for 3D object detection only focus on one or two observable factors such as scale mismatch and density variation that lead to domain shift and they do not take some invisible factors (weather, road condition and sensor type, etc.) into account. Therefore, we attempt to propose a self-training pipeline for unsupervised domain adaptation on 3D object detection. Firstly, we pretrain the detectors with a specific data processing paradigm which includes object random scaling, random beam re-sampling and etc. Then, we employ mean-teacher framework which includes cross-domain student model and target-only teacher model. We employ adversarial learning in student model, enforcing the student model to learn domain-invariant features. This process could further eliminate the invisible factors that lead to domain shift. Furthermore, in order to further obtain high-quality pseudo labels, we apply different data augmentation strategy and mutual learning between student model and teacher model. In addition, we adopt domain statistics normalization to ensure a stable training behavior. Extensive experiments under three different adaptation tasks demonstrate the effectiveness of our method.
引用
收藏
页码:307 / 318
页数:12
相关论文
共 50 条
  • [21] A multi camera unsupervised domain adaptation pipeline for object detection in cultural sites through adversarial learning and self-training
    Pasqualino, Giovanni
    Furnari, Antonino
    Farinella, Giovanni Maria
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [22] Unsupervised Learning of Object Landmarks via Self-Training Correspondence
    Mallis, Dimitrios
    Sanchez, Enrique
    Bell, Matt
    Tzimiropoulos, Georgios
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [23] Adversarial Domain Adaptation Enhanced via Self-training
    Altinel, Fazil
    Akkaya, Ibrahim Batuhan
    29TH IEEE CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS (SIU 2021), 2021,
  • [24] Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation
    Marsden, Robert A.
    Bartler, Alexander
    Doebler, Mario
    Yang, Bin
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [25] Energy-based Self-Training and Normalization for Unsupervised Domain Adaptation
    Herath, Samitha
    Fernando, Basura
    Abbasnejad, Ehsan
    Hayat, Munawar
    Khadivi, Shahram
    Harandi, Mehrtash
    Rezatofighi, Hamid
    Haffari, Gholamreza
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11619 - 11628
  • [26] Unsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Training
    Reddy, Arun
    Paul, William
    Rivera, Corban
    Shah, Ketul
    de Melo, Celso M.
    Chellappa, Rama
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 18919 - 18929
  • [27] MS3D: Leveraging Multiple Detectors for Unsupervised Domain Adaptation in 3D Object Detection
    Tsai, Darren
    Berrio, Julie Stephany
    Shan, Mao
    Nebot, Eduardo
    Worrall, Stewart
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 140 - 147
  • [28] Unsupervised Adaptation of Question Answering Systems via Generative Self-training
    Rennie, Steven J.
    Marcheret, Etienne
    Mallinar, Neil
    Nahamoo, David
    Goel, Vaibhava
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 1148 - 1157
  • [29] Adaptation via Proxy: Building Instance-Aware Proxy for Unsupervised Domain Adaptive 3D Object Detection
    Li, Ziyu
    Yao, Yuncong
    Quan, Zhibin
    Qi, Lei
    Feng, Zhen-Hua
    Yang, Wankou
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (02): : 3478 - 3492
  • [30] Unsupervised Arabic Dialect Adaptation with Self-Training
    Novotney, Scott
    Schwartz, Rich
    Khudanpur, Sanjeev
    12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 548 - +