CPLT: Curriculum Pseudo Label Transformer for Domain Adaptive Object Detection in Foggy Weather

被引:1
|
作者
Zhang, Gege [1 ]
Wang, Luping [1 ]
Zhang, Zhiyong [1 ]
Chen, Zengping [1 ]
机构
[1] Sun Yat sen Univ, Sch Elect & Commun Engn, Shenzhen 518107, Guangdong, Peoples R China
关键词
Detection transformer (DETR); domain adaptation; flexible threshold; object detection; sliced Wasserstein distance; ADAPTATION;
D O I
10.1109/JSEN.2023.3325266
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To address the challenge of label-scarce images captured by sensor in foggy weather condition with limited labeled data for autonomous driving, domain adaptation can be applied to transfer information from a label-rich clear-weather dataset to a label-scarce adverse weather dataset. This article proposes a novel approach named curriculum pseudo label transformer (CPLT) for domain adaptive object detection (DAOD). CPLT incorporates two effective techniques to enhance the transformer's ability to detect objects across domain. First, distribution alignment curriculum (DAC) pseudo label is proposed. The key idea of DAC is to flexibly adjust class-specific thresholds by aligning the class distribution over the course of training. The second technique employed in CPLT is called instance-level feature optimal transport (IFOT), which applies sliced Wasserstein distance to minimize domain discrepancy in instance-level features while preserving the location information. Importantly, neither of these modules introduce additional trainable parameters in the network. Experimental results on five challenging benchmarks demonstrate that CPLT significantly improves domain adaptation object detection performance.
引用
收藏
页码:29857 / 29868
页数:12
相关论文
共 50 条
  • [31] Object and Pedestrian Detection on Road in Foggy Weather Conditions by Hyperparameterized YOLOv8 Model
    Esmaeil Abbasi, Ahmad
    Mangini, Agostino Marcello
    Fanti, Maria Pia
    ELECTRONICS, 2024, 13 (18)
  • [32] Dehazing & Reasoning YOLO: Prior knowledge-guided network for object detection in foggy weather
    Zhong, Fujin
    Shen, Wenxin
    Yu, Hong
    Wang, Guoyin
    Hu, Jun
    PATTERN RECOGNITION, 2024, 156
  • [33] 3D Object Detection with SLS-Fusion Network in Foggy Weather Conditions
    Nguyen Anh Minh Mai
    Duthon, Pierre
    Khoudour, Louahdi
    Crouzil, Alain
    Velastin, Sergio A.
    SENSORS, 2021, 21 (20)
  • [34] Learning Camouflaged Object Detection from Noisy Pseudo Label
    Zhang, Jin
    Zhang, Ruiheng
    Shi, Yanjiao
    Cao, Zhe
    Liu, Nian
    Khan, Fahad Shahbaz
    COMPUTER VISION-ECCV 2024, PT I, 2025, 15059 : 158 - 174
  • [35] PLS: UNSUPERVISED DOMAIN ADAPTATION FOR 3D OBJECT DETECTION VIA PSEUDO-LABEL SIZES
    Chen, Shijie
    Wang, Rongquan
    Li, Xin
    Wu, Yuchen
    Liu, Haizhuang
    Chen, Jiansheng
    Ma, Huimin
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6370 - 6374
  • [36] Pseudo Label Refinery for Unsupervised Domain Adaptation on Cross-dataset 3D Object Detection
    Zhang, Zhanwei
    Chen, Minghao
    Xiao, Shuai
    Peng, Liang
    la Li, Hen
    Lin, Binbin
    Li, Ping
    Wang, Wenxiao
    Wu, Boxi
    Cai, Deng
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 15291 - 15300
  • [37] DA-RAW: Domain Adaptive Object Detection for Real-World Adverse Weather Conditions
    Jeon, Minsik
    Seo, Junwon
    Min, Jihong
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 2013 - 2020
  • [38] An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions
    Eskandar, George
    Marsden, Robert A.
    Pandiyan, Pavithran
    Doebler, Mario
    Guirguis, Karim
    Yang, Bin
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 10865 - 10872
  • [39] Domain Adaptive Object Detection with Dehazing Module
    Pan, Gang
    Liu, Kang
    Li, Jingxin
    Zhang, Rufei
    Shen, Sheng
    Zeng, Zhiliang
    Wang, Jiahao
    Sun, Di
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XI, ICIC 2024, 2024, 14872 : 74 - 83
  • [40] SAMPLING FOR UNSUPERVISED DOMAIN ADAPTIVE OBJECT DETECTION
    Mirrashed, Fatemeh
    Morariu, Vlad I.
    Davis, Larry S.
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 3288 - 3292