CPLT: Curriculum Pseudo Label Transformer for Domain Adaptive Object Detection in Foggy Weather

被引:1
|
作者
Zhang, Gege [1 ]
Wang, Luping [1 ]
Zhang, Zhiyong [1 ]
Chen, Zengping [1 ]
机构
[1] Sun Yat sen Univ, Sch Elect & Commun Engn, Shenzhen 518107, Guangdong, Peoples R China
关键词
Detection transformer (DETR); domain adaptation; flexible threshold; object detection; sliced Wasserstein distance; ADAPTATION;
D O I
10.1109/JSEN.2023.3325266
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To address the challenge of label-scarce images captured by sensor in foggy weather condition with limited labeled data for autonomous driving, domain adaptation can be applied to transfer information from a label-rich clear-weather dataset to a label-scarce adverse weather dataset. This article proposes a novel approach named curriculum pseudo label transformer (CPLT) for domain adaptive object detection (DAOD). CPLT incorporates two effective techniques to enhance the transformer's ability to detect objects across domain. First, distribution alignment curriculum (DAC) pseudo label is proposed. The key idea of DAC is to flexibly adjust class-specific thresholds by aligning the class distribution over the course of training. The second technique employed in CPLT is called instance-level feature optimal transport (IFOT), which applies sliced Wasserstein distance to minimize domain discrepancy in instance-level features while preserving the location information. Importantly, neither of these modules introduce additional trainable parameters in the network. Experimental results on five challenging benchmarks demonstrate that CPLT significantly improves domain adaptation object detection performance.
引用
收藏
页码:29857 / 29868
页数:12
相关论文
共 50 条
  • [21] Co-teaching based pseudo label refinery for cross-domain object detection
    Wang, Kunpeng
    Cai, Jingxiang
    Yao, Juan
    Liu, Peng
    Zhu, Zhiqin
    IET IMAGE PROCESSING, 2021, 15 (13) : 3189 - 3199
  • [22] High-low level task combination for object detection in foggy weather conditions
    Hu, Ke
    Wu, Fei
    Zhan, Zhenfei
    Luo, Jun
    Pu, Huayan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 98
  • [23] High-low level task combination for object detection in foggy weather conditions
    Hu, Ke
    Wu, Fei
    Zhan, Zhenfei
    Luo, Jun
    Pu, Huayan
    Journal of Visual Communication and Image Representation, 2024, 98
  • [24] Domain Contrast for Domain Adaptive Object Detection
    Liu, Feng
    Zhang, Xiaosong
    Wan, Fang
    Ji, Xiangyang
    Ye, Qixiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (12) : 8227 - 8237
  • [25] Camera and LiDAR analysis for 3D object detection in foggy weather conditions
    Nguyen Anh Minh Mai
    Duthon, Pierre
    Salmane, Pascal Housam
    Khoudour, Louahdi
    Crouzil, Alain
    Velastin, Sergio A.
    2022 12TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION SYSTEMS (ICPRS), 2022,
  • [26] Multi-Task Learning for UAV Aerial Object Detection in Foggy Weather Condition
    Fang, Wenxuan
    Zhang, Guoqing
    Zheng, Yuhui
    Chen, Yuwen
    REMOTE SENSING, 2023, 15 (18)
  • [27] MSFFA-YOLO Network: Multiclass Object Detection for Traffic Investigations in Foggy Weather
    Zhang, Qiang
    Hu, Xiaojian
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [28] MSFFA-YOLO Network: Multiclass Object Detection for Traffic Investigations in Foggy Weather
    Zhang, Qiang
    Hu, Xiaojian
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [29] Pseudo-label enhancement for weakly supervised object detection using self-supervised vision transformer
    Yang, Kequan
    Wu, Yuanchen
    Li, Jide
    Yin, Chao
    Li, Xiaoqiang
    KNOWLEDGE-BASED SYSTEMS, 2025, 311
  • [30] PSEUDO-LABEL GENERATION-EVALUATION FRAMEWORK FOR CROSS DOMAIN WEAKLY SUPERVISED OBJECT DETECTION
    Ouyang, Shengxiong
    Wang, Xinglu
    Lyu, Kejie
    Li, Yingming
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 724 - 728