CPLT: Curriculum Pseudo Label Transformer for Domain Adaptive Object Detection in Foggy Weather

被引:1
|
作者
Zhang, Gege [1 ]
Wang, Luping [1 ]
Zhang, Zhiyong [1 ]
Chen, Zengping [1 ]
机构
[1] Sun Yat sen Univ, Sch Elect & Commun Engn, Shenzhen 518107, Guangdong, Peoples R China
关键词
Detection transformer (DETR); domain adaptation; flexible threshold; object detection; sliced Wasserstein distance; ADAPTATION;
D O I
10.1109/JSEN.2023.3325266
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To address the challenge of label-scarce images captured by sensor in foggy weather condition with limited labeled data for autonomous driving, domain adaptation can be applied to transfer information from a label-rich clear-weather dataset to a label-scarce adverse weather dataset. This article proposes a novel approach named curriculum pseudo label transformer (CPLT) for domain adaptive object detection (DAOD). CPLT incorporates two effective techniques to enhance the transformer's ability to detect objects across domain. First, distribution alignment curriculum (DAC) pseudo label is proposed. The key idea of DAC is to flexibly adjust class-specific thresholds by aligning the class distribution over the course of training. The second technique employed in CPLT is called instance-level feature optimal transport (IFOT), which applies sliced Wasserstein distance to minimize domain discrepancy in instance-level features while preserving the location information. Importantly, neither of these modules introduce additional trainable parameters in the network. Experimental results on five challenging benchmarks demonstrate that CPLT significantly improves domain adaptation object detection performance.
引用
收藏
页码:29857 / 29868
页数:12
相关论文
共 50 条
  • [1] Domain Adaptive Object Detection for Autonomous Driving under Foggy Weather
    Li, Jinlong
    Xu, Runsheng
    Ma, Jin
    Zou, Qin
    Ma, Jiaqi
    Yu, Hongkai
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 612 - 622
  • [2] Progressive Domain Adaptive Object Detection Based on Self-Attention in Foggy Weather
    Lin, Meng
    Zhou, Gang
    Yang, Yawei
    Shi, Jun
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2023, 18 (12) : 1923 - 1931
  • [3] Domain Adaptation and Adaptive Information Fusion for Object Detection on Foggy Days
    Chen, Zhe
    Li, Xiaofang
    Zheng, Hao
    Gao, Hongmin
    Wang, Huibin
    SENSORS, 2018, 18 (10)
  • [4] ForegroundNet: Domain Adaptive Transformer for Camouflaged Object Detection
    Liu, Zhouyong
    Luo, Shun
    Sun, Shilei
    Li, Chunguo
    Huang, Yongming
    Yang, Luxi
    IEEE SENSORS JOURNAL, 2024, 24 (14) : 21972 - 21986
  • [5] Defog YOLO for road object detection in foggy weather
    Shi, Xiaolong
    Song, Anjun
    Computer Journal, 2024, 67 (11): : 3115 - 3127
  • [6] Defog YOLO for road object detection in foggy weather
    Shi, Xiaolong
    Song, Anjun
    COMPUTER JOURNAL, 2024,
  • [7] DAGL-Faster: Domain adaptive faster r-cnn for vehicle object detection in rainy and foggy weather conditions
    Hu, Mingdi
    Wu, Yi
    Yang, Yize
    Fan, Jiulun
    Jing, Bingyi
    DISPLAYS, 2023, 79
  • [8] Unsupervised Domain Adaptive Salient Object Detection through Uncertainty-Aware Pseudo-Label Learning
    Yan, Pengxiang
    Wu, Ziyi
    Liu, Mengmeng
    Zeng, Kun
    Lin, Liang
    Li, Guanbin
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3000 - 3008
  • [9] Enhancing Source-Free Domain Adaptive Object Detection with Low-Confidence Pseudo Label Distillation
    Yoon, Ilhoon
    Kwon, Hyeongjun
    Kim, Jin
    Park, Junyoung
    Jang, Hyunsung
    Sohn, Kwanghoon
    COMPUTER VISION - ECCV 2024, PT LXXXIV, 2025, 15142 : 337 - 353
  • [10] Cross-Domain Adaptive Object Detection Based on CNN Image Enhancement in Foggy Conditions
    Guo, Ying
    Liang, Ruilin
    Wang, Runmin
    Computer Engineering and Applications, 2023, 59 (16) : 187 - 195