AdvMix: Adversarial Mixing Strategy for Unsupervised Domain Adaptive Object Detection

被引:2
作者
Chen, Ruimin [1 ,2 ,3 ]
Lv, Dailin [1 ,2 ]
Dai, Li [1 ,2 ]
Jin, Liming [1 ,2 ]
Xiang, Zhiyu [3 ]
机构
[1] Zhejiang Geely Holding Grp Co Ltd, Hangzhou 310051, Peoples R China
[2] Zhejiang Green Intelligent Vehicle & Spare Parts T, Ningbo 315336, Peoples R China
[3] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
关键词
object detection; domain adaption; adversarial learning; self-training; ADAPTATION;
D O I
10.3390/electronics13040685
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent object detection networks suffer from performance degradation when training data and test data are distinct in image styles and content distributions. In this paper, we propose a domain adaptive method, Adversarial Mixing (AdvMix), where the label-rich source domain and unlabeled target domain are jointly trained by the adversarial feature alignment and a self-training strategy. To diminish the style gap, we design the Adversarial Gradient Reversal Layer (AdvGRL), containing a global-level domain discriminator to align the domain features by gradient reversal, and an adversarial weight mapping function to enhance the stability of domain-invariant features by hard example mining. To eliminate the content gap, we introduce a region mixing self-supervised training strategy where a region of the target image with the highest confidence is selected to merge with the source image, and the synthesis image is self-supervised by the consistency loss. To improve the reliability of self-training, we propose a strict confidence metric combining both object and bounding box uncertainty. Extensive experiments conducted on three benchmarks demonstrate that AdvMix achieves prominent performance in terms of detection accuracy, surpassing existing domain adaptive methods by nearly 5% mAP.
引用
收藏
页数:20
相关论文
共 51 条
  • [1] A State-of-the-Art Survey on Deep Learning Theory and Architectures
    Alom, Md Zahangir
    Taha, Tarek M.
    Yakopcic, Chris
    Westberg, Stefan
    Sidike, Paheding
    Nasrin, Mst Shamima
    Hasan, Mahmudul
    Van Essen, Brian C.
    Awwal, Abdul A. S.
    Asari, Vijayan K.
    [J]. ELECTRONICS, 2019, 8 (03)
  • [2] Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934]
  • [3] A Semi-Supervised Object Detection Algorithm Based on Teacher-Student Models with Strong-Weak Heads
    Cai, Xiaowei
    Luo, Fuyi
    Qi, Wei
    Liu, Hong
    [J]. ELECTRONICS, 2022, 11 (23)
  • [4] Domain Adaptive Faster R-CNN for Object Detection in the Wild
    Chen, Yuhua
    Li, Wen
    Sakaridis, Christos
    Dai, Dengxin
    Van Gool, Luc
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3339 - 3348
  • [5] Cheng-Chun Hsu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12354), P733, DOI 10.1007/978-3-030-58545-7_42
  • [6] Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Driving
    Choi, Jiwoong
    Chun, Dayoung
    Kim, Hyun
    Lee, Hyuk-Jae
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 502 - 511
  • [7] Congcong Li, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12358), P481, DOI 10.1007/978-3-030-58601-0_29
  • [8] The Cityscapes Dataset for Semantic Urban Scene Understanding
    Cordts, Marius
    Omran, Mohamed
    Ramos, Sebastian
    Rehfeld, Timo
    Enzweiler, Markus
    Benenson, Rodrigo
    Franke, Uwe
    Roth, Stefan
    Schiele, Bernt
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3213 - 3223
  • [9] Unsupervised Visual Domain Adaptation Using Subspace Alignment
    Fernando, Basura
    Habrard, Amaury
    Sebban, Marc
    Tuytelaars, Tinne
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 2960 - 2967
  • [10] Ganin Y, 2017, ADV COMPUT VIS PATT, P189, DOI 10.1007/978-3-319-58347-1_10