AdvMix: Adversarial Mixing Strategy for Unsupervised Domain Adaptive Object Detection

被引:3
作者
Chen, Ruimin [1 ,2 ,3 ]
Lv, Dailin [1 ,2 ]
Dai, Li [1 ,2 ]
Jin, Liming [1 ,2 ]
Xiang, Zhiyu [3 ]
机构
[1] Zhejiang Geely Holding Grp Co Ltd, Hangzhou 310051, Peoples R China
[2] Zhejiang Green Intelligent Vehicle & Spare Parts T, Ningbo 315336, Peoples R China
[3] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
关键词
object detection; domain adaption; adversarial learning; self-training; ADAPTATION;
D O I
10.3390/electronics13040685
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent object detection networks suffer from performance degradation when training data and test data are distinct in image styles and content distributions. In this paper, we propose a domain adaptive method, Adversarial Mixing (AdvMix), where the label-rich source domain and unlabeled target domain are jointly trained by the adversarial feature alignment and a self-training strategy. To diminish the style gap, we design the Adversarial Gradient Reversal Layer (AdvGRL), containing a global-level domain discriminator to align the domain features by gradient reversal, and an adversarial weight mapping function to enhance the stability of domain-invariant features by hard example mining. To eliminate the content gap, we introduce a region mixing self-supervised training strategy where a region of the target image with the highest confidence is selected to merge with the source image, and the synthesis image is self-supervised by the consistency loss. To improve the reliability of self-training, we propose a strict confidence metric combining both object and bounding box uncertainty. Extensive experiments conducted on three benchmarks demonstrate that AdvMix achieves prominent performance in terms of detection accuracy, surpassing existing domain adaptive methods by nearly 5% mAP.
引用
收藏
页数:20
相关论文
共 50 条
[21]   CornerNet: Detecting Objects as Paired Keypoints [J].
Law, Hei ;
Deng, Jia .
COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 :765-781
[22]   Spatial Attention Pyramid Network for Unsupervised Domain Adaptation [J].
Li, Congcong ;
Du, Dawei ;
Zhang, Libo ;
Wen, Longyin ;
Luo, Tiejian ;
Wu, Yanjun ;
Zhu, Pengfei .
COMPUTER VISION - ECCV 2020, PT XIII, 2020, 12358 :481-497
[23]   Domain Adaptive Object Detection for Autonomous Driving under Foggy Weather [J].
Li, Jinlong ;
Xu, Runsheng ;
Ma, Jin ;
Zou, Qin ;
Ma, Jiaqi ;
Yu, Hongkai .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :612-622
[24]  
Li WY, 2022, AAAI CONF ARTIF INTE, P1421
[25]   SIGMA: Semantic-complete Graph Matching for Domain Adaptive Object Detection [J].
Li, Wuyang ;
Liu, Xinyu ;
Yuan, Yixuan .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5281-5290
[26]  
Li XF, 2021, AAAI CONF ARTIF INTE, V35, P8474
[27]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2999-3007
[28]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[29]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[30]   ConfMix: Unsupervised Domain Adaptation for Object Detection via Confidence-based Mixing [J].
Mattolin, Giulio ;
Zanella, Luca ;
Ricci, Elisa ;
Wang, Yiming .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :423-433