Loose to compact feature alignment for domain adaptive object detection

被引:4
作者
Li, Yang [1 ]
Zhang, Shanshan [1 ]
Liu, Yunan [1 ]
Yang, Jian [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaptation; Object detection; Mask guided foreground alignment; Class-wise instance alignment;
D O I
10.1016/j.patrec.2024.03.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, great achievements have been made for deep learning based object detection methods. But their performance drops significantly when domain shifts occur. To address this problem, in this work we propose a loose to compact feature alignment method under an unsupervised domain adaptation framework. The entire feature alignment is performed in a divide and conquer manner, so as to distribute the alignment difficulties at two steps. At the first step, we loosen the goal at both image and instance levels. At the image level, a new Mask Guided Foreground Alignment (MGFA) module is proposed to make the alignment focus more on easier foreground regions, leaving the more diverse and more difficult background regions to the second step; at the instance level, we propose a Class -Wise Instance Alignment (CWIA) module with separated domain classifiers for different categories so as to ease the alignment. At the second step, the alignment is performed per pixel and per instance, achieving a more compact and better aligned feature space. We conduct experiments on three different adaptation scenarios, where we achieve comparable results, demonstrating the effectiveness of our proposed method.
引用
收藏
页码:92 / 98
页数:7
相关论文
共 52 条
[1]   Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks [J].
Bousmalis, Konstantinos ;
Silberman, Nathan ;
Dohan, David ;
Erhan, Dumitru ;
Krishnan, Dilip .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :95-104
[2]   Exploring Object Relation in Mean Teacher for Cross-Domain Detection [J].
Cai, Qi ;
Pan, Yingwei ;
Ngo, Chong-Wah ;
Tian, Xinmei ;
Duan, Lingyu ;
Yao, Ting .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11449-11458
[3]   Relation Matters: Foreground-Aware Graph-Based Relational Reasoning for Domain Adaptive Object Detection [J].
Chen, Chaoqi ;
Li, Jiongcheng ;
Zhou, Hong-Yu ;
Han, Xiaoguang ;
Huang, Yue ;
Ding, Xinghao ;
Yu, Yizhou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) :3677-3694
[4]   Sequential Instance Refinement for Cross-Domain Object Detection in Images [J].
Chen, Jin ;
Wu, Xinxiao ;
Duan, Lixin ;
Chen, Lin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :3970-3984
[5]   Domain Adaptive Faster R-CNN for Object Detection in the Wild [J].
Chen, Yuhua ;
Li, Wen ;
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3339-3348
[6]   The Cityscapes Dataset for Semantic Urban Scene Understanding [J].
Cordts, Marius ;
Omran, Mohamed ;
Ramos, Sebastian ;
Rehfeld, Timo ;
Enzweiler, Markus ;
Benenson, Rodrigo ;
Franke, Uwe ;
Roth, Stefan ;
Schiele, Bernt .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3213-3223
[7]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[8]   Joint Clustering and Discriminative Feature Alignment for Unsupervised Domain Adaptation [J].
Deng, Wanxia ;
Liao, Qing ;
Zhao, Lingjun ;
Guo, Deke ;
Kuang, Gangyao ;
Hu, Dewen ;
Liu, Li .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :7842-7855
[9]  
Ganin Y, 2015, PR MACH LEARN RES, V37, P1180
[10]  
Geiger A, 2012, PROC CVPR IEEE, P3354, DOI 10.1109/CVPR.2012.6248074