Cross-domain object detection by local to global object-aware feature alignment

被引:0
作者
Yiguo Song
Zhenyu Liu
Ruining Tang
Guifang Duan
Jianrong Tan
机构
[1] Zhejiang University,The State Key Laboratory of CAD &CG
来源
Neural Computing and Applications | 2024年 / 36卷
关键词
Object detection; Unsupervised domain adaptation; Adversarial learning;
D O I
暂无
中图分类号
学科分类号
摘要
Cross-domain object detection has attracted more and more attention recently. It reduces the gap between the two domains, where the source domain is labeled and the target domain is label-agnostic. The feature alignment is a fundamental step for cross-domain object detection. However, the complex background information may lead to an unreliable feature alignment and even negative transfer. It has been found that paying more attention to the object instances is more conducive to the feature alignment. Therefore, this paper proposes a local to global object-aware feature alignment (OFA) method for cross-domain object detection. The proposed network consists of three components: (1) local object-aware feature alignment (LOFA) module, which utilizes the classification map to enhance the local object representation and achieve the local object feature alignment. (2) cross-scale attention feature alignment (CAFA) module, which employs the local cross-channel interactive attention to highlight the foreground features and aligns the features of global cross-scale fusion in the multi-scale level. (3) memory-category guided alignment (MCGA) module, which records all category features from the source domain, and then uses the memory-category features to guide the category learning of target domain. By the proposed OFA, the enhanced object information can lead to better feature alignment. The proposed method is demonstrated by the cross-domain detection in different scenarios and shows state-of-the-art performance.
引用
收藏
页码:3631 / 3644
页数:13
相关论文
共 51 条
[1]  
Liu Z(2023)Few-shot defect recognition of metal surfaces via attention-embedding and self-supervised learning J Intell Manuf 34 3507-3521
[2]  
Song Y(2015)Sun J Faster r-CNN: Towards real-time object detection with region proposal networks Adv Neural Inf Process Syst 28 91-99
[3]  
Tang R(2021)Robust and high-order correlation alignment for unsupervised domain adaptation Neural Comput Appl 33 6891-6903
[4]  
Duan G(2020)Unsupervised domain adaptation with target reconstruction and label confusion in the common subspace Neural Comput Appl 32 4743-4756
[5]  
Tan J(2021)Multiscale adversarial and weighted gradient domain adaptive network for data scarcity surface defect detection IEEE Trans Instrum Meas 70 1-10
[6]  
Ren S(2022)Domain adaptation based on source category prototypes Neural Comput Appl 34 21191-21203
[7]  
He K(2023)GradCa: generalizing to unseen domains via gradient calibration Neurocomputing 529 1-10
[8]  
Girshick R(2022)Exploring implicit domain-invariant features for domain adaptive object detection IEEE Trans Circuits Syst Video Technol 33 1816-1826
[9]  
Cheng Z(2021)Partial alignment for object detection in the wild IEEE Trans Circuits Syst Video Technol 32 5238-5251
[10]  
Chen C(2023)Multi-adversarial faster-RCNN with paradigm teacher for unrestricted object detection Int J Comput Vision 131 680-700