Heterogeneous Graph Attention Network for Unsupervised Multiple-Target Domain Adaptation

被引:110
|
作者
Yang, Xu [1 ]
Deng, Cheng [1 ]
Liu, Tongliang [2 ]
Tao, Dacheng [2 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Univ Sydney, Fac Engn, Sch Comp Sci, 6 Cleveland St, Darlington, NSW 2008, Australia
基金
澳大利亚研究理事会; 中国国家自然科学基金; 国家重点研发计划;
关键词
Semantics; Feature extraction; Adaptation models; Training; Task analysis; Machine learning; Data models; Heterogeneous graph learning; multiple-target domain adaptation; graph attention network;
D O I
10.1109/TPAMI.2020.3026079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Domain adaptation, which transfers the knowledge from label-rich source domain to unlabeled target domains, is a challenging task in machine learning. The prior domain adaptation methods focus on pairwise adaptation assumption with a single source and a single target domain, while little work concerns the scenario of one source domain and multiple target domains. Applying pairwise adaptation methods to this setting may be suboptimal, as they fail to consider the semantic association among multiple target domains. In this work we propose a deep semantic information propagation approach in the novel context of multiple unlabeled target domains and one labeled source domain. Our model aims to learn a unified subspace common for all domains with a heterogeneous graph attention network, where the transductive ability of the graph attention network can conduct semantic propagation of the related samples among multiple domains. In particular, the attention mechanism is applied to optimize the relationships of multiple domain samples for better semantic transfer. Then, the pseudo labels of the target domains predicted by the graph attention network are utilized to learn domain-invariant representations by aligning labeled source centroid and pseudo-labeled target centroid. We test our approach on four challenging public datasets, and it outperforms several popular domain adaptation methods.
引用
收藏
页码:1992 / 2003
页数:12
相关论文
共 50 条
  • [1] Cross-Domain Attention Network for Unsupervised Domain Adaptation Crowd Counting
    Zhang, Anran
    Xu, Jun
    Luo, Xiaoyan
    Cao, Xianbin
    Zhen, Xiantong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6686 - 6699
  • [2] Heterogeneous Domain Adaptation: An Unsupervised Approach
    Liu, Feng
    Zhang, Guangquan
    Lu, Jie
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (12) : 5588 - 5602
  • [3] Attention Guided Multiple Source and Target Domain Adaptation
    Wang, Yuxi
    Zhang, Zhaoxiang
    Hao, Wangli
    Song, Chunfeng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 892 - 906
  • [4] Generating Target Image-Label Pairs for Unsupervised Domain Adaptation
    Li, Rui
    Cao, Wenming
    Wu, Si
    Wong, Hau-San
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7997 - 8011
  • [5] Unsupervised Adversarial Domain Adaptation Network for Semantic Segmentation
    Liu, Wei
    Su, Fulin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (11) : 1978 - 1982
  • [6] Multi-Source Unsupervised Domain Adaptation via Pseudo Target Domain
    Ren, Chuan-Xian
    Liu, Yong-Hui
    Zhang, Xi-Wen
    Huang, Ke-Kun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2122 - 2135
  • [7] DADR-HCD: A Deep Domain Adaptation and Disentangled Representation Network for Unsupervised Heterogeneous Change Detection
    Dai, Anjin
    Yang, Jianyu
    Zhang, Tingting
    Gao, Bingbo
    Tang, Kaixuan
    Chen, Xinyue
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [8] Dual Attention Network for Unsupervised Domain Adaptive Person Re-Identification
    Chen, Haiqin
    Wang, Hongyuan
    Ding, Zongyuan
    Li, Penghui
    IEEE ACCESS, 2023, 11 : 88184 - 88192
  • [9] Unsupervised Domain Adaptation Semantic Segmentation for Remote-Sensing Images via Covariance Attention
    Liu, Yikun
    Kang, Xudong
    Huang, Yuwen
    Wang, Kuikui
    Yang, Gongping
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] Heterogeneous Graph Attention Network for Malicious Domain Detection
    Li, Zhiping
    Yuan, Fangfang
    Liu, Yanbing
    Cao, Cong
    Fang, Fang
    Tan, Jianlong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 506 - 518