GALA: Graph Diffusion-Based Alignment With Jigsaw for Source-Free Domain Adaptation

被引:4
作者
Luo, Junyu [1 ]
Gu, Yiyang [1 ]
Luo, Xiao [2 ]
Ju, Wei [1 ]
Xiao, Zhiping [2 ]
Zhao, Yusheng [1 ]
Yuan, Jingyang [1 ]
Zhang, Ming [1 ]
机构
[1] Peking Univ, Anker Embodied AI Lab, Natl Key Lab Multimedia Informat Proc, Sch Comp Sci, Beijing 100871, Peoples R China
[2] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
Graph diffusion model; graph neural network; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3416372
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation is a crucial machine learning topic, as it contains numerous applications in the real world, particularly with respect to data privacy. Existing approaches predominantly focus on euclidean data, such as images and videos, while the exploration of non-euclidean graph data remains scarce. Recent graph neural network (GNN) approaches can suffer from serious performance decline due to domain shift and label scarcity in source-free adaptation scenarios. In this study, we propose a novel method named Graph Diffusion-based Alignment with Jigsaw (GALA), tailored for source-free graph domain adaptation. To achieve domain alignment, GALA employs a graph diffusion model to reconstruct source-style graphs from target data. Specifically, a score-based graph diffusion model is trained using source graphs to learn the generative source styles. Then, we introduce perturbations to target graphs via a stochastic differential equation instead of sampling from a prior, followed by the reverse process to reconstruct source-style graphs. We feed the source-style graphs into an off-the-shelf GNN and introduce class-specific thresholds with curriculum learning, which can generate accurate and unbiased pseudo-labels for target graphs. Moreover, we develop a simple yet effective graph-mixing strategy named graph jigsaw to combine confident graphs and unconfident graphs, which can enhance generalization capabilities and robustness via consistency learning. Extensive experiments on benchmark datasets validate the effectiveness of GALA.
引用
收藏
页码:9038 / 9051
页数:14
相关论文
共 68 条
[11]  
Han XT, 2022, PR MACH LEARN RES
[12]   GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generation [J].
Huang, Han ;
Sun, Leilei ;
Du, Bowen ;
Fu, Yanjie ;
Lv, Weifeng .
2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, :201-210
[13]   A Comprehensive Survey on Deep Graph Representation Learning [J].
Ju, Wei ;
Fang, Zheng ;
Gu, Yiyang ;
Liu, Zequn ;
Long, Qingqing ;
Qiao, Ziyue ;
Qin, Yifang ;
Shen, Jianhao ;
Sun, Fang ;
Xiao, Zhiping ;
Yang, Junwei ;
Yuan, Jingyang ;
Zhao, Yusheng ;
Wang, Yifan ;
Luo, Xiao ;
Zhang, Ming .
NEURAL NETWORKS, 2024, 173
[14]  
Ju W, 2023, AAAI CONF ARTIF INTE, P4391
[15]  
Ju W, 2022, PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, P2122
[16]   KGNN: Harnessing Kernel-based Networks for Semi-supervised Graph Classification [J].
Ju, Wei ;
Yang, Junwei ;
Qu, Meng ;
Song, Weiping ;
Shen, Jianhao ;
Zhang, Ming .
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, :421-429
[17]   Derivation and validation of toxicophores for mutagenicity prediction [J].
Kazius, J ;
McGuire, R ;
Bursi, R .
JOURNAL OF MEDICINAL CHEMISTRY, 2005, 48 (01) :312-320
[18]  
Kim S, 2023, AAAI CONF ARTIF INTE, P8291
[19]  
Kipf T. N., 2017, INT C LEARN REPR
[20]  
Lee D.H., 2013, WORKSH CHALL REPR LE, V3, P896