Pseudo-Labeling with Graph Active Learning for Few-shot Node Classification

被引:4
作者
Li, Quan [1 ]
Chen, Lingwei [2 ]
Jing, Shixiong [1 ]
Wu, Dinghao [1 ]
机构
[1] Penn State Univ, Coll Informat Sci & Technol, University Pk, PA 16802 USA
[2] Wright State Univ, Dept Comp Sci & Engn, Dayton, OH 45435 USA
来源
23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023 | 2023年
关键词
node classification; graph neural networks; data augmentation; active learning; pseudo-labeling;
D O I
10.1109/ICDM58522.2023.00133
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graphs have emerged as one of the most important and powerful data structures to perform content analysis in many fields. In this line of work, node classification is a classic task, which is generally performed using graph neural networks (GNNs). Unfortunately, regular GNNs cannot be well generalized into the real-world application scenario when the labeled nodes are few. To address this challenge, we propose a novel few-shot node classification model that leverages pseudo-labeling with graph active learning. We first provide a theoretical analysis to argue that extra unlabeled data benefit few-shot classification. Inspired by this, our model proceeds by performing multi-level data augmentation with consistency and contrastive regularizations for better semi-supervised pseudo-labeling, and further devising graph active learning to facilitate pseudo-label selection and improve model effectiveness. Extensive experiments on four public citation networks have demonstrated that our model can effectively improve node classification accuracy with considerably few labeled data, which significantly outperforms all slate-of-the-art baselines by large margins.
引用
收藏
页码:1115 / 1120
页数:6
相关论文
共 36 条
[1]  
Ashmore B., 2023, CIKM
[2]   Enhancing Robustness of Graph Convolutional Networks via Dropping Graph Connections [J].
Chen, Lingwei ;
Li, Xiaoting ;
Wu, Dinghao .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT III, 2021, 12459 :412-428
[3]   Few-shot Network Anomaly Detection via Cross-network Meta-learning [J].
Ding, Kaize ;
Zhou, Qinghai ;
Tong, Hanghang ;
Liu, Huan .
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, :2448-2456
[4]   Graph Prototypical Networks for Few-shot Learning on Attributed Networks [J].
Ding, Kaize ;
Wang, Jianling ;
Li, Jundong ;
Shu, Kai ;
Liu, Chenghao ;
Liu, Huan .
CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, :295-304
[5]  
Fan Yue, 2021, DAGM GERM C PATT REC, P63
[6]  
Feng W., 2020, Advances in neural information processing systems
[7]  
Finn C, 2017, PR MACH LEARN RES, V70
[8]  
Garcia V., 2018, INT C LEARNING REPRE
[9]  
Hamilton W., 2017, NEURIPS, V30
[10]  
Han X, 2018, Arxiv, DOI arXiv:1810.10147