Imbalanced node classification with Graph Neural Networks: A unified approach leveraging homophily and label information

被引:1
|
作者
Lv, Dingyang [1 ]
Xu, Zhengjia [2 ]
Zhang, Jinghui [1 ]
Wang, Yuchen [1 ]
Dong, Fang [1 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Jiangsu, Peoples R China
[2] Southeast Univ, Coll Software Engn, Nanjing 211189, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Unbalanced classification; Low homophily; Graph neural networks; Label utilization; Representation learning;
D O I
10.1016/j.asoc.2023.110985
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The homophily assumption in graph theory posits that nodes with similar characteristics have a higher tendency to form connections. This principle has rendered Graph Neural Networks (GNNs) as vital tools for graph representation learning. However, many real-world graphs may exhibit a phenomenon often termed as neighbor class imbalance, which is characterized by frequent connections between dissimilar nodes, a scenario reflecting low homophily. Classical GNNs tend to overlook this issue, leading to a significant decline in performance. Prior research has attempted to address this challenge by employing high-order neighborhoods and filtering out dissimilar neighbors, yet they have paid little attention to homophily degree estimation and label utilization. In this work, we initially explore the performance of classical GNNs on a synthetic graph with varying homophily degrees, designated as SynG-N. Following this, we introduce a novel method, HLA-GNN, which integrates homophily degree estimation and label utilization to enhance classical GNNs. The degrees of homophily between node pairs are estimated using a limited set of ground-truth labels, which can be integrated into classic GNNs to guide the message aggregation process. Drawing on the label propagation algorithm, we combine the partially observed class labels to enhance the original feature space. Here, the observed class labels are randomly masked as a feature augmentation and training signal. Our experimental results on eight datasets with varying degrees of homophily underscore the effectiveness of our method. HLA-GNN achieves a 12.69%similar to 34.19% improvement on low-homophily graphs, while maintaining competitive results in homophilous settings.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networks
    Zhao, Tianxiang
    Zhang, Xiang
    Wang, Suhang
    WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 833 - 841
  • [2] Graph structure and homophily for label propagation in Graph Neural Networks
    Vandromme, Maxence
    Petiton, Serge G.
    2023 IEEE 16TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP, MCSOC, 2023, : 194 - 201
  • [3] Simplifying approach to node classification in Graph Neural Networks
    Maurya, Sunil Kumar
    Liu, Xin
    Murata, Tsuyoshi
    JOURNAL OF COMPUTATIONAL SCIENCE, 2022, 62
  • [4] Label as Equilibrium: A performance booster for Graph Neural Networks on node classification
    Luo, Yi
    Luo, Guangchun
    Duan, Guiduo
    Chen, Aiguo
    NEURAL NETWORKS, 2025, 186
  • [5] Nia-GNNs: neighbor-imbalanced aware graph neural networks for imbalanced node classification
    Sun, Yanfeng
    Wang, Yujia
    Wang, Shaofan
    APPLIED INTELLIGENCE, 2024, 54 (17-18) : 7941 - 7957
  • [6] When Do Graph Neural Networks Help with Node Classification? Investigating the Impact of Homophily Principle on Node Distinguishability
    Luan, Sitao
    Hua, Chenqing
    Xu, Minkai
    Lu, Qincheng
    Zhu, Jiaqi
    Chang, Xiao-Wen
    Fu, Jie
    Leskovec, Jure
    Precup, Doina
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [7] Imbalanced Graph Classification via Graph-of-Graph Neural Networks
    Wang, Yu
    Zhao, Yuying
    Shah, Neil
    Derr, Tyler
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2068 - 2077
  • [8] Graph Neural Network with curriculum learning for imbalanced node classification
    Li, Xiaohe
    Fan, Zide
    Huang, Feilong
    Hu, Xuming
    Deng, Yawen
    Wang, Lei
    Zhao, Xinyu
    NEUROCOMPUTING, 2024, 574
  • [9] Ensembling Graph Neural Networks for Node Classification
    Lin, Ke-Ao
    Xie, Xiao-Zhu
    Weng, Wei
    Chen, Yong
    Journal of Network Intelligence, 2024, 9 (02): : 804 - 818
  • [10] On Calibration of Graph Neural Networks for Node Classification
    Liu, Tong
    Liu, Yushan
    Hildebrandt, Marcel
    Joblin, Mitchell
    Li, Hang
    Tresp, Volker
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,