EATSA-GNN: Edge-Aware and Two-Stage attention for enhancing graph neural networks based on teacher-student mechanisms for graph node classification

被引:2
作者
Fofanah, Abdul Joseph [1 ]
Leigh, Alpha Omar [2 ]
机构
[1] Griffith Univ, Sch Informat & Commun Technol, 170 Kessels Rd, Brisbane, Qld 4111, Australia
[2] Limkokwing Univ, Fac Informat Commun & Technol, Dept Software Engn Multimedia, Freetown, Sierra Leone
关键词
Edge-aware; Graph neural network; Two-stage attention; Node classification; Feature learning; teacher-student attention;
D O I
10.1016/j.neucom.2024.128686
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have fundamentally transformed the way in which we handle and examine data originating from non-Euclidean domains. Traditional approaches to imbalanced node classification problems, such as resampling, are ineffective because they do not take into account the underlying network structure of the edges. The limited methods available to capture the intricate connections encoded in the edges of a graph pose a significant challenge for GNNs in accurately classifying nodes. We propose EATSA-GNN model to enhance GNN node classification using Edge-Aware and Two-Stage Attention Mechanisms (EATSAGNN). EATSA-GNN focuses its initial attention on edge traits, enabling the model to differentiate the variable significance of different connections between nodes, referred to as Teacher-Attention (TA). In the second step, attention is directed towards the nodes, incorporating the knowledge obtained from the edge-level analysis referred to as Student-Attention (SA). Employing this dual strategy ensures a more sophisticated comprehension of the graph's framework, resulting in improved classification precision. The EATSA-GNN model's contribution to the field of GNNs lies in its ability to utilise both node and edge information in a cohesive manner, resulting in more accurate node classifications. This highlights the essence of the model and its potential. Comparing the EATSA-GNN model to state-of-the-arts methods with two different variants shows how strong it is and how well it can handle complex problems for node classification. This solidifies its position as one of leading solution in the field of GNN architectures and their use in complex networked systems. The exceptional performance of EATSA-GNN not only showcases its effectiveness but also underscores its potential to greatly influence the future advancement of the GNN framework. Implementation of the proposed EATSA-GNN can be accessed here https://github.com/afofanah/EATSA-GNN.
引用
收藏
页数:16
相关论文
共 60 条
[1]   Deep Over-sampling Framework for Classifying Imbalanced Data [J].
Ando, Shin ;
Huang, Chun Yuan .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 :770-785
[2]   A Survey on Hypergraph Representation Learning [J].
Antelmi, Alessia ;
Cordasco, Gennaro ;
Polato, Mirko ;
Scarano, Vittorio ;
Spagnuolo, Carmine ;
Yang, Dingqi .
ACM COMPUTING SURVEYS, 2024, 56 (01)
[3]   Molecular generative Graph Neural Networks for Drug Discovery [J].
Bongini, Pietro ;
Bianchini, Monica ;
Scarselli, Franco .
NEUROCOMPUTING, 2021, 450 :242-252
[4]  
Chatzianastasis M., 2023, AAAI CONF ARTIF INTE, DOI 10.1609/aaai.v37i6.25856
[5]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[6]  
Cheng Z., 2024, IEEE J. Biomed. Health Inf.
[7]   Hybrid sampling-based contrastive learning for imbalanced node classification [J].
Cui, Caixia ;
Wang, Jie ;
Wei, Wei ;
Liang, Jiye .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (03) :989-1001
[8]  
Fofanah A.J., Addressing imbalance in graph datasets: Introducing gate-gnn with graph ensemble weight attention and transfer learning for enhanced node classification
[9]  
Hamilton WL, 2017, ADV NEUR IN, V30
[10]  
Hu W., 2019, arXiv