SR-HGN: Semantic- and Relation-Aware Heterogeneous Graph Neural Network

被引:33
作者
Wang, Zehong [1 ,2 ]
Yu, Donghua [1 ]
Li, Qi [1 ]
Shen, Shigen [3 ]
Yao, Shuang [4 ]
机构
[1] Shaoxing Univ, Dept Comp Sci & Engn, Shaoxing 312000, Peoples R China
[2] Univ Leeds, Sch Math, Leeds LS2 9JT, England
[3] Huzhou Univ, Sch Informat Engn, Huzhou 313000, Peoples R China
[4] China Jiliang Univ, Coll Econ & Management, Hangzhou 310018, Peoples R China
基金
浙江省自然科学基金; 中国国家自然科学基金;
关键词
Graph neural network; Graph representation learning; Heterogeneous information network; Semantic-aware; Relation-aware;
D O I
10.1016/j.eswa.2023.119982
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have received considerable attention in recent years due to their unique ability to model both topologies and semantics in the graphs. In this paper, we explore the use of GNNs in learning low-dimensional node representations in Heterogeneous Information Networks (HINs), which retain rich semantic information across multiple types of nodes and relations. Existing methods for HINs generally focus on modeling heterogeneity at either the node level or the relation level, but not both. As a result, these methods often fall short of optimal performance. To address this issue, we propose a novel Semantic -and Relation-aware Heterogeneous Graph neural Network, dubbed SR-HGN, which jointly incorporates rich semantics preserved on nodes and relations. Our approach involves projecting the HINs into a low-dimensional vector space through two steps: node-level aggregation and type-level aggregation. The node-level aggregation employs an attention mechanism to create relation vectors by aggregating messages from neighborhoods connected via the same type of relation. The type-level aggregation leverages relation vectors to aggregate node representations. In particular, we introduce semantic-aware attention and relation-aware attention in the type-level aggregation to model the contributions of relation vectors, in order to simultaneously gain knowledge from node semantics and relational information. Unlike other approaches that rely on pre-defined meta-paths, our model can be readily applied to most real-world applications without requiring any domain knowledge. To validate the effectiveness of our proposed approach, we conducted extensive experiments on three public datasets. Experimental results demonstrate that the SR-HGN significantly outperforms state-of-the-art baselines on node classification and node clustering tasks.
引用
收藏
页数:13
相关论文
共 50 条
[1]   Principal component analysis [J].
Abdi, Herve ;
Williams, Lynne J. .
WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2010, 2 (04) :433-459
[2]  
Ahmed Amr, 2013, P 22 INT C WORLD WID, P37
[3]  
Brody S., 2021, International Conference on Learning Representations
[4]  
Cao S., 2015, P 24 ACM INT C INF K, P891
[5]   metapath2vec: Scalable Representation Learning for Heterogeneous Networks [J].
Dong, Yuxiao ;
Chawla, Nitesh V. ;
Swami, Ananthram .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :135-144
[6]   FDSA-STG: Fully Dynamic Self-Attention Spatio-Temporal Graph Networks for Intelligent Traffic Flow Prediction [J].
Duan, Youxiang ;
Chen, Ning ;
Shen, Shigen ;
Zhang, Peiying ;
Qu, Youyang ;
Yu, Shui .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (09) :9250-9260
[7]   HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning [J].
Fu, Tao-yang ;
Lee, Wang-Chien ;
Lei, Zhen .
CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, :1797-1806
[8]   MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embedding [J].
Fu, Xinyu ;
Zhang, Jiani ;
Men, Ziqiao ;
King, Irwin .
WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, :2331-2341
[9]   node2vec: Scalable Feature Learning for Networks [J].
Grover, Aditya ;
Leskovec, Jure .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :855-864
[10]  
Hamilton WL, 2017, ADV NEUR IN, V30