Improving graph neural network via complex-network-based anchor structure

被引:14
作者
Dong, Lijun [1 ,2 ]
Yao, Hong [1 ,2 ]
Li, Dan [1 ]
Wang, Yi [3 ]
Li, Shengwen [4 ]
Liang, Qingzhong [1 ,2 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[2] China Univ Geosci, Hubei Key Lab Intelligent Geoinformat Proc, Wuhan 430074, Peoples R China
[3] China Univ Geosci, Sch Math & Phys, Wuhan 430074, Peoples R China
[4] China Univ Geosci, Sch Geog & Informat Engn, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Complex networks; Machine learning; Graph representation learning; Network embedding; Anchor structure;
D O I
10.1016/j.knosys.2021.107528
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The technique of graph/network embedding in artificial intelligence, which embeds graph data into a low-dimensional vector space in the form of machine learning, can help computer to efficiently process and analyze the complex graph data by using the vector operations. Graph Neural Network (GNN) and neural network, an end-to-end graph embedding technique based on Graph Signal Processing (GSP), which aggregates the topological information of the neighborhoods of each node in a graph, has attracted wide attention. However, most of the existing GNN models are limited to local structure information, and the location differences of nodes in the global topology are not sufficiently considered. This leads to that many nodes with the similar local topology are very difficult to distinguish. To address this problem, we propose an anchor-structure-aware GNN (AS-GNN) model to implement more accurate node distinguishment by capturing the global topology information based on the characteristics of complex networks. Anchor structure is defined as a key sub-graph composed of key nodes and edges in a graph. Taking it as a location reference, we can get the location information of each node in the global topology of graph and carry it into the embedding of nodes. By this way, the node vectors including richer topology information of graph are produced by GNN, and thus the nodes with similar local topologies can be distinguished well. To evaluate the performance of AS-GNN, we compare AS-GNN with some existing baseline models by the experiments of the classic GNN application tasks of link prediction and pairwise node classification on five real-world datasets. The experimental results have confirmed the above claims. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 56 条
[1]   HWSMCB: A community-based hybrid approach for identifying influential nodes in the social network [J].
Ahmad, Amreen ;
Ahmad, Tanvir ;
Bhatt, Abhishek .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2020, 545
[2]  
Andrew E., 2018, Bioinformatics, V34, P64, DOI [10.1093/bioinformatics/btx419, DOI 10.1093/BIOINFORMATICS/BTX419]
[3]   Hypergraph convolution and hypergraph attention [J].
Bai, Song ;
Zhang, Feihu ;
Torr, Philip H. S. .
PATTERN RECOGNITION, 2021, 110
[4]   Edge importance in a network via line graphs and the matrix exponential [J].
Cabrera, Omar ;
Matar, Mona ;
Reichel, Lothar .
NUMERICAL ALGORITHMS, 2020, 83 (02) :807-832
[5]   A model of Internet topology using k-shell decomposition [J].
Carmi, Shai ;
Havlin, Shlomo ;
Kirkpatrick, Scott ;
Shavitt, Yuval ;
Shir, Eran .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (27) :11150-11154
[6]   An effective spatial-temporal attention based neural network for traffic flow prediction [J].
Do, Loan N. N. ;
Vu, Hai L. ;
Vo, Bao Q. ;
Liu, Zhiyuan ;
Dinh Phung .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2019, 108 :12-28
[7]   Toward edge minability for role mining in bipartite networks [J].
Dong, Lijun ;
Wang, Yi ;
Liu, Ran ;
Pi, Benjie ;
Wu, Liuyi .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2016, 462 :274-286
[8]   metapath2vec: Scalable Representation Learning for Heterogeneous Networks [J].
Dong, Yuxiao ;
Chawla, Nitesh V. ;
Swami, Ananthram .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :135-144
[9]  
[范文礼 Fan Wenli], 2014, [西南交通大学学报, Journal of Southwest Jiaotong University], V49, P337
[10]  
Feng YF, 2019, AAAI CONF ARTIF INTE, P3558