Network representation learning via improved random walk with restart

被引:22
作者
Zhang, Yanan [1 ]
Shen, Jian [1 ]
Zhang, Ruisheng [1 ]
Zhao, Zhili [1 ]
机构
[1] Lanzhou Univ, Sch Informat Sci & Engn, Lanzhou 730000, Peoples R China
基金
中国博士后科学基金;
关键词
Network representation learning; Random walk with restart; Attention mechanism; Dimensionality reduction;
D O I
10.1016/j.knosys.2023.110255
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-world networks are usually sparse and high-dimensional representations that occupy considerable storage space and increase the computational complexity when performing network tasks. Recently, various methods of network representation learning that can effectively learn dense and low-dimensional network representations have been proposed. However, while these methods consider either the global or local structure of the network, the structures are not considered comprehensively. To address this problem, we propose a novel network representation learning method based on random walk with restart (NRL-RWR), which effectively captures the global and local structures of a network by means of an improved random walk with restart strategy. First, the random walk with restart is improved by an attention mechanism that assigns weights to edges by measuring the similarity between nodes. Second, the improved random walk with restart strategy has the ability to obtain the probability distribution of nodes, and always returns to the starting position with a certain probability in the process of walking, so that more global and local structures of the network can be retained. Finally, we construct an objective function based on Kullback-Leibler divergence, and we adopt negative sampling and edge sampling to optimize the objective function and reduce the computational complexity of network representation learning. Experimental results based on six real-world networks show that NRL-RWR outperforms state-of-the-art network representation learning methods in obtaining low-dimensional vector representations of networks.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 56 条
[1]  
[Anonymous], 2016, INT JOINT C ART INT
[2]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[3]  
Belkin M, 2002, ADV NEUR IN, V14, P585
[4]  
Cao SS, 2016, AAAI CONF ARTIF INTE, P1145
[5]  
Cao Shaosheng., 2015, Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, CIKM '15, P891, DOI [10.1145/2806416.2806512, DOI 10.1145/2806416.2806512]
[6]  
Chen HC, 2018, AAAI CONF ARTIF INTE, P2127
[7]   Diffusion Component Analysis: Unraveling Functional Topology in Biological Networks [J].
Cho, Hyunghoon ;
Berger, Bonnie ;
Peng, Jian .
RESEARCH IN COMPUTATIONAL MOLECULAR BIOLOGY (RECOMB 2015), 2015, 9029 :62-64
[8]  
Feng Xia, 2021, IEEE Transactions on Artificial Intelligence, V2, P109, DOI [10.1109/tai.2021.3076021, 10.1109/TAI.2021.3076021]
[9]   Link Prediction Under Imperfect Detection: Collaborative Filtering for Ecological Networks [J].
Fu, Xiao ;
Seo, Eugene ;
Clarke, Justin ;
Hutchinson, Rebecca A. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (08) :3117-3128
[10]   An Incremental Dimensionality Reduction Method for Visualizing Streaming Multidimensional Data [J].
Fujiwara, Takanori ;
Chou, Jia-Kai ;
Shilpika ;
Xu, Panpan ;
Ren, Liu ;
Ma, Kwan-Liu .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (01) :418-428