a-Random Walk: Collaborative sampling and weighting mechanisms based on a single parameter for node embeddings

被引:2
作者
Hirchoua, Badr [1 ]
El Motaki, Saloua [2 ]
机构
[1] Hassan II Univ UH2, Natl Higher Sch Arts & Crafts ENSAM, Lab Artificial Intelligence & Complex Syst Engn AI, Casablanca, Morocco
[2] Chouaib Doukkali Univ UCD, Natl Sch Appl Sci ENSA, Lab Engn Sci Energy LabSIPE, El Jadida, Morocco
关键词
Node embedding; Random walk; Knowledge representation; Link prediction; Knowledge completion; Node behavior;
D O I
10.1016/j.patcog.2023.109730
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph embedding transforms a graph into vector representations to facilitate subsequent graph-analytic tasks. Existing graph embedding methods ignore efficient node sampling and intelligent node weighting, leading to a weak node representation.This paper introduces the a-random walk model with two main contributions. Firstly, the traditional random walk sampling reveals instability. Thus, we associate a parameter a with each node to balance and stabilize the sampling process, producing high-efficient trajectories. Secondly, we design a weighting mechanism that incorporates these trajectories to generate accurate representations. The designed mech-anism models the behavior of each node contextually at each episode, considering the current state and the previous weights to produce the next episode's weights. The parameter a optimizes the node weights by simulating multiple high-order proximity walks from each node. This approach provides summarized insights about each node's behavior and its neighbors' context, which enables a consistent discovery of prominent paths variation in the graph.Experimental results demonstrate that the a-random walk outperforms the state-of-the-art baselines in handling small and large graphs.& COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:15
相关论文
共 40 条
[1]  
Abu-El-Haija S, 2018, N-GCN: Multi-Scale Graph Convolution for Semi-Supervised Node Classification, DOI 10.48550/ARXIV.1802.08888
[2]  
Abu-El-Haija S, 2018, ADV NEUR IN, V31
[3]   Predicting scientific research trends based on link prediction in keyword networks [J].
Behrouzi, Saman ;
Sarmoor, Zahra Shafaeipour ;
Hajsadeghi, Khosrow ;
Kavousi, Kaveh .
JOURNAL OF INFORMETRICS, 2020, 14 (04)
[4]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[5]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[6]  
Cao S., 2015, Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, P891, DOI DOI 10.1145/2806416.2806512
[7]   Learning Community Embedding with Community Detection and Node Embedding on Graphs [J].
Cavallari, Sandro ;
Zheng, Vincent W. ;
Cai, Hongyun ;
Chang, Kevin Chen-Chuan ;
Cambria, Erik .
CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, :377-386
[8]   Deep MinCut: Learning Node Embeddings by Detecting Communities [J].
Duong, Chi Thang ;
Nguyen, Thanh Tam ;
Hoang, Trung-Dung ;
Yin, Hongzhi ;
Weidlich, Matthias ;
Nguyen, Quoc Viet Hung .
PATTERN RECOGNITION, 2022, 134
[9]   Graph embedding techniques, applications, and performance: A survey [J].
Goyal, Palash ;
Ferrara, Emilio .
KNOWLEDGE-BASED SYSTEMS, 2018, 151 :78-94
[10]   node2vec: Scalable Feature Learning for Networks [J].
Grover, Aditya ;
Leskovec, Jure .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :855-864