A Comprehensive Survey on Deep Graph Representation Learning

被引:107
作者
Ju, Wei [1 ]
Fang, Zheng [2 ]
Gu, Yiyang [1 ]
Liu, Zequn [1 ]
Long, Qingqing [3 ]
Qiao, Ziyue [4 ]
Qin, Yifang [1 ]
Shen, Jianhao [1 ]
Sun, Fang [5 ]
Xiao, Zhiping [5 ]
Yang, Junwei [1 ]
Yuan, Jingyang [1 ]
Zhao, Yusheng [1 ]
Wang, Yifan [6 ]
Luo, Xiao [5 ]
Zhang, Ming [1 ]
机构
[1] Peking Univ, Sch Comp Sci, Natl Key Lab Multimedia Informat Proc, Beijing 100871, Peoples R China
[2] Peking Univ, Sch Intelligence Sci & Technol, Beijing 100871, Peoples R China
[3] Chinese Acad Sci, Comp Network Informat Ctr, Beijing 100086, Peoples R China
[4] Hong Kong Univ Sci & Technol, Artificial Intelligence Thrust, Guangzhou 511453, Peoples R China
[5] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA 90095 USA
[6] Univ Int Business & Econ, Sch Informat Technol & Management, Beijing 100029, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Deep learning on graphs; Graph representation learning; Graph neural network; Survey; NEURAL-NETWORK; DRUG DISCOVERY; ANOMALY DETECTION; DESIGN; DIMENSIONALITY; DISCRIMINATION; INFORMATION; PREDICTION; FRAMEWORK; DATABASE;
D O I
10.1016/j.neunet.2024.106207
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph representation learning aims to effectively encode high-dimensional sparse graph-structured data into low-dimensional dense vectors, which is a fundamental task that has been widely studied in a range of fields, including machine learning and data mining. Classic graph embedding methods follow the basic idea that the embedding vectors of interconnected nodes in the graph can still maintain a relatively close distance, thereby preserving the structural information between the nodes in the graph. However, this is sub -optimal due to: (i) traditional methods have limited model capacity which limits the learning performance; (ii) existing techniques typically rely on unsupervised learning strategies and fail to couple with the latest learning paradigms; (iii) representation learning and downstream tasks are dependent on each other which should be jointly enhanced. With the remarkable success of deep learning, deep graph representation learning has shown great potential and advantages over shallow (traditional) methods, there exist a large number of deep graph representation learning techniques have been proposed in the past decade, especially graph neural networks. In this survey, we conduct a comprehensive survey on current deep graph representation learning algorithms by proposing a new taxonomy of existing state -of -the -art literature. Specifically, we systematically summarize the essential components of graph representation learning and categorize existing approaches by the ways of graph neural network architectures and the most recent advanced learning paradigms. Moreover, this survey also provides the practical and promising applications of deep graph representation learning. Last but not least, we state new perspectives and suggest challenging directions which deserve further investigations in the future.
引用
收藏
页数:50
相关论文
共 610 条
[71]   Link prediction for interdisciplinary collaboration via co-authorship network [J].
Cho H. ;
Yu Y. .
Social Network Analysis and Mining, 2018, 8 (01)
[72]  
Choi J, 2022, AAAI CONF ARTIF INTE, P6367
[73]  
Chouldechova A, 2018, Arxiv, DOI arXiv:1810.08810
[74]  
Chung Fan R. K., 1997, CBMS REGIONAL C SERI, V92
[75]  
Chung JY, 2014, Arxiv, DOI [arXiv:1412.3555, DOI 10.48550/ARXIV.1412.3555]
[76]   Convolutional Embedding of Attributed Molecular Graphs for Physical Property Prediction [J].
Coley, Connor W. ;
Barzilay, Regina ;
Green, William H. ;
Jaakkola, Tommi S. ;
Jensen, Klavs F. .
JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2017, 57 (08) :1757-1772
[77]   RECURRENT NEURAL NETWORKS AND ROBUST TIME-SERIES PREDICTION [J].
CONNOR, JT ;
MARTIN, RD ;
ATLAS, LE .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :240-254
[78]  
Corso G, 2020, ADV NEUR IN, V33
[79]   Equivariant Graph Neural Networks for Toxicity Prediction [J].
Cremer, Julian ;
Medrano Sandonas, Leonardo ;
Tkatchenko, Alexandre ;
Clevert, Djork-Arne ;
De Fabritiis, Gianni .
CHEMICAL RESEARCH IN TOXICOLOGY, 2023, 36 (10) :1561-1573
[80]   A social media event detection framework based on transformers and swarm optimization for public notification of crises and emergency management [J].
Dahou, Abdelghani ;
Mabrouk, Alhassan ;
Ewees, Ahmed A. ;
Gaheen, Marwa A. ;
Abd Elaziz, Mohamed .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2023, 192