Topology-Aware Graph Pooling Networks

被引:69
作者
Gao, Hongyang [1 ]
Liu, Yi [2 ]
Ji, Shuiwang [2 ]
机构
[1] Iowa State Univ, Dept Comp Sci, Ames, IA 50011 USA
[2] Texas A&M Univ, Dept Comp Sci & Engn, College Stn, TX 77843 USA
基金
美国国家科学基金会;
关键词
Topology; Network topology; Task analysis; Diversity reception; Training; Sampling methods; Feature extraction; Deep learning; graph neural networks; graph pooling; graph topology;
D O I
10.1109/TPAMI.2021.3062794
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pooling operations have shown to be effective on computer vision and natural language processing tasks. One challenge of performing pooling operations on graph data is the lack of locality that is not well-defined on graphs. Previous studies used global ranking methods to sample some of the important nodes, but most of them are not able to incorporate graph topology. In this work, we propose the topology-aware pooling (TAP) layer that explicitly considers graph topology. Our TAP layer is a two-stage voting process that selects more important nodes in a graph. It first performs local voting to generate scores for each node by attending each node to its neighboring nodes. The scores are generated locally such that topology information is explicitly considered. In addition, graph topology is incorporated in global voting to compute the importance score of each node globally in the entire graph. Altogether, the final ranking score for each node is computed by combining its local and global voting scores. To encourage better graph connectivity in the sampled graph, we propose to add a graph connectivity term to the computation of ranking scores. Results on graph classification tasks demonstrate that our methods achieve consistently better performance than previous methods.
引用
收藏
页码:4512 / 4518
页数:7
相关论文
共 32 条
[1]  
[Anonymous], 2014, Comput. Sci.
[2]  
[Anonymous], 2018, Advances in Neural Information Processing Systems
[3]   Protein function prediction via graph kernels [J].
Borgwardt, KM ;
Ong, CS ;
Schönauer, S ;
Vishwanathan, SVN ;
Smola, AJ ;
Kriegel, HP .
BIOINFORMATICS, 2005, 21 :I47-I56
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]  
Clevert D.-A., 2015, arXiv preprint, V1511, P07289
[6]   Distinguishing enzyme structures from non-enzymes without alignments [J].
Dobson, PD ;
Doig, AJ .
JOURNAL OF MOLECULAR BIOLOGY, 2003, 330 (04) :771-783
[7]   Large-Scale Learnable Graph Convolutional Networks [J].
Gao, Hongyang ;
Wang, Zhengyang ;
Ji, Shuiwang .
KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, :1416-1424
[8]  
Gao Hongyang., 2019, PR MACH LEARN RES, P2083
[9]  
Hamilton WL, 2017, ADV NEUR IN, V30
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778