Graph Neural Networks With Parallel Neighborhood Aggregations for Graph Classification

被引:5
作者
Doshi, Siddhant [1 ]
Chepuri, Sundeep Prabhakar [1 ]
机构
[1] Indian Inst Sci, Dept Elect Commun Engn, Bangalore 560012, Karnataka, India
关键词
Computational modeling; Task analysis; Numerical models; Training; Predictive models; Computer architecture; Brain modeling; Graph classification; graph filterbanks; graph neural networks; isomorphism test; representation learning;
D O I
10.1109/TSP.2022.3205476
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We focus on graph classification using a graph neural network (GNN) model that precomputes node features using a bank of neighborhood aggregation graph operators arranged in parallel. These GNN models have a natural advantage of reduced training and inference time due to the precomputations but are also fundamentally different from popular GNN variants that update node features through a sequential neighborhood aggregation procedure during training. We provide theoretical conditions under which a generic GNN model with parallel neighborhood aggregations (PA-GNNs, in short) are provably as powerful as the well-known Weisfeiler-Lehman (WL) graph isomorphism test in discriminating non-isomorphic graphs. Although PA-GNN models do not have an apparent relationship with the WL test, we show that the graph embeddings obtained from these two methods are injectively related. We then propose a specialized PA-GNN model, called simple and parallel graph isomorphism network (SPIN), which obeys the developed conditions. We demonstrate via numerical experiments that the developed model achieves state-of-the-art performance on many diverse real-world datasets while maintaining the discriminative power of the WL test and the computational advantage of preprocessing graphs before the training process.
引用
收藏
页码:4883 / 4896
页数:14
相关论文
共 46 条
[31]   Rethinking the Inception Architecture for Computer Vision [J].
Szegedy, Christian ;
Vanhoucke, Vincent ;
Ioffe, Sergey ;
Shlens, Jon ;
Wojna, Zbigniew .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2818-2826
[32]  
Tremblay N, 2018, COOPERATIVE AND GRAPH SIGNAL PROCESSING: PRINCIPLES AND APPLICATIONS, P299, DOI 10.1016/B978-0-12-813677-5.00011-0
[33]  
Velickovic P., 2018, P 6 ICLR
[34]   Comparison of descriptor spaces for chemical compound retrieval and classification [J].
Wale, Nikil ;
Watson, Ian A. ;
Karypis, George .
KNOWLEDGE AND INFORMATION SYSTEMS, 2008, 14 (03) :347-375
[35]  
Weber M, 2019, PROC TUT ANOMALY DET
[36]  
Weisfeiler Boris, 1968, Nauchno-Technicheskaya Informatsia, Ser., V1968, P2
[37]  
Wu F, 2019, PR MACH LEARN RES, V97
[38]   MoleculeNet: a benchmark for molecular machine learning [J].
Wu, Zhenqin ;
Ramsundar, Bharath ;
Feinberg, Evan N. ;
Gomes, Joseph ;
Geniesse, Caleb ;
Pappu, Aneesh S. ;
Leswing, Karl ;
Pande, Vijay .
CHEMICAL SCIENCE, 2018, 9 (02) :513-530
[39]   A Comprehensive Survey on Graph Neural Networks [J].
Wu, Zonghan ;
Pan, Shirui ;
Chen, Fengwen ;
Long, Guodong ;
Zhang, Chengqi ;
Yu, Philip S. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) :4-24
[40]  
Xu K., 2019, PROC INT C LEARN REP