Two-order graph convolutional networks for semi-supervised classification

被引:20
作者
Fu Sichao [1 ]
Liu Weifeng [1 ]
Li Shuying [2 ]
Zhou Yicong [3 ]
机构
[1] China Univ Petr East China, Coll Informat & Control Engn, Qingdao 266580, Shandong, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Automat, Xian 710121, Shaanxi, Peoples R China
[3] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
approximation theory; learning (artificial intelligence); pattern classification; graph theory; convolutional neural nets; semisupervised classification; deep learning algorithms; natural language processing; diffusion-convolutional neural networks; GCN algorithm; one-order localised spectral graph filter; one-order polynomial; Laplacian; undirect neighbour structure information; graph structure data; two-order spectral graph convolutions; two-order approximation; two-order polynomial; abundant localised structure information; graph data; computer vision; two-order GCN; layerwise GCN; two-order graph convolutional networks; semi-supervised classification; TUTORIAL;
D O I
10.1049/iet-ipr.2018.6224
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, deep learning (DL) algorithms have achieved great success in many applications including computer vision and natural language processing. Many different kinds of DL models have been reported, such as DeepWalk, LINE, diffusionconvolutional neural networks, graph convolutional networks (GCN), and so on. The GCN algorithm is a variant of convolutional neural network and achieves significant superiority by using a one-order localised spectral graph filter. However, only a one-order polynomial in the Laplacian of GCN has been approximated and implemented, which ignores undirect neighbour structure information. The lack of rich structure information reduces the performance of the neural networks in the graph structure data. In this study, the authors deduce and simplify the formula of two-order spectral graph convolutions to preserve rich local information. Furthermore, they build a layerwise GCN based on this two-order approximation, i.e. two-order GCN (TGCN) for semi-supervised classification. With the two-order polynomial in the Laplacian, the proposed TGCN model can assimilate abundant localised structure information of graph data and then boosts the classification significantly. To evaluate the proposed solution, extensive experiments are conducted on several popular datasets including the Citeseer, Cora, and PubMed dataset. Experimental results demonstrate that the proposed TGCN outperforms the state-of-art methods.
引用
收藏
页码:2763 / 2771
页数:9
相关论文
共 36 条
[1]  
[Anonymous], IEEE T GEOSCI REMOTE
[2]  
[Anonymous], INT C MACH LEARN NEW
[3]  
Atwood J., 2016, NIPS, P1993
[4]   APPLICATIONS OF GRAPH-THEORY IN CHEMISTRY [J].
BALABAN, AT .
JOURNAL OF CHEMICAL INFORMATION AND COMPUTER SCIENCES, 1985, 25 (03) :334-343
[5]   Towards a theoretical foundation for Laplacian-based manifold methods [J].
Belkin, M ;
Niyogi, P .
LEARNING THEORY, PROCEEDINGS, 2005, 3559 :486-500
[6]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[7]  
Bilgic M, 2006, IEEE CONF VIS ANAL, P43
[8]   The CORA dataset: validation and diagnostics of in-situ ocean temperature and salinity measurements [J].
Cabanes, C. ;
Grouazel, A. ;
von Schuckmann, K. ;
Hamon, M. ;
Turpin, V. ;
Coatanoan, C. ;
Paris, F. ;
Guinehut, S. ;
Boone, C. ;
Ferry, N. ;
Montegut, C. de Boyer ;
Carval, T. ;
Reverdin, G. ;
Pouliquen, S. ;
Le Traon, P. -Y. .
OCEAN SCIENCE, 2013, 9 (01) :1-18
[9]  
Collobert R., 2008, P 25 INT C MACHINE L, P160, DOI [10.1145/1390156.1390177, DOI 10.1145/1390156.1390177]
[10]  
Defferrard M., 2016, P ADV NEUR INF PROC, P3844