Multitask Representation Learning With Multiview Graph Convolutional Networks

被引:28
作者
Huang, Hong [1 ,2 ,3 ,4 ]
Song, Yu [1 ,2 ,3 ,4 ]
Wu, Yao [1 ,2 ,3 ,4 ]
Shi, Jia [1 ,2 ,3 ,4 ]
Xie, Xia [1 ,2 ,3 ,4 ]
Jin, Hai [1 ,2 ,3 ,4 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Engn Res Ctr Big Data Technol, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, Serv Comp Technol & Syst Lab, Wuhan 430074, Peoples R China
[3] Huazhong Univ Sci & Technol, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China
[4] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Data mining; Data models; Correlation; Predictive models; Collaboration; Training data; graph neural networks (GNNs); multitask learning; representation learning;
D O I
10.1109/TNNLS.2020.3036825
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Link prediction and node classification are two important downstream tasks of network representation learning. Existing methods have achieved acceptable results but they perform these two tasks separately, which requires a lot of duplication of work and ignores the correlations between tasks. Besides, conventional models suffer from the identical treatment of information of multiple views, thus they fail to learn robust representation for downstream tasks. To this end, we tackle link prediction and node classification problems simultaneously via multitask multiview learning in this article. We first explain the feasibility and advantages of multitask multiview learning for these two tasks. Then we propose a novel model named MT-MVGCN to perform link prediction and node classification tasks simultaneously. More specifically, we design a multiview graph convolutional network to extract abundant information of multiple views in a network, which is shared by different tasks. We further apply two attention mechanisms: view the attention mechanism and task attention mechanism to make views and tasks adjust the view fusion process. Moreover, view reconstruction can be introduced as an auxiliary task to boost the performance of the proposed model. Experiments on real-world network data sets demonstrate that our model is efficient yet effective, and outperforms advanced baselines in these two tasks.
引用
收藏
页码:983 / 995
页数:13
相关论文
共 53 条
[21]   Multilinear Factorization Machines for Multi-Task Multi-View Learning [J].
Lu, Chun-Ta ;
He, Lifang ;
Shao, Weixiang ;
Cao, Bokai ;
Yu, Philip S. .
WSDM'17: PROCEEDINGS OF THE TENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2017, :701-709
[22]   Multi-Dimensional Network Embedding with Hierarchical Structure [J].
Ma, Yao ;
Ren, Zhaochun ;
Jiang, Ziheng ;
Tang, Jiliang ;
Yin, Dawei .
WSDM'18: PROCEEDINGS OF THE ELEVENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2018, :387-395
[23]  
Mikolov T., 2013, NIPS, V26, P3111, DOI 10.5555/2999792.2999959
[24]  
Mnih V, 2014, ADV NEUR IN, V27
[25]  
Monti F, 2017, ADV NEUR IN, V30
[26]  
Niwattanakul Suphakit, 2013, IMECS 2013 Proceedings of International Multiconference of Engineers and Computer Scientists, P380
[27]   DeepWalk: Online Learning of Social Representations [J].
Perozzi, Bryan ;
Al-Rfou, Rami ;
Skiena, Steven .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :701-710
[28]   A Variable Sampling Interval EWMA Distribution-Free Control Chart for Monitoring Services Quality [J].
Phuong Hanh Tran ;
Kim Phuc Tran ;
Truong Thu Huong ;
Heuchenne, Cedric ;
Thi Anh Dao Nguyen ;
Cong Ngon Do .
2018 INTERNATIONAL CONFERENCE ON E-BUSINESS AND APPLICATIONS (ICEBA 2018), 2018, :1-5
[29]   Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec [J].
Qiu, Jiezhong ;
Dong, Yuxiao ;
Ma, Hao ;
Li, Jian ;
Wang, Kuansan ;
Tang, Jie .
WSDM'18: PROCEEDINGS OF THE ELEVENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2018, :459-467
[30]   An Attention-based Collaboration Framework for Multi-View Network Representation Learning [J].
Qu, Meng ;
Tang, Jian ;
Shang, Jingbo ;
Ren, Xiang ;
Zhang, Ming ;
Han, Jiawei .
CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, :1767-1776