Multitask Representation Learning With Multiview Graph Convolutional Networks

被引:28
作者
Huang, Hong [1 ,2 ,3 ,4 ]
Song, Yu [1 ,2 ,3 ,4 ]
Wu, Yao [1 ,2 ,3 ,4 ]
Shi, Jia [1 ,2 ,3 ,4 ]
Xie, Xia [1 ,2 ,3 ,4 ]
Jin, Hai [1 ,2 ,3 ,4 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Engn Res Ctr Big Data Technol, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, Serv Comp Technol & Syst Lab, Wuhan 430074, Peoples R China
[3] Huazhong Univ Sci & Technol, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China
[4] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Data mining; Data models; Correlation; Predictive models; Collaboration; Training data; graph neural networks (GNNs); multitask learning; representation learning;
D O I
10.1109/TNNLS.2020.3036825
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Link prediction and node classification are two important downstream tasks of network representation learning. Existing methods have achieved acceptable results but they perform these two tasks separately, which requires a lot of duplication of work and ignores the correlations between tasks. Besides, conventional models suffer from the identical treatment of information of multiple views, thus they fail to learn robust representation for downstream tasks. To this end, we tackle link prediction and node classification problems simultaneously via multitask multiview learning in this article. We first explain the feasibility and advantages of multitask multiview learning for these two tasks. Then we propose a novel model named MT-MVGCN to perform link prediction and node classification tasks simultaneously. More specifically, we design a multiview graph convolutional network to extract abundant information of multiple views in a network, which is shared by different tasks. We further apply two attention mechanisms: view the attention mechanism and task attention mechanism to make views and tasks adjust the view fusion process. Moreover, view reconstruction can be introduced as an auxiliary task to boost the performance of the proposed model. Experiments on real-world network data sets demonstrate that our model is efficient yet effective, and outperforms advanced baselines in these two tasks.
引用
收藏
页码:983 / 995
页数:13
相关论文
共 53 条
[1]   Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum [J].
Bai, Xiaolong ;
Fang, Yuming ;
Lin, Weisi ;
Wang, Lipo ;
Ju, Bing-Feng .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (04) :2135-2145
[2]  
Cao SS, 2016, AAAI CONF ARTIF INTE, P1145
[3]  
Chen J., 2018, PROC 6 INT C LEARN R, P1
[4]   Thermal Facial Landmark Detection by Deep Multi-Task Learning [J].
Chu, Wei-Ta ;
Liu, Yu-Hui .
2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
[5]   A Survey on Network Embedding [J].
Cui, Peng ;
Wang, Xiao ;
Pei, Jian ;
Zhu, Wenwu .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (05) :833-852
[6]   The Anatomy of a Scientific Rumor [J].
De Domenico, M. ;
Lima, A. ;
Mougel, P. ;
Musolesi, M. .
SCIENTIFIC REPORTS, 2013, 3
[7]  
Defferrard M, 2016, ADV NEUR IN, V29
[8]   metapath2vec: Scalable Representation Learning for Heterogeneous Networks [J].
Dong, Yuxiao ;
Chawla, Nitesh V. ;
Swami, Ananthram .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :135-144
[9]  
Estrach J. B., 2014, 2 INT C LEARN REPR I
[10]   HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning [J].
Fu, Tao-yang ;
Lee, Wang-Chien ;
Lei, Zhen .
CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, :1797-1806