Multi-Task Learning Based Network Embedding

被引:6
作者
Wang, Shanfeng [1 ]
Wang, Qixiang [2 ]
Gong, Maoguo [2 ]
机构
[1] Xidian Univ, Sch Cyber Engn, Xian, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
network representation learning; multi-task learning; network embedding; high-order proximity; low-order proximity;
D O I
10.3389/fnins.2019.01387
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The goal of network representation learning, also called network embedding, is to encode the network structure information into a continuous low-dimensionality embedding space where geometric relationships among the vectors can reflect the relationships of nodes in the original network. The existing network representation learning methods are always single-task learning, in which case these methods focus on preserving the proximity of nodes from one aspect. However, the proximity of nodes is dependent on both the local and global structure, resulting in a limitation on the node embeddings learned by these methods. In order to solve this problem, in this paper, we propose a novel method, Multi-Task Learning-Based Network Embedding, termed MLNE. There are two tasks in this method so as to preserve the proximity of nodes. The aim of the first task is to preserve the high-order proximity between pairwise nodes in the whole network. The second task is to preserve the low-order proximity in the one-hop area of each node. By jointly learning these tasks in the supervised deep learning model, our method can obtain node embeddings that can sufficiently reflect the roles that nodes play in networks. In order to demonstrate the efficacy of our MLNE method over existing state-of-the-art methods, we conduct experiments on multi-label classification, link prediction, and visualization in five real-world networks. The experimental results show that our method performs competitively.
引用
收藏
页数:10
相关论文
共 40 条
  • [1] Al-Rfou, 2018, ARXIV PREPRINT ARXIV
  • [2] [Anonymous], 2016, ARXIV160808940
  • [3] Belkin M, 2002, ADV NEUR IN, V14, P585
  • [4] Cao SS, 2016, AAAI CONF ARTIF INTE, P1145
  • [5] A Survey on Network Embedding
    Cui, Peng
    Wang, Xiao
    Pei, Jian
    Zhu, Wenwu
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (05) : 833 - 852
  • [6] Learning Structural Node Embeddings via Diffusion Wavelets
    Donnat, Claire
    Zitnik, Marinka
    Hallac, David
    Leskovec, Jure
    [J]. KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1320 - 1329
  • [7] Multi-Task Learning for Blind Source Separation
    Du, Bo
    Wang, Shaodong
    Xu, Chang
    Wang, Nan
    Zhang, Liangpei
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (09) : 4219 - 4231
  • [8] Community detection in graphs
    Fortunato, Santo
    [J]. PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2010, 486 (3-5): : 75 - 174
  • [9] Gong M., 2017, COMPUTATIONAL INTELL
  • [10] Graph embedding techniques, applications, and performance: A survey
    Goyal, Palash
    Ferrara, Emilio
    [J]. KNOWLEDGE-BASED SYSTEMS, 2018, 151 : 78 - 94