Distributed stochastic gradient descent for link prediction in signed social networks

被引:21
作者
Zhang, Han [1 ]
Wu, Gang [1 ]
Ling, Qing [2 ,3 ]
机构
[1] Univ Sci & Technol China, Dept Automat, 443 Huangshan Rd, Hefei 230027, Anhui, Peoples R China
[2] Sun Yat Sen Univ, Sch Data & Comp Sci, 132 East Outer Ring Rd, Guangzhou 510006, Guangdong, Peoples R China
[3] Guangdong Prov Key Lab Computat Sci, 132 East Outer Ring Rd, Guangzhou 510006, Guangdong, Peoples R China
关键词
Signed social network; Link prediction; Low-rank matrix completion; Asynchronous distributed optimization; Stochastic gradient descent; STRUCTURAL BALANCE;
D O I
10.1186/s13634-019-0601-0
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper considers the link prediction problem defined over a signed social network, where the relationship between any two network users can be either positive (friends) or negative (foes). Given a portion of the relationships, the goal of link prediction is to identify the rest unknown ones. This task resorts to completing the adjacency matrix of the signed social network, which is low rank or approximately low rank. Considering the large scale of the adjacency matrix, in this paper, we adopt low-rank matrix factorization models for the link prediction problem and solve them through asynchronous distributed stochastic gradient descent algorithms. The low-rank matrix factorization models effectively reduce the size of the parameter space, while the asynchronous distributed stochastic gradient descent algorithms enable fast completion of the adjacency matrix. We validate the proposed algorithms using two real-world datasets on a distributed shared-memory computation platform. Numerical results demonstrate that the asynchronous distributed stochastic gradient descent algorithms achieve nearly linear computional speedups with respect to the number of computational threads, and are able to complete an adjacency matrix of ten billions of entries within 10 s.
引用
收藏
页数:11
相关论文
共 26 条
  • [1] [Anonymous], 2004, P 13 INT C WORLD WID, DOI DOI 10.1145/988672.988727
  • [2] [Anonymous], ARXIV160604991
  • [3] [Anonymous], 2016, ADV INTEL SYS RES
  • [4] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [5] A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION
    Cai, Jian-Feng
    Candes, Emmanuel J.
    Shen, Zuowei
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) : 1956 - 1982
  • [6] STRUCTURAL BALANCE - A GENERALIZATION OF HEIDER THEORY
    CARTWRIGHT, D
    HARARY, F
    [J]. PSYCHOLOGICAL REVIEW, 1956, 63 (05) : 277 - 293
  • [7] Chiang K., 2011, P 20 ACM INT C INF K, P1157, DOI [10.1145/2063576.2063742, DOI 10.1145/2063576.2063742]
  • [8] Chiang KY, 2014, J MACH LEARN RES, V15, P1177
  • [9] A Fast Parallel Stochastic Gradient Method for Matrix Factorization in Shared Memory Systems
    Chin, Wei-Sheng
    Zhuang, Yong
    Juan, Yu-Chin
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2015, 6 (01)
  • [10] CLUSTERING AND STRUCTURAL BALANCE IN GRAPHS
    DAVIS, JA
    [J]. HUMAN RELATIONS, 1967, 20 (02) : 181 - 187