A Second-Order Symmetric Non-Negative Latent Factor Model for Undirected Weighted Network Representation

被引:11
作者
Li, Weiling [1 ]
Wang, Renfang [2 ]
Luo, Xin [1 ,3 ]
Zhou, MengChu [4 ,5 ]
机构
[1] Dongguan Univ Technol, Sch Comp Sci & Technol, Dongguan 523808, Peoples R China
[2] Zhejiang Wanli Univ, Coll Big Data & Software Engn, Ningbo 315100, Peoples R China
[3] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
[4] Zhejiang Gongshang Univ, Sch Informat & Elect Engn, Hangzhou 310018, Peoples R China
[5] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2023年 / 10卷 / 02期
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Optimization; Computational modeling; Symmetric matrices; Analytical models; Approximation algorithms; Jacobian matrices; Convergence; Conjugate gradient descent; hessian-vector product; latent factor analysis; undirected weighted network; representation learning; symmetric; second-order optimization; MATRIX-FACTORIZATION; OPTIMIZATION; EFFICIENT;
D O I
10.1109/TNSE.2022.3206802
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Precise representation to undirected weighted network (UWN) is the foundation of understanding connection patterns inside a massive node set. It can be addressed via a Symmetric Non-negative Latent Factor (SNLF) model with a non-convex learning objective. However, existing SNLF models commonly adopt a first-order learning algorithm that cannot well handle such a non-convex objective, thereby leading to inaccurate UWN representation. Aiming at addressing this issue, this study incorporates an efficient second-order learning algorithm into an SNLF model, thereby establishing a Second-order Symmetric Non-negative Latent Factor ((SNLF)-N-2) model with two-fold ideas: a) applying the single latent factor-related mapping function to the non-negativity constrained optimization parameters to achieve an unconstrained learning objective, and b) optimizing this learning objective with its optimization parameters through an efficient second-order learning algorithm to achieve accurate representation to the target UWN with affordable computational burden. Empirical studies indicate that owing to its efficient incorporation of the second-order optimization technique, the proposed (SNLF)-N-2 model outperforms state-of-the-art SNLF models when they are used to gain highly accurate representation to UWNs emerging from real applications.
引用
收藏
页码:606 / 618
页数:13
相关论文
共 51 条
  • [1] The Tikhonov regularization for vector equilibrium problems
    Anh, Lam Quoc
    Duy, Tran Quoc
    Muu, Le Dung
    Tri, Truong Van
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2021, 78 (03) : 769 - 792
  • [2] Anil R., 2018, PROC INT C LEARN REP
  • [3] [Anonymous], 2008, SIGIR, DOI DOI 10.1145/1390334.1390387
  • [4] Benavoli A, 2014, PR MACH LEARN RES, V32, P1026
  • [5] Evaluating Non-Personalized Single-Heuristic Active Learning Strategies for Collaborative Filtering Recommender Systems
    Chaaya, Georges
    Metais, Elisabeth
    Abdo, Jacques Bou
    Chiky, Raja
    Demerjian, Jacques
    Barbar, Kablan
    [J]. 2017 16TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2017, : 593 - 600
  • [6] Demsar J, 2006, J MACH LEARN RES, V7, P1
  • [7] GENERALIZED MOMENTUM-BASED METHODS: A HAMILTONIAN PERSPECTIVE
    Diakonikolas, Jelena
    Jordan, Michael, I
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (01) : 915 - 944
  • [8] On the extension of the Hager-Zhang conjugate gradient method for vector optimization
    Goncalves, M. L. N.
    Prudente, L. F.
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 76 (03) : 889 - 916
  • [9] Hofree M, 2013, NAT METHODS, V10, P1108, DOI [10.1038/NMETH.2651, 10.1038/nmeth.2651]
  • [10] A Distributed Framework for Large-scale Protein-protein Interaction Data Analysis and Prediction Using MapReduce
    Hu, Lun
    Yang, Shicheng
    Luo, Xin
    Yuan, Huaqiang
    Sedraoui, Khaled
    Zhou, MengChu
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (01) : 160 - 172