Joint Network Reconstruction and Community Detection from Rich but Noisy Data

被引:0
|
作者
Hu, Jie [1 ]
Chen, Xiao [1 ]
Chen, Yu [1 ,2 ]
Zhang, Weiping [1 ]
机构
[1] Univ Sci & Technol China, Int Inst Finance, Sch Management, Hefei, Peoples R China
[2] Univ Sci & Technol China, Int Inst Finance, Sch Management, Hefei 230026, Anhui, Peoples R China
关键词
Community detection; EM algorithm; Kullback-Leibler divergence; Mixture distributions; Network reconstruction; MAXIMUM-LIKELIHOOD-ESTIMATION; MODEL;
D O I
10.1080/10618600.2023.2267630
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Most empirical studies of complex networks return rich but noisy data, as they measure the network structure repeatedly but with substantial errors due to indirect measurements. In this article, we propose a novel framework, called the group-based binary mixture (GBM) modeling approach, to simultaneously conduct network reconstruction and community detection from such rich but noisy data. A generalized expectation-maximization (EM) algorithm is developed for computing the maximum likelihood estimates, and an information criterion is introduced to consistently select the number of communities. The strong consistency properties of the network reconstruction and community detection are established under some assumption on the Kullback-Leibler (KL) divergence, and in particular, we do not impose assumptions on the true network structure. It is shown that joint reconstruction with community detection has a synergistic effect, whereby actually detecting communities can improve the accuracy of the reconstruction. Finally, we illustrate the performance of the approach with numerical simulations and two real examples. Supplementary materials for this article are available online.
引用
收藏
页码:501 / 514
页数:14
相关论文
共 50 条
  • [21] Bayesian mesh reconstruction from noisy point data
    Qian, Guiping
    Tong, Ruofeng
    Peng, Wen
    Dong, Jinxing
    ADVANCES IN ARTIFICIAL REALITY AND TELE-EXISTENCE, PROCEEDINGS, 2006, 4282 : 819 - +
  • [22] EXACT RECONSTRUCTION AND RECONSTRUCTION FROM NOISY DATA WITH ANISOTROPIC TOTAL VARIATION \ast
    Holler, Martin
    Wirth, Benedikt
    SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2024, 56 (03) : 2938 - 2967
  • [24] Reconstruction of a fiber Bragg grating from noisy reflection data
    Rosenthal, A
    Horowitz, M
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2005, 22 (01) : 84 - 92
  • [25] Bayesian image and pattern reconstruction from incomplete and noisy data
    V. L. Vengrinovich
    Pattern Recognition and Image Analysis, 2012, 22 (1) : 99 - 107
  • [26] Jump-preserving surface reconstruction from noisy data
    Qiu, Peihua
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2009, 61 (03) : 715 - 751
  • [27] Signal reconstruction from noisy-phase and -magnitude data
    Taratorin, Alexander M.
    Sideman, Samuel
    Applied Optics, 1994, 33 (23): : 5415 - 5425
  • [28] Jump-preserving surface reconstruction from noisy data
    Peihua Qiu
    Annals of the Institute of Statistical Mathematics, 2009, 61 : 715 - 751
  • [29] Reconstruction of bandlimited signals from noisy data by adaptive thresholding
    Nguyen, LV
    Pawlak, M
    2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 3, PROCEEDINGS, 2004, : 653 - 656
  • [30] An algorithm of wavelet network learning from noisy data
    Zhang, Zhiguo
    San, Ye
    WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 2746 - +