MMSE of probabilistic low-rank matrix estimation: Universality with respect to the output channel

被引:0
|
作者
Lesieur, Thibault [3 ,4 ]
Krzakala, Florent [1 ,2 ]
Zdeborova, Lenka [3 ,4 ]
机构
[1] Ecole Normale Super, LPS, Paris, France
[2] Ecole Normale Super, CNRS, Paris, France
[3] CEA Saclay, IPhT, F-91191 Gif Sur Yvette, France
[4] CNRS, F-91191 Gif Sur Yvette, France
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers probabilistic estimation of a low-rank matrix from non-linear element-wise measurements of its elements. We derive the corresponding approximate message passing (AMP) algorithm and its state evolution. Relying on non-rigorous but standard assumptions motivated by statistical physics, we characterize the minimum mean squared error (MMSE) achievable information theoretically and with the AMP algorithm. Unlike in related problems of linear estimation, in the present setting the MMSE depends on the output channel only trough a single parameter - its Fisher information. We illustrate this striking finding by analysis of submatrix localization, and of detection of communities hidden in a dense stochastic block model. For this example we locate the computational and statistical boundaries that are not equal for rank larger than four.
引用
收藏
页码:680 / 687
页数:8
相关论文
共 50 条
  • [1] Low-Rank Structured MMSE Channel Estimation with Mixtures of Factor Analyzers
    Fesl, Benedikt
    Turan, Nurettin
    Utschick, Wolfgang
    FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF, 2023, : 375 - 380
  • [2] GEVD-based Low-Rank Channel Covariance Matrix Estimation and MMSE Channel Estimation for Uplink Cellular Massive MIMO Systems
    Van Rompaey, Robbe
    Moonen, Marc
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 1641 - 1645
  • [3] ROBUST LOW-RANK MATRIX ESTIMATION
    Elsener, Andreas
    van de Geer, Sara
    ANNALS OF STATISTICS, 2018, 46 (6B): : 3481 - 3509
  • [4] Survey on Probabilistic Models of Low-Rank Matrix Factorizations
    Shi, Jiarong
    Zheng, Xiuyun
    Yang, Wei
    ENTROPY, 2017, 19 (08)
  • [5] Probabilistic low-rank matrix completion on finite alphabets
    Lafond, Jean
    Klopp, Olga
    Moulines, Eric
    Salmon, Joseph
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [6] Estimation of Overspread Underwater Acoustic Channel Based on Low-Rank Matrix Recovery
    Li, Jie
    Chen, Fangjiong
    Liu, Songzuo
    Yu, Hua
    Ji, Fei
    SENSORS, 2019, 19 (22)
  • [7] Improved sparse low-rank matrix estimation
    Parekh, Ankit
    Selesnick, Ivan W.
    SIGNAL PROCESSING, 2017, 139 : 62 - 69
  • [8] Sparse and Low-Rank Covariance Matrix Estimation
    Zhou S.-L.
    Xiu N.-H.
    Luo Z.-Y.
    Kong L.-C.
    Journal of the Operations Research Society of China, 2015, 3 (02) : 231 - 250
  • [9] Low-Rank Structured Covariance Matrix Estimation
    Shikhaliev, Azer P.
    Potter, Lee C.
    Chi, Yuejie
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (05) : 700 - 704
  • [10] Low-Rank Tensor MMSE Equalization
    Ribeiro, Lucas N.
    de Almeida, Andre L. F.
    Mota, Joao C. M.
    2019 16TH INTERNATIONAL SYMPOSIUM ON WIRELESS COMMUNICATION SYSTEMS (ISWCS), 2019, : 511 - 516