MMSE of probabilistic low-rank matrix estimation: Universality with respect to the output channel

被引:0
|
作者
Lesieur, Thibault [3 ,4 ]
Krzakala, Florent [1 ,2 ]
Zdeborova, Lenka [3 ,4 ]
机构
[1] Ecole Normale Super, LPS, Paris, France
[2] Ecole Normale Super, CNRS, Paris, France
[3] CEA Saclay, IPhT, F-91191 Gif Sur Yvette, France
[4] CNRS, F-91191 Gif Sur Yvette, France
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers probabilistic estimation of a low-rank matrix from non-linear element-wise measurements of its elements. We derive the corresponding approximate message passing (AMP) algorithm and its state evolution. Relying on non-rigorous but standard assumptions motivated by statistical physics, we characterize the minimum mean squared error (MMSE) achievable information theoretically and with the AMP algorithm. Unlike in related problems of linear estimation, in the present setting the MMSE depends on the output channel only trough a single parameter - its Fisher information. We illustrate this striking finding by analysis of submatrix localization, and of detection of communities hidden in a dense stochastic block model. For this example we locate the computational and statistical boundaries that are not equal for rank larger than four.
引用
收藏
页码:680 / 687
页数:8
相关论文
共 50 条
  • [21] Low-Rank Matrix Estimation in the Presence of Change-Points
    Shi, Lei
    Wang, Guanghui
    Zou, Changliang
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25
  • [22] Efficient quantum state estimation with low-rank matrix completion
    Tariq, Shehbaz
    Farooq, Ahmad
    Rehman, Junaid Ur
    Duong, Trung Q.
    Shin, Hyundong
    EPJ QUANTUM TECHNOLOGY, 2024, 11 (01)
  • [23] Low-Rank Matrix Recovery Via Robust Outlier Estimation
    Guo, Xiaojie
    Lin, Zhouchen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (11) : 5316 - 5327
  • [24] VON NEUMANN ENTROPY PENALIZATION AND LOW-RANK MATRIX ESTIMATION
    Koltchinskii, Vladimir
    ANNALS OF STATISTICS, 2011, 39 (06): : 2936 - 2973
  • [25] Robust low-rank abundance matrix estimation for hyperspectral unmixing
    Feng, Fan
    Zhao, Baojun
    Tang, Linbo
    Wang, Wenzheng
    Jia, Sen
    JOURNAL OF ENGINEERING-JOE, 2019, 2019 (21): : 7406 - 7409
  • [26] Bootstrap-Based Regularization for Low-Rank Matrix Estimation
    Josse, Julie
    Wager, Stefan
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [27] Low-Rank Matrix Completion Based on Maximum Likelihood Estimation
    Chen, Jinhui
    Yang, Jian
    2013 SECOND IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR 2013), 2013, : 261 - 265
  • [28] Probabilistic Low-Rank Multitask Learning
    Kong, Yu
    Shao, Ming
    Li, Kang
    Fu, Yun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (03) : 670 - 680
  • [29] Low-Rank Matrix Completion
    Chi, Yuejie
    IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (05) : 178 - 181
  • [30] Low-Rank Matrix Sensing-Based Channel Estimation for mmWave and THz Hybrid MIMO Systems
    Masood, Khawaja Fahad
    Tong, Jun
    Xi, Jiangtao
    Yuan, Jinhong
    Guo, Qinghua
    Yu, Yanguang
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (04) : 777 - 793