Estimation in the spiked Wigner model: A short proof of the replica formula

被引:0
作者
El Alaoui, Ahmed [1 ]
Krzakala, Florent [2 ,3 ]
机构
[1] Univ Calif Berkeley, Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[2] CNRS, UPMC, PSL, LPS,ENS, Paris, France
[3] Sorbonne Univ, Paris, France
来源
2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT) | 2018年
关键词
LARGEST EIGENVALUE;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider the problem of estimating the rank-one perturbation of a Wigner matrix in a setting of low signal-to-noise ratio. This serves as a simple model for principal component analysis in high dimensions. The mutual information per variable between the spike and the observed matrix, or equivalently, the normalized Kullback-Leibler divergence between the planted and null models are known to converge to the so-called replica-symmetric formula, the properties of which determine the fundamental limits of estimation in this model. We provide in this note a short and transparent proof of this formula, based on simple executions of Gaussian interpolations and standard concentration-of-measure arguments. The Franz-Parisi potential, that is, the free entropy at a fixed overlap, plays an important role in our proof. Furthermore, our proof can be generalized straightforwardly to spiked tensor models of even order.
引用
收藏
页码:1874 / 1878
页数:5
相关论文
共 25 条
  • [1] Extended variational principle for the Sherrington-Kirkpatrick spin-glass model
    Aizenman, M
    Sims, R
    Starr, SL
    [J]. PHYSICAL REVIEW B, 2003, 68 (21):
  • [2] [Anonymous], 2017, Phase Transitions, Optimal Errors and Optimality of Message-Passing in Generalized Linear Models
  • [3] [Anonymous], ARXIV161103888
  • [4] [Anonymous], 2001, Fields Institute Communications, DOI DOI 10.1090/FIC/030/10
  • [5] [Anonymous], 2017, ARXIV170502780
  • [6] [Anonymous], 2001, STAT PHYS SPIN GLASS
  • [7] [Anonymous], 2013, Concentration Inequali-ties: A Nonasymptotic Theory of Independence, DOI DOI 10.1093/ACPROF:OSO/9780199535255.001.0001
  • [8] Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices
    Baik, J
    Ben Arous, G
    Péché, S
    [J]. ANNALS OF PROBABILITY, 2005, 33 (05) : 1643 - 1697
  • [9] Barbier J., 2016, ADV NEURAL INFORM PR, P424
  • [10] Barbier J., 2017, ARXIV170910368