Estimating common principal components in high dimensions

被引:47
作者
Browne, Ryan P. [1 ]
McNicholas, Paul D. [1 ]
机构
[1] Univ Guelph, Dept Math & Stat, Guelph, ON N1G 2W1, Canada
关键词
Clustering; Common principal components; GPCM; Flury; Minimization; Maximization; Mixture; Mixture models; Model-based clustering; MM algorithm; COVARIANCE MATRICES; DISCRIMINANT-ANALYSIS;
D O I
10.1007/s11634-013-0139-1
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the problem of minimizing an objective function that depends on an orthonormal matrix. This situation is encountered, for example, when looking for common principal components. The Flury method is a popular approach but is not effective for higher dimensional problems. We obtain several simple majorization-minimization (MM) algorithms that provide solutions to this problem and are effective in higher dimensions. We use mixture model-based clustering applications to illustrate our MM algorithms. We then use simulated data to compare them with other approaches, with comparisons drawn with respect to convergence and computational time.
引用
收藏
页码:217 / 226
页数:10
相关论文
共 32 条
  • [1] Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
  • [2] Model-based clustering, classification, and discriminant analysis via mixtures of multivariate t-distributions
    Andrews, Jeffrey L.
    McNicholas, Paul D.
    [J]. STATISTICS AND COMPUTING, 2012, 22 (05) : 1021 - 1029
  • [3] [Anonymous], 2012, R LANG ENV STAT COMP
  • [4] Arnold SJ, 1999, EVOLUTION, V53, P1516, DOI 10.1111/j.1558-5646.1999.tb05415.x
  • [5] MODEL-BASED GAUSSIAN AND NON-GAUSSIAN CLUSTERING
    BANFIELD, JD
    RAFTERY, AE
    [J]. BIOMETRICS, 1993, 49 (03) : 803 - 821
  • [6] Model-based cluster and discriminant analysis with the MIXMOD software
    Biernacki, Christophe
    Celeux, Gilles
    Govaert, Gerard
    Langrognet, Florent
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2006, 51 (02) : 587 - 600
  • [7] Principal component models for correlation matrices
    Boik, RJ
    [J]. BIOMETRIKA, 2003, 90 (03) : 679 - 701
  • [8] Spectral models for covariance matrices
    Boik, RJ
    [J]. BIOMETRIKA, 2002, 89 (01) : 159 - 182
  • [9] High-dimensional data clustering
    Bouveyron, C.
    Girard, S.
    Schmid, C.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2007, 52 (01) : 502 - 519
  • [10] Browne R. P., 2013, MIXTURE MIXTURE MODE