A new efficient method for determining the number of components in PARAFAC models

被引:1054
|
作者
Bro, R
Kiers, HAL
机构
[1] Royal Vet & Agr Univ, Dept Food & Dairy Sci, Chemomet Grp, DK-1958 Frederiksberg C, Denmark
[2] Univ Groningen, Heymans Inst, DPMG, Groningen, Netherlands
关键词
PARAFAC; validation; number of components; loss function; scree plots; cross-validation;
D O I
10.1002/cem.801
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A new diagnostic called the core consistency diagnostic (CORCONDIA) is suggested for determining the proper number of components for multiway models. It applies especially to the parallel factor analysis (PARAFAC) model, but also to other models that can be considered as restricted Tucker3 models. It is based on scrutinizing the 'appropriateness' of the structural model based on the data and the estimated parameters of gradually augmented models. A PARAFAC model (employing dimension-wise combinations of components for all modes) is called appropriate if adding other combinations of the same components does not improve the fit considerably. It is proposed to choose the largest model that is still sufficiently appropriate. Using examples from a range of different types of data, it is shown that the core consistency diagnostic is an effective tool for determining the appropriate number of components in e.g. PARAFAC models. However, it is also shown, using simulated data, that the theoretical understanding of CORCONDIA is not yet complete. Copyright (C) 2003 John Wiley Sons, Ltd.
引用
收藏
页码:274 / 286
页数:13
相关论文
共 50 条
  • [1] Advanced Residuals Analysis for Determining the Number of PARAFAC Components in Dissolved Organic Matter
    Cuss, Chad W.
    Gueguen, Celine
    Andersson, Per
    Porcelli, Don
    Maximov, Trofim
    Kutscher, Liselott
    APPLIED SPECTROSCOPY, 2016, 70 (02) : 334 - 346
  • [2] Determining the number of components in mixtures of linear models
    Hawkins, DS
    Allen, DM
    Stromberg, AJ
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2001, 38 (01) : 15 - 48
  • [3] Detection of number of components in CANDECOMP/PARAFAC models via minimum description length
    Liu, Kefei
    da Costa, Joao Paulo C. L.
    So, Hing Cheung
    Huang, Lei
    Ye, Jieping
    DIGITAL SIGNAL PROCESSING, 2016, 51 : 110 - 123
  • [4] DETERMINING THE NUMBER OF INDEPENDENT COMPONENTS BY BRINKLEY METHOD
    ZHAO, MY
    WANG, ZC
    XIAO, LZ
    JOURNAL OF CHEMICAL EDUCATION, 1992, 69 (07) : 539 - 542
  • [5] Determining the Number of Components in Mixture Models for Hierarchical Data
    Lukociene, Olga
    Vermunt, Jeroen K.
    ADVANCES IN DATA ANALYSIS, DATA HANDLING AND BUSINESS INTELLIGENCE, 2010, : 241 - 249
  • [6] CORE CONSISTENCY DIAGNOSTIC AIDED BY RECONSTRUCTION ERROR FOR ACCURATE ENUMERATION OF THE NUMBER OF COMPONENTS IN PARAFAC MODELS
    Liu, Kefei
    So, H. C.
    da Costa, Joao Paulo C. L.
    Huang, Lei
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 6635 - 6639
  • [7] METHOD OF DETERMINING NEW HARDNESS NUMBER
    DROZD, MS
    INDUSTRIAL LABORATORY, 1959, 25 (05): : 624 - 628
  • [8] Determining the number of components in mixture regression models: an experimental design
    Brochado, Ana
    Martins, Vitorino
    ECONOMICS BULLETIN, 2020, 40 (02): : 1465 - 1474
  • [9] Determining the number of components in mixture models using Williams' statistical test
    Cang, S
    Partridge, D
    8TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING, VOLS 1-3, PROCEEDING, 2001, : 828 - 834
  • [10] NEW AND ACCURATE METHOD OF DETERMINING AVOGADRO NUMBER
    KAR, KC
    INDIAN JOURNAL OF THEORETICAL PHYSICS, 1969, 17 (04): : 125 - &