Model-based clustering of Gaussian copulas for mixed data

被引:24
作者
Marbac, Matthieu [1 ,2 ]
Biernacki, Christophe [1 ,2 ,3 ]
Vandewalle, Vincent [1 ,4 ]
机构
[1] Inria Lille, 40 Ave Halley, F-59650 Villeneuve Dascq, France
[2] Univ Lille 1, Villeneuve Dascq, France
[3] CNRS, Paris, France
[4] Univ Lille 2, EA 2694, Lille, France
关键词
Clustering; Gaussian copula; Metropolis-within-Gibbs algorithm; mixed data; mixture models; visualization; MIXTURE MODEL; BAYESIAN-INFERENCE; LIKELIHOOD; VARIABLES; MARGINS;
D O I
10.1080/03610926.2016.1277753
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Clustering of mixed data is important yet challenging due to a shortage of conventional distributions for such data. In this article, we propose a mixture model of Gaussian copulas for clustering mixed data. Indeed copulas, and Gaussian copulas in particular, are powerful tools for easily modeling the distribution of multivariate variables. This model clusters data sets with continuous, integer, and ordinal variables (all having a cumulative distribution function) by considering the intra-component dependencies in a similar way to the Gaussian mixture. Indeed, each component of the Gaussian copula mixture produces a correlation coefficient for each pair of variables and its univariate margins follow standard distributions (Gaussian, Poisson, and ordered multinomial) depending on the nature of the variable (continuous, integer, or ordinal). As an interesting by-product, this model generalizes many well-known approaches and provides tools for visualization based on its parameters. The Bayesian inference is achieved with a Metropolis-within-Gibbs sampler. The numerical experiments, on simulated and real data, illustrate the benefits of the proposed model: flexible and meaningful parameterization combined with visualization features.
引用
收藏
页码:11635 / 11656
页数:22
相关论文
共 40 条
[21]   THE LOCATION MODEL FOR MIXTURES OF CATEGORICAL AND CONTINUOUS-VARIABLES [J].
KRZANOWSKI, WJ .
JOURNAL OF CLASSIFICATION, 1993, 10 (01) :25-49
[22]   ON INFORMATION AND SUFFICIENCY [J].
KULLBACK, S ;
LEIBLER, RA .
ANNALS OF MATHEMATICAL STATISTICS, 1951, 22 (01) :79-86
[23]  
Lewis D. D., 1998, Machine Learning: ECML-98. 10th European Conference on Machine Learning. Proceedings, P4, DOI 10.1007/BFb0026666
[24]  
McLachlan G., 2000, WILEY SER PROB STAT, V1, DOI 10.1002/0471721182
[25]   A latent variables approach for clustering mixed binary and continuous variables within a Gaussian mixture model [J].
Morlini, Isabella .
ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2012, 6 (01) :5-28
[26]   Latent class models for mixed variables with applications in archaeometry [J].
Moustaki, I ;
Papageorgiou, I .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2005, 48 (03) :659-675
[27]   Bayesian Gaussian Copula Factor Models for Mixed Data [J].
Murray, Jared S. ;
Dunson, David B. ;
Carin, Lawrence ;
Lucas, Joseph E. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2013, 108 (502) :656-665
[28]  
Nelsen R. B., 1998, An Introduction to Copulas
[29]   MAXIMUM LIKELIHOOD ESTIMATION OF THE POLYCHLORIC CORRELATION-COEFFICIENT [J].
OLSSON, U .
PSYCHOMETRIKA, 1979, 44 (04) :443-460
[30]   Efficient Bayesian inference for Gaussian copula regression models [J].
Pitt, Michael ;
Chan, David ;
Kohn, Robert .
BIOMETRIKA, 2006, 93 (03) :537-554