Fast Nonparametric Clustering of Structured Time-Series

被引:36
作者
Hensman, James [1 ,2 ]
Rattray, Magnus [3 ]
Lawrence, Neil D. [1 ,2 ]
机构
[1] Univ Sheffield, Dept Comp Sci, Sheffield S10 2TN, S Yorkshire, England
[2] Univ Sheffield, Sheffield Inst Translat Neurosci, Sheffield S10 2TN, S Yorkshire, England
[3] Univ Manchester, Fac Life Sci, Manchester, Lancs, England
基金
英国生物技术与生命科学研究理事会; 英国医学研究理事会;
关键词
Variational Bayes; Gaussian processes; structured time series; gene expression; GENE-EXPRESSION; VARIATIONAL INFERENCE; MODELS;
D O I
10.1109/TPAMI.2014.2318711
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this publication, we combine two Bayesian nonparametric models: the Gaussian Process (GP) and the Dirichlet Process (DP). Our innovation in the GP model is to introduce a variation on the GP prior which enables us to model structured time-series data, i.e., data containing groups where we wish to model inter-and intra-group variability. Our innovation in the DP model is an implementation of a new fast collapsed variational inference procedure which enables us to optimize our variational approximation significantly faster than standard VB approaches. In a biological time series application we show how our model better captures salient features of the data, leading to better consistency with existing biological classifications, while the associated inference algorithm provides a significant speed-up over EM-based variational inference.
引用
收藏
页码:383 / 393
页数:11
相关论文
共 30 条
[1]   Natural gradient works efficiently in learning [J].
Amari, S .
NEURAL COMPUTATION, 1998, 10 (02) :251-276
[2]  
[Anonymous], ARXIV13037090
[3]  
[Anonymous], 2011, P 28 INT C MACH LEAR
[4]   Hierarchical models for assessing variability among functions [J].
Behseta, S ;
Kass, RE ;
Wallstrom, GL .
BIOMETRIKA, 2005, 92 (02) :419-434
[5]   Variational Inference for Dirichlet Process Mixtures [J].
Blei, David M. ;
Jordan, Michael I. .
BAYESIAN ANALYSIS, 2006, 1 (01) :121-143
[6]   Bayesian hierarchical clustering for microarray time series data with replicates and outlier measurements [J].
Cooke, Emma J. ;
Savage, Richard S. ;
Kirk, Paul D. W. ;
Darkins, Robert ;
Wild, David L. .
BMC BIOINFORMATICS, 2011, 12
[7]  
Dunson D.B., 2010, BAYESIAN NONPARAMETR
[8]   The Circadian Clock in Murine Chondrocytes Regulates Genes Controlling Key Aspects of Cartilage Homeostasis [J].
Gossan, Nicole ;
Zeef, Leo ;
Hensman, James ;
Hughes, Alun ;
Bateman, John F. ;
Rowley, Lynn ;
Little, Christopher B. ;
Piggins, Hugh D. ;
Rattray, Magnus ;
Boot-Handford, Raymond P. ;
Meng, Qing-Jun .
ARTHRITIS AND RHEUMATISM, 2013, 65 (09) :2334-2345
[9]  
Hensman J., 2012, Advances in Neural Information Processing Systems (NIPS), V2, P2888
[10]  
Hensman J., 2012, BMC BIOINFORMA UNPUB