A Bayesian analysis of spherical pattern based on finite Langevin mixture

被引:8
作者
Amayri, Ola [1 ]
Bouguila, Nizar [1 ]
机构
[1] Concordia Univ, Fac Engn & Comp Sci, Montreal, PQ H3G 2W1, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Langevin mixture; Bayesian inference; MCMC; Spherical data; Topic detection and tracking; Image categorization; SIGNIFICANCE TESTS; APPROXIMATE TESTS; DIRECTIONAL-DATA; MISES; CLASSIFICATION; INFERENCE;
D O I
10.1016/j.asoc.2015.10.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parameter estimation is a cornerstone of most fundamental problems of statistical research and practice. In particular, finite mixture models have long been heavily relied on deterministic approaches such as expectation maximization (EM). Despite their successful utilization in wide spectrum of areas, they have inclined to converge to local solutions. An alternative approach is the adoption of Bayesian inference that naturally addresses data uncertainty while ensuring good generalization. To this end, in this paper we propose a fully Bayesian approach for Langevin mixture model estimation and selection via MCMC algorithm based on Gibbs sampler, Metropolis-Hastings and Bayes factors. We demonstrate the effectiveness and the merits of the proposed learning framework through synthetic data and challenging applications involving topic detection and tracking and image categorization. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:373 / 383
页数:11
相关论文
共 59 条
[1]   Learning to detect objects in images via a sparse, part-based representation [J].
Agarwal, S ;
Awan, A ;
Roth, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (11) :1475-1490
[2]  
Allan J., 2000, Proceedings of the Ninth International Conference on Information and Knowledge Management. CIKM 2000, P374, DOI 10.1145/354756.354843
[3]  
Allan J., 2005, Proceedings of the Hawaii International Conference on System Sciences, P101
[4]  
Amayri O., 2011, Proceedings of the 2011 Tenth International Conference on Machine Learning and Applications (ICMLA 2011), P388, DOI 10.1109/icmla.2011.6174513
[5]  
Amayri O., 2013, P 2013 INT JOINT C N, P1
[6]   Beyond hybrid generative discriminative learning: spherical data classification [J].
Amayri, Ola ;
Bouguila, Nizar .
PATTERN ANALYSIS AND APPLICATIONS, 2015, 18 (01) :113-133
[7]   On online high-dimensional spherical data clustering and feature selection [J].
Amayri, Ola ;
Bouguila, Nizar .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2013, 26 (04) :1386-1398
[8]  
[Anonymous], 1986, IMS Lecture Notes Monograph Series
[9]  
[Anonymous], 1998, Topic Detection and Tracking Pilot Study Final Report, DOI DOI 10.1184/R1/6626252.V1
[10]  
Banerjee A, 2005, J MACH LEARN RES, V6, P1345