Variational Bayesian inference for a Dirichlet process mixture of beta distributions and application

被引:7
|
作者
Lai, Yuping [1 ]
Ping, Yuan [2 ]
Xiao, Ke [1 ]
Hao, Bin [3 ]
Zhang, Xiufeng [4 ]
机构
[1] North China Univ Technol, Coll Comp Sci & Technol, Beijing, Peoples R China
[2] Xuchang Univ, Sch Informat Engn, Xuchang, Peoples R China
[3] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[4] Natl Res Ctr Rehabil Tech Aids, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Dirichlet process; Nonparametric Bayesian analysis; Beta distribution; Infinite mixture model; Variational inference; Image categorization; Object detection; HIDDEN MARKOV MODEL; INFORMATION CRITERION; CLASSIFICATION;
D O I
10.1016/j.neucom.2017.07.068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finite beta mixture model (BMM) has been shown to be very flexible and powerful for bounded support data modeling. However, BMM cannot automatically select the proper number of the mixture components based on the observed data, which is important and has a deterministic effect on the modeling accuracy. In this paper, we aim at tackling this problem by infinite Beta mixture model (InBMM). It is based on the Dirichlet process (DP) mixture with the assumption that the number of the mixture components is infinite in advance and can be automatically determined according to the observed data. Further, a variational InBMM using single lower- bound approximation (VBInBMM) is proposed which applies the stick-breaking representation of the DP and is learned by an extended variational inference framework. Numerical experiments on both synthetic and real data, generated from two challenging application namely image categorization and object detection, demonstrate good performance obtained by the proposed method. (C) 2017 Published by Elsevier B. V.
引用
收藏
页码:23 / 33
页数:11
相关论文
共 50 条
  • [31] A note on the Dirichlet process prior in Bayesian nonparametric inference with partial exchangeability
    Petrone, S
    Raftery, AE
    STATISTICS & PROBABILITY LETTERS, 1997, 36 (01) : 69 - 83
  • [32] Bayesian Estimation of the von-Mises Fisher Mixture Model with Variational Inference
    Taghia, Jalil
    Ma, Zhanyu
    Leijon, Arne
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (09) : 1701 - 1715
  • [33] Oil Spill Detection in SAR Images Using Online Extended Variational Learning of Dirichlet Process Mixtures of Gamma Distributions
    Almulihi, Ahmed
    Alharithi, Fahd
    Bourouis, Sami
    Alroobaea, Roobaea
    Pawar, Yogesh
    Bouguila, Nizar
    REMOTE SENSING, 2021, 13 (15)
  • [34] Unsupervised Learning Using Variational Inference on Finite Inverted Dirichlet Mixture Models with Component Splitting
    Maanicshah, Kamal
    Amayri, Manar
    Bouguila, Nizar
    Fan, Wentao
    WIRELESS PERSONAL COMMUNICATIONS, 2021, 119 (02) : 1817 - 1844
  • [35] Unsupervised Learning Using Variational Inference on Finite Inverted Dirichlet Mixture Models with Component Splitting
    Kamal Maanicshah
    Manar Amayri
    Nizar Bouguila
    Wentao Fan
    Wireless Personal Communications, 2021, 119 : 1817 - 1844
  • [36] A Non-parametric Bayesian Learning Model Using Accelerated Variational Inference on Multivariate Beta Mixture Models for Medical Applications
    Manouchehri, Narges
    Bouguila, Nizar
    INTERNATIONAL JOURNAL OF SEMANTIC COMPUTING, 2022, 16 (03) : 449 - 469
  • [37] Variational Textured Dirichlet Process Mixture Model With Pairwise Constraint for Unsupervised Classification of Polarimetric SAR Images
    Liu, Chi
    Li, Heng-Chao
    Liao, Wenzhi
    Philips, Wilfried
    Emery, William J.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (08) : 4145 - 4160
  • [38] An Infinite Mixture of Inverted Dirichlet Distributions
    Bdiri, Taoufik
    Bouguila, Nizar
    NEURAL INFORMATION PROCESSING, PT II, 2011, 7063 : 71 - 78
  • [39] Nonparametric Bayesian inferences on the skewed data using a Dirichlet process mixture model
    Mostofi, Amin Ghalamfarsa
    Kharrati-Kopaei, Mahmood
    STATISTICAL PAPERS, 2025, 66 (01)
  • [40] Dirichlet process HMM mixture models with application to music analysis
    Qi, Yuting
    Paisley, John William
    Carin, Lawrence
    2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL II, PTS 1-3, 2007, : 465 - +