Variational Bayesian inference for a Dirichlet process mixture of beta distributions and application

被引:7
|
作者
Lai, Yuping [1 ]
Ping, Yuan [2 ]
Xiao, Ke [1 ]
Hao, Bin [3 ]
Zhang, Xiufeng [4 ]
机构
[1] North China Univ Technol, Coll Comp Sci & Technol, Beijing, Peoples R China
[2] Xuchang Univ, Sch Informat Engn, Xuchang, Peoples R China
[3] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[4] Natl Res Ctr Rehabil Tech Aids, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Dirichlet process; Nonparametric Bayesian analysis; Beta distribution; Infinite mixture model; Variational inference; Image categorization; Object detection; HIDDEN MARKOV MODEL; INFORMATION CRITERION; CLASSIFICATION;
D O I
10.1016/j.neucom.2017.07.068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finite beta mixture model (BMM) has been shown to be very flexible and powerful for bounded support data modeling. However, BMM cannot automatically select the proper number of the mixture components based on the observed data, which is important and has a deterministic effect on the modeling accuracy. In this paper, we aim at tackling this problem by infinite Beta mixture model (InBMM). It is based on the Dirichlet process (DP) mixture with the assumption that the number of the mixture components is infinite in advance and can be automatically determined according to the observed data. Further, a variational InBMM using single lower- bound approximation (VBInBMM) is proposed which applies the stick-breaking representation of the DP and is learned by an extended variational inference framework. Numerical experiments on both synthetic and real data, generated from two challenging application namely image categorization and object detection, demonstrate good performance obtained by the proposed method. (C) 2017 Published by Elsevier B. V.
引用
收藏
页码:23 / 33
页数:11
相关论文
共 50 条
  • [41] Variational Inference of Finite Generalized Gaussian Mixture Models
    Amudala, Srikanth
    Ali, Samr
    Najar, Fatma
    Bouguila, Nizar
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 2433 - 2439
  • [42] A SEMIPARAMETRIC BAYESIAN APPROACH TO NETWORK MODELLING USING DIRICHLET PROCESS PRIOR DISTRIBUTIONS
    Ghosh, Pulak
    Gill, Paramjit
    Muthukumarana, Saman
    Swartz, Tim
    AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2010, 52 (03) : 289 - 302
  • [43] Online Learning of Hierarchical Pitman-Yor Process Mixture of Generalized Dirichlet Distributions With Feature Selection
    Fan, Wentao
    Sallay, Hassen
    Bouguila, Nizar
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (09) : 2048 - 2061
  • [44] A Variational Approach to Bayesian Phylogenetic Inference
    Zhang, Cheng
    Matsen IV, Frederick A.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25 : 1 - 56
  • [45] Variational Inference for Watson Mixture Model
    Taghia, Jalil
    Leijon, Arne
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (09) : 1886 - 1900
  • [46] Variational inference for Bayesian bridge regression
    Zanini C.T.P.
    Migon H.S.
    Dias R.
    Statistics and Computing, 2024, 34 (1)
  • [47] Stochastic variational inference for clustering short text data with finite mixtures of Dirichlet-Multinomial distributions
    Bilancia, Massimo
    Nigri, Andrea
    Magro, Samuele
    STATISTICAL PAPERS, 2025, 66 (04)
  • [48] DIRICHLET PROCESS MIXTURE MODELS WITH MULTIPLE MODALITIES
    Paisley, John
    Carin, Lawrence
    2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 1613 - 1616
  • [49] VARIATIONAL INFERENCE FOR NONPARAMETRIC SUBSPACE DICTIONARY LEARNING WITH HIERARCHICAL BETA PROCESS
    Li, Shaoyang
    Tao, Xiaoming
    Lu, Jianhua
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2691 - 2695
  • [50] Variational learning of finite Dirichlet mixture models using component splitting
    Fan, Wentao
    Bouguila, Nizar
    Ziou, Djemel
    NEUROCOMPUTING, 2014, 129 : 3 - 16