VARIATIONAL BAYES AND LOCALIZED FEATURE SELECTION FOR STUDENT'S t-MIXTURE MODELS

被引:2
作者
Zhang, Hui [1 ,2 ,3 ]
Wu, Q. M. Jonathan [2 ]
Thanh Minh Nguyen [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing, Peoples R China
[2] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[3] Nanjing Univ Informat Sci & Technol, Jiangsu Engn Ctr Network Monitoring, Nanjing, Peoples R China
基金
中国国家自然科学基金; 加拿大自然科学与工程研究理事会;
关键词
Bayesian approach; feature selection; Student's t-distributions; variational learning; RECOGNITION; INFERENCE;
D O I
10.1142/S021800141350016X
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel algorithm for feature selection and model detection using Student's t-distribution based on the variational Bayesian (VB) approach. First, our method is based on the Student's t-mixture model (SMM) which has heavier tail than the Gaussian distribution and is therefore less sensitive to small numbers of data points and consequent precision-estimates of the components number. Second, the number of components, the local feature saliency and the parameters of the mixture model are simultaneously estimated by Bayesian variational learning. Experimental results using synthetic and real data demonstrate the improved robustness of our approach.
引用
收藏
页数:18
相关论文
共 26 条
  • [1] [Anonymous], 2007, Uci machine learning repository
  • [2] [Anonymous], 2006, Pattern recognition and machine learning
  • [3] Attias H, 1999, UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, P21
  • [4] Attias H, 2000, ADV NEUR IN, V12, P209
  • [5] COMPARISON OF STABLE AND STUDENT DISTRIBUTIONS AS STATISTICAL MODELS FOR STOCK PRICES
    BLATTBERG, RC
    GONEDES, NJ
    [J]. JOURNAL OF BUSINESS, 1974, 47 (02) : 244 - 280
  • [6] Signal modeling and classification using a robust latent space model based on t distributions
    Chatzis, Sotirios P.
    Kosmopoulos, Dimitrios I.
    Varvarigou, Theodora A.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (03) : 949 - 963
  • [7] Robust Sequential Data Modeling Using an Outlier Tolerant Hidden Markov Model
    Chatzis, Sotirios P.
    Kosmopoulos, Dimitrios I.
    Varvarigou, Theodora A.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (09) : 1657 - 1669
  • [8] Bayesian feature and model selection for Gaussian mixture models
    Constantinopoulos, C
    Titsias, MK
    Likas, A
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (06) : 1013 - U1
  • [9] Unsupervised learning of Gaussian mixtures based on variational component splitting
    Constantinopoulos, Constantinos
    Likas, Aristidis
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2007, 18 (03): : 745 - 755
  • [10] Corduneanu A., 2001, Artificial intelligence and statistics, P27