Why BDeu? Regular Bayesian network structure learning with discrete and continuous variables

被引:2
|
作者
Suzuki, Joe [1 ]
机构
[1] Osaka Univ, Grad Sch Engn Sci, Dept Math Sci, 1-3 Machikaneyama, Toyonaka, Osaka 5608531, Japan
关键词
Bayesian network; BDeu; structure learning;
D O I
10.1002/wics.1554
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the problem of Bayesian network structure learning (BNSL) from data. In particular, we focus on the score-based approach rather than the constraint-based approach and address what score we should use for the purpose. The Bayesian Dirichlet equivalent uniform (BDeu) has been mainly used within the community of BNs (not outside of it). We know that for any model selection and any data, the fitter the data to a model, the more complex the model, and vice versa. However, recently, it was proven that BDeu violates regularity, which means that it does not balance the two factors, although it works satisfactorily (consistently) when the sample size is infinitely large. In addition, we claim that the merit of using the regular scores over the Blleu is that tighter bounds of pruning rules are available when we consider efficient BNSL. Finally, using experiments, we compare the performances of the procedures to examine the claim. (This paper is for review and gives a unified viewpoint from the recent progress on the topic.) This article is categorized under: Statistical Learning and Exploratory Methods of the Data Sciences > Modeling Methods Statistical and Graphical Methods of Data Analysis > Bayesian Methods and Theory
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Bayesian Network Structure Learning for Discrete and Continuous Variables
    Suzuki, Joe
    2012 2ND INTERNATIONAL CONFERENCE ON UNCERTAINTY REASONING AND KNOWLEDGE ENGINEERING (URKE), 2012, : 141 - 144
  • [2] A theoretical analysis of the BDeu scores in Bayesian network structure learning
    Suzuki J.
    Behaviormetrika, 2017, 44 (1) : 97 - 116
  • [3] Learning bayesian network structures when discrete and continuous variables are present
    Suzuki, Joe
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2014, 8754 : 471 - 486
  • [4] Learning Bayesian Network Structures When Discrete and Continuous Variables Are Present
    Suzuki, Joe
    PROBABILISTIC GRAPHICAL MODELS, 2014, 8754 : 471 - 486
  • [5] Bayesian network models with discrete and continuous variables
    Cobb, Barry R.
    Rumi, Rafael
    Salmeron, Antonio
    ADVANCES IN PROBABILISTIC GRAPHICAL MODELS, 2007, 213 : 81 - 102
  • [6] From continuous to discrete variables for Bayesian network classifiers
    El-Matouat, F
    Colot, O
    Vannoorenberghe, P
    Labiche, J
    SMC 2000 CONFERENCE PROCEEDINGS: 2000 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOL 1-5, 2000, : 2800 - 2805
  • [7] Learning Bayesian networks structure with continuous variables
    Wang, Shuang-Cheng
    Li, Xiao-Lin
    Tang, Hai-Yan
    ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2006, 4093 : 448 - 456
  • [8] Bayesian Network Structure Estimation Based on the Bayesian/MDL Criteria When Both Discrete and Continuous Variables Are Present
    Suzuki, Joe
    2012 DATA COMPRESSION CONFERENCE (DCC), 2012, : 307 - 316
  • [9] Branch and Bound for Regular Bayesian Network Structure Learning
    Suzuki, Joe
    Kawahara, Jun
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI2017), 2017,
  • [10] Learning Bayesian networks from datasets joining continuous and discrete variables
    Dojer, Norbert
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2016, 78 : 116 - 124