Improving Bayesian network structure learning with mutual information-based node ordering in the K2 algorithm

被引:115
作者
Chen, Xue-Wen [1 ]
Anantha, Gopalakrishna [1 ]
Lin, Xiaotong [1 ]
机构
[1] Univ Kansas, Dept Comp Sci & Elect Engn, Lawrence, KS 66045 USA
基金
美国国家科学基金会;
关键词
classification; data mining; machine-learning;
D O I
10.1109/TKDE.2007.190732
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Structure learning of Bayesian networks is a well-researched but computationally hard task. We present an algorithm that integrates an information-theory-based approach and a scoring-function-based approach for learning structures of Bayesian networks. Our algorithm also makes use of basic Bayesian network concepts like cl-separation and condition independence. We show that the proposed algorithm is capable of handling networks with a large number of variables. We present the applicability of the proposed algorithm on four standard network data sets and also compare its performance and computational efficiency with other standard structured learning methods. The experimental results show that our method can efficiently and accurately identify complex network structures from data.
引用
收藏
页码:628 / 640
页数:13
相关论文
共 47 条
  • [21] Independency relationships and learning algorithms for singly connected networks
    De Campos, LM
    [J]. JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 1998, 10 (04) : 511 - 549
  • [22] A new approach for learning belief networks using independence criteria
    de Campos, LM
    Huete, JF
    [J]. INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2000, 24 (01) : 11 - 37
  • [23] Being Bayesian about network structure. A Bayesian approach to structure discovery in Bayesian networks
    Friedman, N
    Koller, D
    [J]. MACHINE LEARNING, 2003, 50 (1-2) : 95 - 125
  • [24] Using Bayesian networks to analyze expression data
    Friedman, N
    Linial, M
    Nachman, I
    Pe'er, D
    [J]. JOURNAL OF COMPUTATIONAL BIOLOGY, 2000, 7 (3-4) : 601 - 620
  • [25] FRIEDMAN N, 1996, P 12 C UNC ART INT
  • [26] GEIGER D, 1993, INT J INTELL SYST, V8, P231
  • [27] GEIGER D, 1990, P 8 NAT C ART INT AA
  • [28] PROBABILISTIC SIMILARITY NETWORKS
    HECKERMAN, D
    [J]. NETWORKS, 1990, 20 (05) : 607 - 636
  • [29] LEARNING BAYESIAN NETWORKS - THE COMBINATION OF KNOWLEDGE AND STATISTICAL-DATA
    HECKERMAN, D
    GEIGER, D
    CHICKERING, DM
    [J]. MACHINE LEARNING, 1995, 20 (03) : 197 - 243
  • [30] Heckerman D., 1996, Technical report, MSR-TR-95-06