Improving Bayesian network structure learning with mutual information-based node ordering in the K2 algorithm

被引:118
作者
Chen, Xue-Wen [1 ]
Anantha, Gopalakrishna [1 ]
Lin, Xiaotong [1 ]
机构
[1] Univ Kansas, Dept Comp Sci & Elect Engn, Lawrence, KS 66045 USA
基金
美国国家科学基金会;
关键词
classification; data mining; machine-learning;
D O I
10.1109/TKDE.2007.190732
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Structure learning of Bayesian networks is a well-researched but computationally hard task. We present an algorithm that integrates an information-theory-based approach and a scoring-function-based approach for learning structures of Bayesian networks. Our algorithm also makes use of basic Bayesian network concepts like cl-separation and condition independence. We show that the proposed algorithm is capable of handling networks with a large number of variables. We present the applicability of the proposed algorithm on four standard network data sets and also compare its performance and computational efficiency with other standard structured learning methods. The experimental results show that our method can efficiently and accurately identify complex network structures from data.
引用
收藏
页码:628 / 640
页数:13
相关论文
共 47 条
[1]   Hailfinder: A Bayesian system for forecasting severe weather [J].
Abramson, B ;
Brown, J ;
Edwards, W ;
Murphy, A ;
Winkler, RL .
INTERNATIONAL JOURNAL OF FORECASTING, 1996, 12 (01) :57-71
[2]   Searching for Bayesian network structures in the space of restricted acyclic partially directed graphs [J].
Acid, S ;
de Campos, LM .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2003, 18 :445-490
[3]  
AGOSTA JM, 1990, UNCERTAINTY ARTIFICI, V4, P397
[4]  
[Anonymous], 1988, PROBABILISTIC REASON, DOI DOI 10.1016/C2009-0-27609-4
[5]  
[Anonymous], J MACHINE LEARNING R
[6]  
[Anonymous], P 9 C UNC ART INT
[7]  
Bouckaert RR, 1993, Lecture Notes in Computer Science, V747, P41
[8]   A guide to the literature on learning probabilistic networks from data [J].
Buntine, W .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1996, 8 (02) :195-210
[9]  
Buntine W., 1991, P 7 C UNC ART INT, P52
[10]  
CAMPOS L, 1997, INT J INTELL SYST, V12, P495