Improving Bayesian network structure learning with mutual information-based node ordering in the K2 algorithm

被引:118
作者
Chen, Xue-Wen [1 ]
Anantha, Gopalakrishna [1 ]
Lin, Xiaotong [1 ]
机构
[1] Univ Kansas, Dept Comp Sci & Elect Engn, Lawrence, KS 66045 USA
基金
美国国家科学基金会;
关键词
classification; data mining; machine-learning;
D O I
10.1109/TKDE.2007.190732
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Structure learning of Bayesian networks is a well-researched but computationally hard task. We present an algorithm that integrates an information-theory-based approach and a scoring-function-based approach for learning structures of Bayesian networks. Our algorithm also makes use of basic Bayesian network concepts like cl-separation and condition independence. We show that the proposed algorithm is capable of handling networks with a large number of variables. We present the applicability of the proposed algorithm on four standard network data sets and also compare its performance and computational efficiency with other standard structured learning methods. The experimental results show that our method can efficiently and accurately identify complex network structures from data.
引用
收藏
页码:628 / 640
页数:13
相关论文
共 47 条
[11]  
CHARTRAND G, 2005, GRAPHS DIGRAPH
[12]   Learning Bayesian networks from data: An information-theory based approach [J].
Cheng, J ;
Greiner, R ;
Kelly, J ;
Bell, D ;
Liu, WR .
ARTIFICIAL INTELLIGENCE, 2002, 137 (1-2) :43-90
[13]  
CHENG J, 1997, P 6 INT WORKSH ART I
[14]  
CHICKERING D, 1995, PRELIMINARY PAPERS 5
[15]  
Chickering D. M., 2003, Journal of Machine Learning Research, V3, P507, DOI 10.1162/153244303321897717
[16]  
Chickering D.M., 1996, Learning Bayesian Networks is NPComplete, V112, P121, DOI DOI 10.1007/978-1-4612-2404-4_12
[17]  
Chickering DM, 2004, J MACH LEARN RES, V5, P1287
[18]   Learning equivalence classes of Bayesian-network structures [J].
Chickering, DM .
JOURNAL OF MACHINE LEARNING RESEARCH, 2002, 2 (03) :445-498
[19]   APPROXIMATING DISCRETE PROBABILITY DISTRIBUTIONS WITH DEPENDENCE TREES [J].
CHOW, CK ;
LIU, CN .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1968, 14 (03) :462-+
[20]  
COOPER GF, 1992, MACH LEARN, V9, P309, DOI 10.1007/BF00994110