A hybrid method for learning Bayesian networks based on ant colony optimization

被引:40
作者
Ji, Junzhong [1 ]
Hu, Renbing [1 ]
Zhang, Hongxun [1 ]
Liu, Chunnian [1 ]
机构
[1] Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Municipal Key Lab Multimedia & Intelligen, Beijing 100124, Peoples R China
基金
北京市自然科学基金;
关键词
Bayesian networks; Ant colony optimization; Variable search space; Heuristic; Function; Simulated annealing strategy; DESCRIPTION LENGTH PRINCIPLE; ALGORITHM;
D O I
10.1016/j.asoc.2011.01.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a powerful formalism, Bayesian networks play an increasingly important role in the Uncertainty Field. This paper proposes a hybrid method to discover the knowledge represented in Bayesian networks. The hybrid method combines dependency analysis, ant colony optimization (ACO), and the simulated annealing strategy. Firstly, the new method uses order-0 independence tests with a self-adjusting threshold value to reduce the size of the search space, so that the search process takes less time to find the near-optimal solution. Secondly, better Bayesian network models are generated by using an improved ACO algorithm, where a new heuristic function is introduced to further enhance the search effectiveness and efficiency. Finally, an optimization scheme based on simulated annealing is employed to improve the optimization efficiency in the stochastic search process of ants. In a number of experiments and comparisons, the hybrid method outperforms the original ACO-B which uses ACO and some other network learning algorithms. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:3373 / 3384
页数:12
相关论文
共 28 条
[1]  
ALCOB JR, 2004, P 15 EUR C MACH LEAR
[2]   Multiple objective ant colony optimisation [J].
Angus D. ;
Woodward C. .
Swarm Intelligence, 2009, 3 (1) :69-85
[3]  
ANGUS D, 2009, SWARM INTELLIGENCE A, V3, P85
[4]  
ANGUS D, 2009, SWARM INTELLIGENCE A, V3, P22
[5]   The hyper-cube framework for ant colony optimization [J].
Blum, C ;
Dorigo, M .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (02) :1161-1172
[6]   Search bias in ant colony optimization: On the role of competition-balanced systems [J].
Blum, C ;
Dorigo, M .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2005, 9 (02) :159-174
[7]   Learning Bayesian networks from data: An information-theory based approach [J].
Cheng, J ;
Greiner, R ;
Kelly, J ;
Bell, D ;
Liu, WR .
ARTIFICIAL INTELLIGENCE, 2002, 137 (1-2) :43-90
[8]  
Chickering D.M., 2002, MSRTR2002103
[9]   A BAYESIAN METHOD FOR THE INDUCTION OF PROBABILISTIC NETWORKS FROM DATA [J].
COOPER, GF ;
HERSKOVITS, E .
MACHINE LEARNING, 1992, 9 (04) :309-347
[10]  
Cotta C., 2002, Parallel Problem Solving from Nature - PPSN VII. 7th International Conference. Proceedings (Lecture Notes in Computer Science Vol.2439), P730