Bayesian Network Structural Learning Using Adaptive Genetic Algorithm with Varying Population Size

被引:5
作者
Ribeiro, Rafael Rodrigues Mendes [1 ]
Maciel, Carlos Dias [1 ]
机构
[1] Univ Sao Paulo, Dept Elect & Comp Engn, BR-13566590 Sao Carlos, SP, Brazil
来源
MACHINE LEARNING AND KNOWLEDGE EXTRACTION | 2023年 / 5卷 / 04期
基金
巴西圣保罗研究基金会;
关键词
Bayesian network; structural learning; genetic algorithm;
D O I
10.3390/make5040090
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A Bayesian network (BN) is a probabilistic graphical model that can model complex and nonlinear relationships. Its structural learning from data is an NP-hard problem because of its search-space size. One method to perform structural learning is a search and score approach, which uses a search algorithm and structural score. A study comparing 15 algorithms showed that hill climbing (HC) and tabu search (TABU) performed the best overall on the tests. This work performs a deeper analysis of the application of the adaptive genetic algorithm with varying population size (AGAVaPS) on the BN structural learning problem, which a preliminary test showed that it had the potential to perform well on. AGAVaPS is a genetic algorithm that uses the concept of life, where each solution is in the population for a number of iterations. Each individual also has its own mutation rate, and there is a small probability of undergoing mutation twice. Parameter analysis of AGAVaPS in BN structural leaning was performed. Also, AGAVaPS was compared to HC and TABU for six literature datasets considering F1 score, structural Hamming distance (SHD), balanced scoring function (BSF), Bayesian information criterion (BIC), and execution time. HC and TABU performed basically the same for all the tests made. AGAVaPS performed better than the other algorithms for F1 score, SHD, and BIC, showing that it can perform well and is a good choice for BN structural learning.
引用
收藏
页码:1877 / 1887
页数:11
相关论文
共 29 条
[1]  
Alridha Ahmed, 2021, Journal of Physics: Conference Series, V1818, DOI 10.1088/1742-6596/1818/1/012179
[2]  
Ankan A., 2015, P PYTHON SCI C, P6, DOI [DOI 10.25080/MAJORA-7B98-3ED-001, 10.25080/majora-7b98e3ed-001, DOI 10.25080/MAJORA-7B98E3ED-001]
[3]   A probabilistic decision support tool for prediction and management of rainfall-related poor water quality events for a drinking water treatment plant [J].
Bertone, Edoardo ;
Rousso, Benny Zuse ;
Kufeji, Dapo .
JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2023, 332
[4]   A genetic algorithm-based, hybrid machine learning approach to model selection [J].
Bies, RR ;
Muldoon, MF ;
Pollock, BG ;
Manuck, S ;
Smith, G ;
Sale, ME .
JOURNAL OF PHARMACOKINETICS AND PHARMACODYNAMICS, 2006, 33 (02) :195-221
[5]  
Constantinou AC, 2020, Arxiv, DOI arXiv:1905.12666
[6]   The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation [J].
Chicco, Davide ;
Jurman, Giuseppe .
BMC GENOMICS, 2020, 21 (01)
[7]   Large-scale empirical validation of Bayesian Network structure learning algorithms with noisy data [J].
Constantinou, Anthony C. ;
Liu, Yang ;
Chobtham, Kiattikun ;
Guo, Zhigao ;
Kitson, Neville K. .
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2021, 131 :151-188
[8]   Bayesian network hybrid learning using an elite-guided genetic algorithm [J].
Contaldi, Carlo ;
Vafaee, Fatemeh ;
Nelson, Peter C. .
ARTIFICIAL INTELLIGENCE REVIEW, 2019, 52 (01) :245-272
[9]  
de Campos LM, 2006, J MACH LEARN RES, V7, P2149
[10]   An efficient Bayesian network structure learning algorithm based on structural information [J].
Fang, Wei ;
Zhang, Weijian ;
Ma, Li ;
Wu, Yunlin ;
Yan, Kefei ;
Lu, Hengyang ;
Sun, Jun ;
Wu, Xiaojun ;
Yuan, Bo .
SWARM AND EVOLUTIONARY COMPUTATION, 2023, 76