A Method For Hybrid Bayesian Network Structure Learning from Massive Data Using MapReduce

被引:2
作者
Li, Shun [1 ]
Wang, Biao [1 ]
机构
[1] Univ Int Relat, Sch Informat Sci & Technol, Beijing 100091, Peoples R China
来源
2017 IEEE 3RD INTERNATIONAL CONFERENCE ON BIG DATA SECURITY ON CLOUD (BIGDATASECURITY, IEEE 3RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, (HPSC) AND 2ND IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA AND SECURITY (IDS) | 2017年
关键词
Bayesian Network; Structure Learning; MapReduce; styling; Hybrid Learning; ALGORITHM; PARALLEL;
D O I
10.1109/BigDataSecurity.2017.42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Bayesian Network is the popular and important data mining model for representing uncertain knowledge. For large scale data it is often too costly to learn the accurate structure. To resolve this problem, much work has been done on migrating the structure learning algorithms to the MapReduce framework. In this paper, we introduce a distributed hybrid structure learning algorithm by combining the advantages of constraint-based and score-and-search-based algorithms. By reusing the intermediate results of MapReduce, the algorithm greatly simplified the computing work and got good results in both efficiency and accuracy.
引用
收藏
页码:272 / 276
页数:5
相关论文
共 50 条
[41]   Driver Drowsiness Detection Model Identification with Bayesian Network Structure Learning Method [J].
Guo, Wenqiang ;
Zhang, Baorong ;
Xia, Lingjun ;
Shi, Shuai ;
Zhang, Xiao ;
She, Jinlong .
PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, :131-136
[42]   Bayesian network parameter learning using constraint-based data extension method [J].
Ru, Xinxin ;
Gao, Xiaoguang ;
Wang, Yangyang ;
Liu, Xiaohan .
APPLIED INTELLIGENCE, 2023, 53 (09) :9958-9977
[43]   Bayesian network parameter learning using constraint-based data extension method [J].
Xinxin Ru ;
Xiaoguang Gao ;
Yangyang Wang ;
Xiaohan Liu .
Applied Intelligence, 2023, 53 :9958-9977
[44]   Learning Bayesian Network Structure Using a MultiExpert Approach [J].
Colace, Francesco ;
De Santo, Massimo ;
Greco, Luca .
INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2014, 24 (02) :269-284
[45]   Bayesian network structure learning using scatter search [J].
Yang, Wei-Ting ;
Tamssaouet, Karim ;
Dauzere-Peres, Stephane .
KNOWLEDGE-BASED SYSTEMS, 2024, 300
[46]   Bayesian network structure learning using quantum annealing [J].
B. O’Gorman ;
R. Babbush ;
A. Perdomo-Ortiz ;
A. Aspuru-Guzik ;
V. Smelyanskiy .
The European Physical Journal Special Topics, 2015, 224 :163-188
[47]   Bayesian network structure learning using quantum annealing [J].
O'Gorman, B. ;
Babbush, R. ;
Perdomo-Ortiz, A. ;
Aspuru-Guzik, A. ;
Smelyanskiy, V. .
EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2015, 224 (01) :163-188
[48]   Learning Dynamic Bayesian Network Structure from Non-time Symmetric Data [J].
Wang Shuang-cheng ;
Shao Jun ;
Cheng Xin-zhang .
PROCEEDINGS OF THE 2009 CHINESE CONFERENCE ON PATTERN RECOGNITION AND THE FIRST CJK JOINT WORKSHOP ON PATTERN RECOGNITION, VOLS 1 AND 2, 2009, :73-+
[49]   Duplicate Detection for Bayesian Network Structure Learning [J].
Jahnsson, Niklas ;
Malone, Brandon ;
Myllymaki, Petri .
NEW GENERATION COMPUTING, 2017, 35 (01) :47-67
[50]   Learning Bayesian network structure with immune algorithm [J].
Cai, Zhiqiang ;
Si, Shubin ;
Sun, Shudong ;
Dui, Hongyan .
JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2015, 26 (02) :282-291