A Method For Hybrid Bayesian Network Structure Learning from Massive Data Using MapReduce

被引：2

作者：

Li, Shun ^{[1
]}

Wang, Biao ^{[1
]}

机构：

[1] Univ Int Relat, Sch Informat Sci & Technol, Beijing 100091, Peoples R China

来源：

2017 IEEE 3RD INTERNATIONAL CONFERENCE ON BIG DATA SECURITY ON CLOUD (BIGDATASECURITY, IEEE 3RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, (HPSC) AND 2ND IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA AND SECURITY (IDS) | 2017年

关键词：

Bayesian Network; Structure Learning; MapReduce; styling; Hybrid Learning; ALGORITHM; PARALLEL;

D O I：

10.1109/BigDataSecurity.2017.42

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Bayesian Network is the popular and important data mining model for representing uncertain knowledge. For large scale data it is often too costly to learn the accurate structure. To resolve this problem, much work has been done on migrating the structure learning algorithms to the MapReduce framework. In this paper, we introduce a distributed hybrid structure learning algorithm by combining the advantages of constraint-based and score-and-search-based algorithms. By reusing the intermediate results of MapReduce, the algorithm greatly simplified the computing work and got good results in both efficiency and accuracy.

引用

页码：272 / 276

页数：5

共 30 条

[11]

Cussens J., 2008, P 24 C UNC ART INT

[12]

de Campos CP, 2011, J MACH LEARN RES, V12, P663

[13]

Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137

[14]

Friedman N, 1999, UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, P196

[15] A hybrid algorithm for Bayesian network structure learning with application to multi-label learning [J].

Gasse, Maxime ;

Aussem, Alex ;

Elghazel, Haytham .

EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (15) :6755-6772

[16]

Hadoop White T., 2012, THE DEFINITIVE GUIDE

[17]

Lantz E., 2007, P 23 C UNC ART INT

[18]

Liu H, 2017, KNOWLEDGE BASED SYST

[19] A parallel algorithm for Bayesian network structure learning from large data sets [J].

Madsen, Anders L. ;

Jensen, Frank ;

Salmeron, Antonio ;

Langseth, Helge ;

Nielsen, Thomas D. .

KNOWLEDGE-BASED SYSTEMS, 2017, 117 :46-55

[20]

Pearl J., 1988, PROBABILISTIC REASON, DOI DOI 10.1016/C2009-0-27609-4

← 1 2 3 →