A Method For Hybrid Bayesian Network Structure Learning from Massive Data Using MapReduce

被引：2

作者：

Li, Shun ^{[1
]}

Wang, Biao ^{[1
]}

机构：

[1] Univ Int Relat, Sch Informat Sci & Technol, Beijing 100091, Peoples R China

来源：

2017 IEEE 3RD INTERNATIONAL CONFERENCE ON BIG DATA SECURITY ON CLOUD (BIGDATASECURITY, IEEE 3RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, (HPSC) AND 2ND IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA AND SECURITY (IDS) | 2017年

关键词：

Bayesian Network; Structure Learning; MapReduce; styling; Hybrid Learning; ALGORITHM; PARALLEL;

D O I：

10.1109/BigDataSecurity.2017.42

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Bayesian Network is the popular and important data mining model for representing uncertain knowledge. For large scale data it is often too costly to learn the accurate structure. To resolve this problem, much work has been done on migrating the structure learning algorithms to the MapReduce framework. In this paper, we introduce a distributed hybrid structure learning algorithm by combining the advantages of constraint-based and score-and-search-based algorithms. By reusing the intermediate results of MapReduce, the algorithm greatly simplified the computing work and got good results in both efficiency and accuracy.

引用

页码：272 / 276

页数：5

共 50 条

[21] Learning the Structure of Bayesian Networks from Incomplete Data Using a Mixture Model [J].

Salman I. ;

Vomlel J. .

Informatica (Slovenia), 2023, 47 (01) :81-94

[22] Causal inference and Bayesian network structure learning from nominal data [J].

Guiming Luo ;

Boxu Zhao ;

Shiyuan Du .

Applied Intelligence, 2019, 49 :253-264

[23] Causal inference and Bayesian network structure learning from nominal data [J].

Luo, Guiming ;

Zhao, Boxu ;

Du, Shiyuan .

APPLIED INTELLIGENCE, 2019, 49 (01) :253-264

[24] Towards MapReduce based Bayesian Deep Learning Network for Monitoring Big Data Applications [J].

Shafiq, M. Omair ;

Torunski, Eric .

2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, :2112-2121

[25] A Structure Learning Algorithm for Bayesian Network Using Prior Knowledge [J].

Xu, Jun-Gang ;

Zhao, Yue ;

Chen, Jian ;

Han, Chao .

JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2015, 30 (04) :713-724

[26] A Bayesian Network structure learning algorithm using experts' knowledge [J].

Guo, Huiping ;

Li, Hongru .

2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, :287-292

[27] A Structure Learning Algorithm for Bayesian Network Using Prior Knowledge [J].

Jun-Gang Xu ;

Yue Zhao ;

Jian Chen ;

Chao Han .

Journal of Computer Science and Technology, 2015, 30 :713-724

[28] A Bayesian network structure learning method for optimizing ordering search operator [J].

Jia L. ;

Dong M. ;

He C. ;

Di R. ;

Li X. .

Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2023, 41 (02) :419-427

[29] Particle Swarm Optimization based method for Bayesian Network Structure Learning [J].

Aouay, Saoussen ;

Jamoussi, Salma ;

Ben Ayed, Yassine .

2013 5TH INTERNATIONAL CONFERENCE ON MODELING, SIMULATION AND APPLIED OPTIMIZATION (ICMSAO), 2013,

[30] Learning distributed bayesian network structure using majority-based method [J].

Shetty, Sachin ;

Song, Min ;

Yang, Houjun ;

Matthews, Lisa .

JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2009, 9 (01) :S53-S68

← 1 2 3 4 5 →