Optimization and Application in Medical Big Document-Data of Apriori Algorithm based on MapReduce

被引：0

作者：

Li Wei ^{[1
]}

Liu Guangming ^{[1
]}

Shao Yachao ^{[2
]}

Liu Junlong ^{[2
]}

Zuo You ^{[2
]}

机构：

[1] Natl Univ Def Technol, Changsha, Hunan, Peoples R China

[2] Natl Supercomp Ctr Tianjin, Tianjin, Peoples R China

来源：

2016 INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND INFORMATICS (ICCCI) | 2016年

关键词：

component; Medical big data; NoSQL; MapReduce; Data Mining; Apriori; optimization;

D O I：

暂无

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

For the challenges of redundancy, multi-dimension, complex and heterogeneous in medical documents, and to solve the problem that the value hidden in the huge amounts of medical document-data can't be mined, this paper proposed a system called MSPM based on NOSQL and MapReduce. Through storage of key-value pairs, complex and heterogeneous datas are summed up in a unified and convenient format of transaction for Apriori. Then Apriori is executed in parallel through MapReduce. At last, with the strategies of generating all the candidate sets non-recursively and constraint count for candidate sets of interest, it can solve the problem of low speed, high overhead and poor effectiveness for Apriori algorithm in the application of medical data. Testing results has shown the algorithm of optimization is available.

引用

页数：5

共 50 条

[21] Apriori Parallel Improved Algorithm Based on MapReduce Distributed Architecture
She Xiangyang
Zhang Ling
PROCEEDINGS OF 2016 SIXTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION & MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC 2016), 2016, : 517 - 521
[22] A Top-k Query Algorithm for Big Data Based on MapReduce
Lin, Xueyan
PROCEEDINGS OF 2015 6TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE, 2015, : 982 - 985
[23] Big Data Prediction Framework for Weather Temperature Based on MapReduce Algorithm
Ismail, Khalid Adam
Majid, Mazlina Abdul
Zain, Jasni Mohamed
Abu Bakar, Noor Akma
2016 IEEE CONFERENCE ON OPEN SYSTEMS, 2016, : 13 - 17
[24] Analysis of the Big Data based on MapReduce
Tian, Zi-de
PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTOMATION, MECHANICAL CONTROL AND COMPUTATIONAL ENGINEERING, 2015, 124 : 224 - 228
[25] An Enhancement of the MapReduce Apriori Algorithm Using Vertical Data Layout and Set Theory Concept of Intersection
Dhanya, S.
Vysaakan, M.
Mahesh, A. S.
INTELLIGENT SYSTEMS TECHNOLOGIES AND APPLICATIONS, VOL 2, 2016, 385 : 225 - 233
[26] The application characteristics of traditional Chinese medical science treatment on vertigo based on data mining Apriori algorithm
Wang, Miao
Chen, Li
Huang, Yanjun
Zhang, Lei
Zhang, Zihao
Ding, Jie
Shang, Huiliang
International Journal of Wireless and Mobile Computing, 2015, 9 (04) : 349 - 354
[27] Big data analysis on medical field for drug recommendation using apriori algorithm and deep learning
Dasgupta, Sarbani
Saha, Banani
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (35) : 83029 - 83051
[28] A Big Graph Clustering Algorithm Based on MapReduce
Leng, Yonglin
Zhang, Qingchen
MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS, 2014, 1049 : 1467 - +
[29] Toward Conceptual MapReduce Algorithm for Big Data Platfrom
Sohn, Seungdae
Kim, Jinhong
2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 985 - 988
[30] Decision Tree Algorithm Optimization Research Based on MapReduce
Yuan, Fangfang
Lian, Fusheng
Xu, Xingjian
Ji, Zhaohua
PROCEEDINGS OF 2015 6TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE, 2015, : 1010 - 1013

← 1 2 3 4 5 →