Research of a MapReduce Communication Data Stream Processing Model

被引：0

作者：

Yang, Wenchuan ^{[1
]}

Jia, Bei ^{[2
]}

机构：

[1] Beijing Univ Posts & Telecommun, Sch Comp, Beijing 100876, Peoples R China

[2] Xian Commun Inst, Xian 710106, Peoples R China

来源：

PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON CLOUD COMPUTING AND INFORMATION SECURITY (CCIS 2013) | 2013年 / 52卷

关键词：

Cloud Computing; Hadoop; Hive; MapReduce; Workflow;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we propose CDS-MR, a MapReduce deep service analysis system based on Hive/Hadoop frameworks. Normally, the job of the switch is to transmit data. There is a tendency to put more capability into the switch, such as retain or query pass by data. Thus we definitely need to think about what can be kept in working storage and how to analysis it. Obviously, the ordinary database cannot handle the massive dataset and complex ad-hoc query. MapReduce is a popular and widely used fine grain parallel runtime, which is developed for high performance processing of large scale dataset.

引用

页码：28 / 31

页数：4

共 50 条

[21] OceanRoute: Vessel Mobility Data Processing and Analyzing Model Based on MapReduce
Chao Liu
Yingjian Liu
Zhongwen Guo
Wei Jing
Journal of Ocean University of China, 2018, 17 : 594 - 602
[22] Study on massive data processing of intermittent energy based on MapReduce Model
Mei, Huawei
Mi, Zengqiang
Wu, Guanglei
Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2014, 38 (15): : 76 - 80and99
[23] Parallel Data Processing with MapReduce: A Survey
Lee, Kyong-Ha
Lee, Yoon-Joon
Choi, Hyunsik
Chung, Yon Dohn
Moon, Bongki
SIGMOD RECORD, 2011, 40 (04) : 11 - 20
[24] Large Scale Data Storage and Processing of Insulator Leakage Current Using HBase and MapReduce
Song, Yaqi
Zhu, Yongli
Li, Li
2014 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON), 2014, : 1331 - 1337
[25] Data stream treatment using sliding windows with MapReduce
Jose Basgall, Maria
Hasperue, Waldo
Naiouf, Marcelo
JOURNAL OF COMPUTER SCIENCE & TECHNOLOGY, 2016, 16 (02): : 76 - 83
[26] MapReduce based Frameworks for Classifying Evolving Data Stream
Haque, Ahsanul
Khan, Latifur
2013 IEEE 13TH INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2013, : 1113 - 1120
[27] An overview and an Approach for Graph Data Processing using Hadoop MapReduce
Talan, Pooja P.
Sharma, Kartik U.
PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTING METHODOLOGIES AND COMMUNICATION (ICCMC 2018), 2018, : 59 - 63
[28] Improving Mapreduce for Incremental Processing Using Map Data Storage
Anandkrishna, R.
Kumar, Dhananjay
FOURTH INTERNATIONAL CONFERENCE ON RECENT TRENDS IN COMPUTER SCIENCE & ENGINEERING (ICRTCSE 2016), 2016, 87 : 288 - 293
[29] A Comparison Study of Graph Data Processing Based on MyBSP and MapReduce
Liu, Chao
Yao, Hong
Tang, Zhengwang
Zeng, Deze
Hu, Chengyu
Liang, Qingzhong
2014 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA (CCBD), 2014, : 70 - 74
[30] Heterogeneous Architectures for Big Data Batch Processing in MapReduce Paradigm
Goudarzi, Maziar
IEEE TRANSACTIONS ON BIG DATA, 2019, 5 (01) : 18 - 33

← 1 2 3 4 5 →