Research of a MapReduce Communication Data Stream Processing Model

被引：0

作者：

Yang, Wenchuan ^{[1
]}

Jia, Bei ^{[2
]}

机构：

[1] Beijing Univ Posts & Telecommun, Sch Comp, Beijing 100876, Peoples R China

[2] Xian Commun Inst, Xian 710106, Peoples R China

来源：

PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON CLOUD COMPUTING AND INFORMATION SECURITY (CCIS 2013) | 2013年 / 52卷

关键词：

Cloud Computing; Hadoop; Hive; MapReduce; Workflow;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we propose CDS-MR, a MapReduce deep service analysis system based on Hive/Hadoop frameworks. Normally, the job of the switch is to transmit data. There is a tendency to put more capability into the switch, such as retain or query pass by data. Thus we definitely need to think about what can be kept in working storage and how to analysis it. Obviously, the ordinary database cannot handle the massive dataset and complex ad-hoc query. MapReduce is a popular and widely used fine grain parallel runtime, which is developed for high performance processing of large scale dataset.

引用

页码：28 / 31

页数：4

共 50 条

[41] High-Performance Geospatial Big Data Processing System Based on MapReduce
Jo, Junghee
Lee, Kang-Woo
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2018, 7 (10):
[42] Architecture of Efficient Word Processing using Hadoop MapReduce for Big Data Applications
Mandal, Bichitra
Sahoo, Ramesh Kumar
Sethi, Srinivas
PROCEEDINGS 2015 INTERNATIONAL CONFERENCE ON MAN AND MACHINE INTERFACING (MAMI), 2015,
[43] Astronomical Data Application Research Based On MapReduce
Cui, Qingfa
Wu, Sheng
PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018), 2018, : 2345 - 2348
[44] MapReduce-Based Improved Random Forest Model for Massive Educational Data Processing and Classification
Xu, Wei
Hoang, Vinh Truong
MOBILE NETWORKS & APPLICATIONS, 2021, 26 (01) : 191 - 199
[45] MapReduce-Based Improved Random Forest Model for Massive Educational Data Processing and Classification
Wei Xu
Vinh Truong Hoang
Mobile Networks and Applications, 2021, 26 : 191 - 199
[46] XHAMI - Extended HDFS and MapReduce Interface for Image Processing Applications
Kune, Raghavendra
Konugurthi, Pramod Kumar
Agarwal, Arun
Chillarige, Raghavendra Rao
Buyya, Rajkumar
2015 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING IN EMERGING MARKETS (CCEM), 2016, : 43 - 51
[47] P2P-MapReduce: Parallel data processing in dynamic Cloud environments
Marozzo, Fabrizio
Talia, Domenico
Trunfio, Paolo
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2012, 78 (05) : 1382 - 1402
[48] Distributed XPath Query Processing over Large XML Data based on MapReduce framework
Fan, Hongjie
Wang, Dongsheng
Liu, Junfei
2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1447 - 1453
[49] A MapReduce Approach for Processing Student Data Activity in a Peer-to-peer Networked Setting
Miguel, Jorge
Caballe, Santi
Xhafa, Fatos
2015 10TH INTERNATIONAL CONFERENCE ON P2P, PARALLEL, GRID, CLOUD AND INTERNET COMPUTING (3PGCIC), 2015, : 9 - 16
[50] Scalable Big Graph Processing in MapReduce
Qin, Lu
Yu, Jeffrey Xu
Chang, Lijun
Cheng, Hong
Zhang, Chengqi
Lin, Xuemin
SIGMOD'14: PROCEEDINGS OF THE 2014 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2014, : 827 - 838

← 1 2 3 4 5 →