Research of a MapReduce Communication Data Stream Processing Model

被引：0

作者：

Yang, Wenchuan ^{[1
]}

Jia, Bei ^{[2
]}

机构：

[1] Beijing Univ Posts & Telecommun, Sch Comp, Beijing 100876, Peoples R China

[2] Xian Commun Inst, Xian 710106, Peoples R China

来源：

PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON CLOUD COMPUTING AND INFORMATION SECURITY (CCIS 2013) | 2013年 / 52卷

关键词：

Cloud Computing; Hadoop; Hive; MapReduce; Workflow;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we propose CDS-MR, a MapReduce deep service analysis system based on Hive/Hadoop frameworks. Normally, the job of the switch is to transmit data. There is a tendency to put more capability into the switch, such as retain or query pass by data. Thus we definitely need to think about what can be kept in working storage and how to analysis it. Obviously, the ordinary database cannot handle the massive dataset and complex ad-hoc query. MapReduce is a popular and widely used fine grain parallel runtime, which is developed for high performance processing of large scale dataset.

引用

页码：28 / 31

页数：4

共 50 条

[31] Smart MapReduce Cloud: Applying Extra Processing to Intermediate Data on Demand
Huang, Tzu-Chi
Chu, Kuo-Chih
Tsai, Ming-Fong
2014 20TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2014, : 799 - 804
[32] Solutions for Processing K Nearest Neighbor Joins for Massive Data on MapReduce
Song, Ge
Rochas, Justine
Huet, Fabrice
Magoules, Frederic
23RD EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2015), 2015, : 279 - 287
[33] Analysis of Massive Industrial Data using MapReduce Framework for Parallel Processing
Aly, Mohab
Yacout, Soumaya
Shaban, Yasser
2017 ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM, 2017,
[34] Research of MapReduce Oriented Graphical Programming
Du, Wulun
Luan, Zhongzhi
Qian, Depei
Xie, Ming
Chen, Wei
2013 INTERNATIONAL CONFERENCE ON CLOUD AND SERVICE COMPUTING (CSC 2013), 2013, : 160 - 161
[35] XHAMI - extended HDFS and MapReduce interface for Big Data image processing applications in cloud computing environments
Kune, Raghavendra
Konugurthi, Pramod Kumar
Agarwal, Arun
Chillarige, Raghavendra Rao
Buyya, Rajkumar
SOFTWARE-PRACTICE & EXPERIENCE, 2017, 47 (03) : 455 - 472
[36] MapReduce with communication overlap (MaRCO)
Ahmad, Faraz
Lee, Seyong
Thottethodi, Mithuna
Vijaykumar, T. N.
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2013, 73 (05) : 608 - 620
[37] Cloud computing model for big data processing and performance optimization of multimedia communication
Zhou, Zhicheng
Zhao, Liang
COMPUTER COMMUNICATIONS, 2020, 160 : 326 - 332
[38] Cloud Federation to Elastically Increase MapReduce Processing Resources
Panarello, Alfonso
Fazio, Maria
Celesti, Antonio
Puliafito, Antonio
Villari, Massimo
EURO-PAR 2014: PARALLEL PROCESSING WORKSHOPS, PT II, 2014, 8806 : 97 - 108
[39] Classification of Knowledge Processing by MapReduce
Benhamed, Siham
Nait-Bahloul, Safia
2014 4TH INTERNATIONAL SYMPOSIUM ISKO-MAGHREB: CONCEPTS AND TOOLS FOR KNOWLEDGE MANAGEMENT (ISKO-MAGHREB), 2014,
[40] Processing of Medical Different Types of Data Using Hadoop and Java']Java MapReduce
Boyko, Nataliya
Tkachuk, Nazar
IDDM 2020: PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON INFORMATICS & DATA-DRIVEN MEDICINE, 2020, 2753

← 1 2 3 4 5 →