Research of a MapReduce Communication Data Stream Processing Model

In this paper, we propose CDS-MR, a MapReduce deep service analysis system based on Hive/Hadoop frameworks. Normally, the job of the switch is to transmit data. There is a tendency to put more capability into the switch, such as retain or query pass by data. Thus we definitely need to think about what can be kept in working storage and how to analysis it. Obviously, the ordinary database cannot handle the massive dataset and complex ad-hoc query. MapReduce is a popular and widely used fine grain parallel runtime, which is developed for high performance processing of large scale dataset.