HTME: A Data Streams Processing Strategy based on Hoeffding Tree in MapReduce Environment

被引:0
作者
Song, Xin [1 ]
Gao, Jing [2 ]
Ma, Jin'an [2 ]
Niu, Shaokai [3 ]
He, Huiyuan [3 ]
机构
[1] Northeastern Univ, Ctr Comp, Qinhuangdao, Hebei, Peoples R China
[2] Northeastern Univ, Sch Control Engn, Qinhuangdao, Hebei, Peoples R China
[3] Northeastern Univ, Sch Comp Sci & Engn, Shenyang, Peoples R China
来源
PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA) | 2016年
关键词
BIG-DATA; REAL-TIME; CLASSIFICATION; CLOUD; SYSTEMS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years Wireless Sensor Networks have provided a effective solution for sensing and gathering spatial data by ZigBee protocol or other wireless network protocols. So the massive sensor data streams processing has reached many areas of monitoring application in internet of things. The sensor data streams constantly flow in and flow out of the monitoring system, cloud computing can provide a scalable storage and the massive data processing power to perform both online and offline analysis and mining of the heterogeneous sensor data streams. In order to support the classification of the sensor data streams, in this paper, a sensor data streams processing strategy is proposed based on Hoeffding tree algorithm for event monitoring application in cloud computing. The proposed strategy is sufficient for sensor data streams classification tasks using map-reduce platform of cloud computing. Finally, the possibilities of the strategy are demonstrated on spatial sensing data streams processing operations in comparison with existing solutions in the MapReduce environment. The simulation results show that the strategy achieves more energy savings and also ensures few amounts of sensor data retained in memory.
引用
收藏
页码:1642 / 1645
页数:4
相关论文
共 15 条
[1]   A Map Reduce solution for associative classification of big data [J].
Bechini, Alessio ;
Marcelloni, Francesco ;
Segatori, Armando .
INFORMATION SCIENCES, 2016, 332 :33-55
[2]   Integration of Cloud computing and Internet of Things: A survey [J].
Botta, Alessio ;
de Donato, Walter ;
Persico, Valerio ;
Pescape, Antonio .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2016, 56 :684-700
[3]   A framework for processing large scale geospatial and remote sensing data in MapReduce environment [J].
Giachetta, Roberto .
COMPUTERS & GRAPHICS-UK, 2015, 49 :37-46
[4]   The rise of "big data" on cloud computing: Review and open research issues [J].
Hashem, Ibrahim Abaker Targio ;
Yaqoob, Ibrar ;
Anuar, Nor Badrul ;
Mokhtar, Salimah ;
Gani, Abdullah ;
Khan, Samee Ullah .
INFORMATION SYSTEMS, 2015, 47 :98-115
[5]  
Hodge V. J., 2015, NEURAL NETW IN PRESS
[6]   Feature Selection and Classification of Microarray Data using MapReduce based ANOVA and K-Nearest Neighbor [J].
Kumar, Mukesh ;
Rath, Nitish Kumar ;
Swain, Amitav ;
Rath, Santanu Kumar .
ELEVENTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2015/INDIA ELEVENTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2015/NDIA ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2015, 2015, 54 :301-310
[7]   Classification of microarray using MapReduce based proximal support vector machine classifier [J].
Kumar, Mukesh ;
Rath, Santanu Kumar .
KNOWLEDGE-BASED SYSTEMS, 2015, 89 :584-602
[8]   An empirical study on implementing highly reliable stream computing systems with private cloud [J].
Liu, Yaxiao ;
Liu, Weidong ;
Song, Jiaxing ;
He, Huan .
AD HOC NETWORKS, 2015, 35 :37-50
[9]   Remote sensing big data computing: Challenges and opportunities [J].
Ma, Yan ;
Wu, Haiping ;
Wang, Lizhe ;
Huang, Bormin ;
Ranjan, Rajiv ;
Zomaya, Albert ;
Jie, Wei .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2015, 51 :47-60
[10]  
[亓开元 Qi Kaiyuan], 2012, [计算机学报, Chinese Journal of Computers], V35, P477