SQLS:A Storm-Based Query Language System for Real-Time Stream Data Analysis

被引：0

作者：

JI Yimu ^{[1
,2
,3
,4
]}

ZHANG Dianchao ^{[1
]}

SUN Yanfei ^{[5
]}

ZHAO Chuanxin ^{[6
]}

HE Jing ^{[7
]}

WANG Ruchuan ^{[2
]}

CHEN Guoliang ^{[1
,2
]}

机构：

[1] Computer of Science,Nanjing University of Posts and Telecommunications

[2] Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks

[3] Key Laboratory of Computer Network and Information Integration,Southeast University

[4] Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education,Nanjing University of Science and Technology

[5] Computer of Telecommunications,Nanjing University of Posts and Telecommunications

[6] Department of Computer,Anhui Normal University

[7] Engineering and Science,Victoria University

来源：

Chinese Journal of Electronics | 2016年 / 25卷 / 06期

关键词：

Continuous query; Ad hoc query; Storm; CQL; Real-time query processing;

D O I：

暂无

中图分类号：

TP311.13 [];

学科分类号：

1201 ;

摘要：

In this work, a Storm-based query language System(SQLS) is proposed for real-time data stream analysis. The system is compatible with Continuous query language(CQL) specification. It supports both continuous queries and one-time queries over streaming data, and meets the requirements of user experience(traditional SQL queries) and Qo S(such as real-time and throughput). In order to better meet the requirement of throughput and enhance the processing efficiency, the load shedding algorithm and cache optimization are employed during the implementation of SQL-like operators. Finally, performance testing of the proposed SQLS has been conducted on standalone Storm platform and Storm clusters. Experimental results show that our system can not only meet the needs of users, but also extend the function of real-time streaming queries processing.

引用

页码：1025 / 1033

页数：9

共 4 条

[1] Sampling Streaming Data Along Geodesic[J]. LI Wenping,YANG Jing,ZHANG Jianpei.Chinese Journal of Electronics. 2015(02)
[2] 大数据流式计算:关键技术及系统实例
孙大为
张广艳
郑纬民
[J]. 软件学报, 2014, 25 (04) : 839 - 862
[3] Aurora: a new model and architecture for data stream management[J] . The VLDB Journal . 2003 (2)
[4] The design of the borealis stream processing engine .2 Daniel J Abadi,Yanif Ahmad,Magdalena Balazinska,Ugur Cetintemel,Mitch Cherniack,Jeong-Hyon Hwang,Wolfgang Lindner,Anurag Maskey,Alex Rasin,Esther Ryvkina,Nesime Tatbul,Ying Xing,Stanley B.Zdonik. CIDR . 2005

← 1 →