Time series big data: a survey on data stream frameworks, analysis and algorithms

被引:16
作者
Almeida, Ana [1 ,2 ]
Bras, Susana [2 ,3 ]
Sargento, Susana [1 ,2 ]
Pinto, Filipe Cabral [1 ,4 ]
机构
[1] Inst Telecomunicacoes, Aveiro, Portugal
[2] Univ Aveiro, Dept Eletron Telecomunicacoes & Informat, Aveiro, Portugal
[3] Univ Aveiro, IEETA, DETI, LASI, Aveiro, Portugal
[4] Altice Labs, Aveiro, Portugal
基金
英国科研创新办公室;
关键词
Big data; Time series; Stream processing engines; Forecasting; Anomaly detection; Machine learning; ANOMALY DETECTION; NETWORK;
D O I
10.1186/s40537-023-00760-1
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Big data has a substantial role nowadays, and its importance has significantly increased over the last decade. Big data's biggest advantages are providing knowledge, supporting the decision-making process, and improving the use of resources, services, and infrastructures. The potential of big data increases when we apply it in real-time by providing real-time analysis, predictions, and forecasts, among many other applications. Our goal with this article is to provide a viewpoint on how to build a system capable of processing big data in real-time, performing analysis, and applying algorithms. A system should be designed to handle vast amounts of data and provide valuable knowledge through analysis and algorithms. This article explores the current approaches and how they can be used for the real-time operations and predictions.
引用
收藏
页数:32
相关论文
共 50 条
[11]   Evaluation of big data frameworks for analysis of smart grids [J].
Ansari, Mohammad Hasan ;
Vakili, Vahid Tabatab ;
Bahrak, Behnam .
JOURNAL OF BIG DATA, 2019, 6 (01)
[12]   Survey of Distributed Computing Frameworks for Supporting Big Data Analysis [J].
Sun, Xudong ;
He, Yulin ;
Wu, Dingming ;
Huang, Joshua Zhexue .
BIG DATA MINING AND ANALYTICS, 2023, 6 (02) :154-169
[13]   Railway Passenger Flow Forecasting Based on Time Series Analysis with Big Data [J].
Xu, Xiangqian ;
Dou, Yajie ;
Zhou, Zhexuan ;
Liao, Tianjun ;
Lu, Yanjing ;
Tan, Yuejin .
PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, :3584-3590
[14]   Systematic Mapping for Big Data Stream Processing Frameworks [J].
Alayyoub, Mohammed ;
Yazici, Ali ;
Karakaya, Ziya .
2016 ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL INFORMATION MANAGEMENT (ICDIM 2016), 2016, :31-36
[15]   A Survey on Big Data Security Algorithms [J].
Prasanna, K. Lakshmi ;
Reddy, M. Thrilok ;
Prakash, S. Shiva .
HELIX, 2018, 8 (02) :3290-3293
[16]   A Survey of Clustering Algorithms for Big Data: Taxonomy and Empirical Analysis [J].
Fahad, Adil ;
Alshatri, Najlaa ;
Tari, Zahir ;
Alamri, Abdullah ;
Khalil, Ibrahim ;
Zomaya, Albert Y. ;
Foufou, Sebti ;
Bouras, Abdelaziz .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2014, 2 (03) :267-279
[17]   A Survey on Forecasting of Time Series Data [J].
Mahalakshmi, G. ;
Sridevi, S. ;
Rajaram, S. .
2016 INTERNATIONAL CONFERENCE ON COMPUTING TECHNOLOGIES AND INTELLIGENT DATA ENGINEERING (ICCTIDE'16), 2016,
[18]   A Comprehensive Survey on Cloud Data Mining (CDM) Frameworks and Algorithms [J].
Barua, Hrishav Bakul ;
Mondal, Kartick Chandra .
ACM COMPUTING SURVEYS, 2019, 52 (05)
[19]   A survey on parallel clustering algorithms for Big Data [J].
Zineb Dafir ;
Yasmine Lamari ;
Said Chah Slaoui .
Artificial Intelligence Review, 2021, 54 :2411-2443
[20]   A survey on parallel clustering algorithms for Big Data [J].
Dafir, Zineb ;
Lamari, Yasmine ;
Slaoui, Said Chah .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (04) :2411-2443