Time series big data: a survey on data stream frameworks, analysis and algorithms

被引:16
作者
Almeida, Ana [1 ,2 ]
Bras, Susana [2 ,3 ]
Sargento, Susana [1 ,2 ]
Pinto, Filipe Cabral [1 ,4 ]
机构
[1] Inst Telecomunicacoes, Aveiro, Portugal
[2] Univ Aveiro, Dept Eletron Telecomunicacoes & Informat, Aveiro, Portugal
[3] Univ Aveiro, IEETA, DETI, LASI, Aveiro, Portugal
[4] Altice Labs, Aveiro, Portugal
基金
英国科研创新办公室;
关键词
Big data; Time series; Stream processing engines; Forecasting; Anomaly detection; Machine learning; ANOMALY DETECTION; NETWORK;
D O I
10.1186/s40537-023-00760-1
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Big data has a substantial role nowadays, and its importance has significantly increased over the last decade. Big data's biggest advantages are providing knowledge, supporting the decision-making process, and improving the use of resources, services, and infrastructures. The potential of big data increases when we apply it in real-time by providing real-time analysis, predictions, and forecasts, among many other applications. Our goal with this article is to provide a viewpoint on how to build a system capable of processing big data in real-time, performing analysis, and applying algorithms. A system should be designed to handle vast amounts of data and provide valuable knowledge through analysis and algorithms. This article explores the current approaches and how they can be used for the real-time operations and predictions.
引用
收藏
页数:32
相关论文
共 50 条
[41]   Parallel Time Series Modeling - A Case Study of In-Database Big Data Analytics [J].
Qian, Hai ;
Yang, Shengwen ;
Iyer, Rahul ;
Feng, Xixuan ;
Wellons, Mark ;
Welton, Caleb .
TRENDS AND APPLICATIONS IN KNOWLEDGE DISCOVERY AND DATA MINING, 2014, 8643 :417-428
[42]   A systematic survey on big data and artificial intelligence algorithms for intelligent transportation system [J].
Abirami, S. ;
Pethuraj, M. ;
Uthayakumar, M. ;
Chitra, P. .
CASE STUDIES ON TRANSPORT POLICY, 2024, 17
[43]   Analysis of Mahout Big Data Clustering Algorithms [J].
Sharma, Ishan ;
Tiwari, Rajeev ;
Rana, Hukam Singh ;
Anand, Abhineet .
INTELLIGENT COMMUNICATION, CONTROL AND DEVICES, ICICCD 2017, 2018, 624 :999-1008
[44]   BDWatchdog: Real-time monitoring and profiling of Big Data applications and frameworks [J].
Enes, Jonatan ;
Exposito, Roberto R. ;
Tourino, Juan .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 87 :420-437
[45]   Performance Improvement Algorithms in Big Data Analysis [J].
Metsker, Oleg ;
Efimov, Egor ;
Trofimov, Egor ;
Kopanitsa, Georgy ;
Bolgova, Ekaterina ;
Yakovlev, Alexey .
9TH INTERNATIONAL YOUNG SCIENTISTS CONFERENCE IN COMPUTATIONAL SCIENCE, YSC2020, 2020, 178 :386-393
[46]   Evaluation of big data frameworks for analysis of smart grids [J].
Mohammad Hasan Ansari ;
Vahid Tabatab Vakili ;
Behnam Bahrak .
Journal of Big Data, 6
[47]   A Comprehensive Survey on Big Data Technology Based Cybersecurity Analytics Systems [J].
Saravanan, S. ;
Prakash, G. .
APPLIED SOFT COMPUTING AND COMMUNICATION NETWORKS, 2021, 187 :123-143
[48]   A Survey of Algorithms, Technologies and Issues in Big Data Analytics and Applications [J].
Vaidya, Gendlal M. ;
Kshirsagar, Manali M. .
PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS 2020), 2020, :347-350
[49]   Performance Analysis of Machine Learning Algorithms for Big Data Classification: ML and Al-Based Algorithms for Big Data Analysis [J].
Punia, Sanjeev Kumar ;
Kumar, Manoj ;
Stephan, Thompson ;
Deverajan, Ganesh Gopal ;
Patan, Rizwan .
INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS, 2021, 12 (04) :60-75
[50]   A survey of big data architectures and machine learning algorithms in healthcare [J].
Manogaran G. ;
Lopez D. .
International Journal of Biomedical Engineering and Technology, 2017, 25 (2-4) :182-211