Real-Time Analytics: Concepts, Architectures, and ML/AI Considerations

被引:9
作者
Chen, Weisi [1 ]
Milosevic, Zoran [2 ,4 ]
Rabhi, Fethi A. [3 ]
Berry, Andrew [2 ]
机构
[1] Xiamen Univ Technol, Sch Software Engn, Xiamen 361024, Fujian, Peoples R China
[2] Deontik, Brisbane, Qld 4032, Australia
[3] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
[4] Best Practice Software, Brisbane, Qld 4000, Australia
关键词
Real-time analytics; data streaming; big data analytics; complex event processing; machine learning; BIG DATA ANALYTICS; PREDICTIVE ANALYTICS; LEARNING ANALYTICS; SYSTEM; STREAM; KAFKA;
D O I
10.1109/ACCESS.2023.3295694
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advancement in intelligent devices, social media, and the Internet of Things, staggering amounts of new data are being generated, and the pace is continuously accelerating. Real-time analytics (RTA) has emerged as a distinct branch of big data analytics focusing on the velocity aspect of big data, in which data is prepared, processed, and analyzed as it arrives, intending to generate insights and create business value in near real-time. The objective of this paper is to provide an overview of key concepts and architectural approaches for designing RTA solutions, including the relevant infrastructure, processing, and analytics platforms, as well as analytics techniques and tools with the most up-to-date machine learning and artificial intelligence considerations, and position these in the context of the most prominent platforms and analytics techniques. The paper develops a logical analytics stack to support the description of key functionality and relationships between relevant components in RTA solutions based on a thorough literature review and industrial practice. This provides practitioners with guidance in selecting the most appropriate solutions for their RTA problems, including the application of emerging AI technologies in this context. The paper discusses the complex event processing technology that has influenced many recent data streaming solutions in the analytics stack and highlights the integration of machine learning and artificial intelligence into RTA solutions. Some real-life application scenarios in the finance and health domains are presented, including several of the authors' earlier contributions, to demonstrate the utilization of the techniques and technologies discussed in this paper. Future research directions and remaining challenges are discussed.
引用
收藏
页码:71634 / 71657
页数:24
相关论文
共 50 条
[41]   AI for Real-Time Traffic Management in Communication Networks [J].
Sonawane, Gauri, V ;
Patil, Purushottam R. ;
Bhaladhare, Pawan R. .
METALLURGICAL & MATERIALS ENGINEERING, 2025, 31 (01) :475-485
[42]   Big Data Analytics Architecture for Real-Time Traffic Control [J].
Amini, Sasan ;
Gerostathopoulos, Ilias ;
Prehofer, Christian .
2017 5TH IEEE INTERNATIONAL CONFERENCE ON MODELS AND TECHNOLOGIES FOR INTELLIGENT TRANSPORTATION SYSTEMS (MT-ITS), 2017, :710-715
[43]   Real-Time Bigdata Analytics: A Stream Data Mining Approach [J].
Tidke, Bharat ;
Mehta, Rupa G. ;
Dhanani, Jenish .
RECENT FINDINGS IN INTELLIGENT COMPUTING TECHNIQUES, VOL 2, 2018, 708 :345-351
[44]   Real-Time Visual Analytics for Remote Monitoring of Patients' Health [J].
Boumrah M. ;
Garbaya S. ;
Radgui A. .
Computer Science Research Notes, 2023, 31 (1-2) :368-378
[45]   An Autonomic Approach to Real-Time Predictive Analytics using Open Data and Internet of Things [J].
Derguech, Wassim ;
Bruke, Eanna ;
Curry, Edward .
2014 IEEE 11TH INTL CONF ON UBIQUITOUS INTELLIGENCE AND COMPUTING AND 2014 IEEE 11TH INTL CONF ON AUTONOMIC AND TRUSTED COMPUTING AND 2014 IEEE 14TH INTL CONF ON SCALABLE COMPUTING AND COMMUNICATIONS AND ITS ASSOCIATED WORKSHOPS, 2014, :204-211
[46]   Predictive Analytics and Machine Learning for Real-Time Supply Chain Risk Mitigation and Agility [J].
Aljohani, Abeer .
SUSTAINABILITY, 2023, 15 (20)
[47]   Conversation Analytics: Can Machines Read Between the Lines in Real-Time Strategic Conversations? [J].
Chen, Yanzhen ;
Rui, Huaxia ;
Whinston, Andrew B. .
INFORMATION SYSTEMS RESEARCH, 2024, :440-455
[48]   Improving hearing healthcare with Big Data analytics of real-time hearing aid data [J].
Christensen, Jeppe H. ;
Pontoppidan, Niels H. ;
Anisetti, Marco ;
Bellandi, Valerio ;
Cremonini, Marco .
2019 IEEE WORLD CONGRESS ON SERVICES (IEEE SERVICES 2019), 2019, :307-313
[49]   Improved Big Data Analytics Solution Using Deep Learning Model and Real-Time Sentiment Data Analysis Approach [J].
Chen, Chun-I Philip ;
Zheng, Jiangbin .
ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2018, 2018, 10989 :579-588
[50]   AI-ML applications in bioprocessing: ML as an enabler of real time quality prediction in continuous manufacturing of mAbs [J].
Nikita, Saxena ;
Thakur, Garima ;
Jesubalan, Naveen G. ;
Kulkarni, Amey ;
Yezhuvath, Vinesh B. ;
Rathore, Anurag S. .
COMPUTERS & CHEMICAL ENGINEERING, 2022, 164