Some New Observations on SLO-aware Edge Stream Processing

被引:2
|
作者
Shahid, Amna [1 ]
Kang, Peng [2 ]
Lama, Palden [2 ]
Khan, Samee U. [1 ]
机构
[1] Mississippi State Univ, Mississippi State, MS 39762 USA
[2] Univ Texas San Antonio, San Antonio, TX USA
来源
2023 IEEE CLOUD SUMMIT | 2023年
关键词
Internet of Things; Stream Processing; Prioritybased Scheduler;
D O I
10.1109/CloudSummit57601.2023.00011
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The emergence of edge stream processing has created a new way of processing real-time data from the Internet of Things (IoT), which comprises a plethora of geographically dispersed physical devices equipped with sensors and actuators that exchange data with the Cloud. Nevertheless, edge stream processing systems face new challenges, including dynamic workloads, resource limitations, and multi-tenant application hosting. Adaptive resource management has been proposed to address these issues. However, this technique may lead to Service Level Objective (SLO) violations when the system encounters resource constraints. To mitigate this problem, we investigate the benefits of using priority-based stream data to reduce the SLO violations associated with adaptive resource management. Our findings demonstrate that segregating data according to their priority levels and processing them accordingly can significantly enhance the efficiency and stability of the system. We implemented this technique on the Storm Streaming system and used RIOT as a benchmark, employing VRebalance and other approaches to adjust system resources dynamically.
引用
收藏
页码:27 / 32
页数:6
相关论文
共 50 条
  • [21] SLO-Aware Function Placement for Serverless Workflows With Layer-Wise Memory Sharing
    Cheng, Dazhao
    Yan, Kai
    Cai, Xinquan
    Gong, Yili
    Hu, Chuang
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (06) : 919 - 936
  • [22] Tangram: High-resolution Video Analytics on Serverless Platform with SLO-aware Batching
    Peng, Haosong
    Zhan, Yufeng
    Li, Peng
    Xia, Yuanqing
    2024 IEEE 44TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS 2024, 2024, : 645 - 655
  • [23] SDRP: Safe, Efficient, and SLO-Aware Workload Consolidation Through Secure and Dynamic Resource Partitioning
    Han, Myeonggyun
    Baek, Woongki
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (04) : 1868 - 1882
  • [24] Enabling Cost-Effective, SLO-Aware Machine Learning Inference Serving on Public Cloud
    Zhang, Chengliang
    Yu, Minchen
    Wang, Wei
    Yan, Feng
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2022, 10 (03) : 1765 - 1779
  • [25] Graph Neural Network-Based SLO-Aware Proactive Resource Autoscaling Framework for Microservices
    Park, Jinwoo
    Choi, Byungkwon
    Lee, Chunghan
    Han, Dongsu
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (04) : 3331 - 3346
  • [26] MArk: Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving
    Zhang, Chengliang
    Yu, Minchen
    Wang, Wei
    Yan, Feng
    PROCEEDINGS OF THE 2019 USENIX ANNUAL TECHNICAL CONFERENCE, 2019, : 1049 - 1062
  • [27] mSIRM: Cost-Efficient and SLO-aware ML Load Balancing on Fog and Multi-Cloud Network
    Phalak, Chetan
    Chahal, Dheeraj
    Ramesh, Manju
    Singhal, Rekha
    PROCEEDINGS OF THE 13TH WORKSHOP ON AI AND SCIENTIFIC COMPUTING AT SCALE USING FLEXIBLE COMPUTING INFRASTRUCTURES, FLEXSCIENCE 2023, 2023, : 19 - 26
  • [28] Data-priority Aware Fair Task Scheduling for Stream Processing at the Edge
    Akram, Faiza
    Kang, Peng
    Lama, Palden
    Khan, Samee U.
    2024 IEEE CLOUD SUMMIT, CLOUD SUMMIT 2024, 2024, : 117 - 122
  • [29] AutoInfer: Self-Driving Management for Resource-Efficient, SLO-Aware Machine=Learning Inference in GPU Clusters
    Cai, Binlei
    Guo, Qin
    Dong, Xiaodong
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (07): : 6271 - 6285
  • [30] Mode Aware Stream Query Processing
    Wei, Mingrui
    Rundensteiner, Elke
    SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, PROCEEDINGS, 2009, 5566 : 380 - 397