Cost of Fault-Tolerance on Data Stream Processing

被引：0

作者：

Vianello, Valerio ^{[1
]}

Patino-Martinez, Marta ^{[1
]}

Azqueta-Alzuar, Ainhoa ^{[1
]}

Jimenez-Peris, Ricardo ^{[2
]}

机构：

[1] Univ Politecn Madrid, Madrid, Spain

[2] LeanXcale, Madrid, Spain

来源：

EURO-PAR 2018: PARALLEL PROCESSING WORKSHOPS | 2019年 / 11339卷

基金：

欧盟地平线“2020”;

关键词：

Data streaming; Fault tolerance; Evaluation; HiBench;

D O I：

10.1007/978-3-030-10549-5_2

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

Data streaming engines process data on the fly in contrast to databases that first, store the data and then, they process it. In order to process the increasing amount of data produced every day, data streaming engines run on top of a distributed system. In this setting failures will likely happen. Current distributed data streaming engines like Apache Flink provide fault tolerance. In this paper we evaluate the impact on performance of fault tolerance mechanisms of Flink during regular operation (when there are no failures) on a distributed system and the impact on performance when there are failures. We use the Intel HiBench for conducting the evaluation.

引用

页码：17 / 27

页数：11

共 50 条

[1] Fault-tolerance in the borealis distributed stream processing system
Balazinska, Magdalena
Balakrishnan, Hari
Madden, Samuel R.
Stonebraker, Michael
ACM TRANSACTIONS ON DATABASE SYSTEMS, 2008, 33 (01):
[2] Fault-Tolerance Implementation in Typical Distributed Stream Processing Systems
Chen, Wuhong
Tsai, Jichiang
JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2014, 30 (04) : 1167 - 1186
[3] Optimizing checkpoint-based fault-tolerance in distributed stream processing systems: Theory to practice
Jayasekara, Sachini
Karunasekera, Shanika
Harwood, Aaron
SOFTWARE-PRACTICE & EXPERIENCE, 2022, 52 (01): : 296 - 315
[4] Low-cost fault-tolerance in barrier synchronizations
Kulkarni, SS
Arora, A
1998 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING - PROCEEDINGS, 1998, : 132 - 139
[5] Multiplexing schemes for cost-effective fault-tolerance
Roy, S
Beiu, V
2004 4TH IEEE CONFERENCE ON NANOTECHNOLOGY, 2004, : 589 - 592
[6] Increased Fault-Tolerance and Real-time Performance Resiliency for Stream Processing Workloads through Redundancy
Tran, Geoffrey Phi C.
Walters, John Paul
Crago, Stephen P.
2019 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (IEEE SCC 2019), 2019, : 51 - 55
[7] Low Cost Rollback to Improve Fault-Tolerance in VLSI Circuits
Bonnoit, Thierry
Zergainoh, Nacer-Eddine
Nicolaidis, Michael
Velazco, Raoul
2017 IEEE 8TH LATIN AMERICAN SYMPOSIUM ON CIRCUITS & SYSTEMS (LASCAS), 2017,
[8] Approximate Fault Tolerance for Sensor Stream Processing
Takao, Daiki
Sugiura, Kento
Ishikawa, Yoshiharu
DATABASES THEORY AND APPLICATIONS, ADC 2020, 2020, 12008 : 55 - 67
[9] Approximate Fault Tolerance for Edge Stream Processing
Takao, Daiki
Sugiura, Kento
Ishikawa, Yoshiharu
DATABASE AND EXPERT SYSTEMS APPLICATIONS - DEXA 2021 WORKSHOPS, 2021, 1479 : 173 - 183
[10] COMPARATIVE FAULT-TOLERANCE OF PARALLEL DISTRIBUTED-PROCESSING NETWORKS
SEGEE, BE
CARTER, MJ
IEEE TRANSACTIONS ON COMPUTERS, 1994, 43 (11) : 1323 - 1329

← 1 2 3 4 5 →