A performance modeling framework for lambda architecture based applications

被引:16
作者
Gribaudo, M. [1 ]
Iacono, M. [2 ]
Kiran, M. [3 ]
机构
[1] Politecn Milan, Dip Elettron & Informaz, Milan, Italy
[2] Univ Campania Luigi Vanvitelli, Dip Matemat & Fis, Informat Proc Syst, Caserta, Italy
[3] Lawrence Berkeley Natl Lab, Berkeley, CA USA
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2018年 / 86卷
关键词
Modeling languages; Lambda architectural pattern; Performance evaluation; Multiformalism modeling; Multisolution methods; Cloud; Analytical approach;
D O I
10.1016/j.future.2017.07.033
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The lambda architectural pattern allows to overcome some limitations of data processing frameworks. It builds on the methodology of having two different data processing streams on the same system: a real time computing for fast data streams and a batch computing behavior for massive workloads for delayed processing. While these two modes are clearly not new, lambda architectures allow them to coordinate their execution to avoid interference. However resource allocation over cloud infrastructure, has greatly impacted the overall performances (and importantly costs). If performance could be modeled in advance, architects could make better judgments on allocation of their resources to use the systems more efficiently. In this paper, we present a modeling approach, based on multiformalism and multisolution techniques, that provides a fast evaluation tool to support design choices about parameters and eventually lead to better architecture designs. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:1032 / 1041
页数:10
相关论文
共 24 条
[1]  
Baarir Soheib, 2009, Performance Evaluation Review, V36, P4, DOI 10.1145/1530873.1530876
[2]  
BARBIERATO E., Proceedings of the 7th International Conference on Performance Evaluation Methodologies and Tools, 2013 Torino, Italia, P30, DOI [10.4108/icst.valuetools.2013.254398, DOI 10.4108/ICST.VALUETOOLS.2013.254398]
[3]   Exploiting product forms solution techniques in multiformalism modeling [J].
Barbierato, Enrico ;
Dei Rossi, Gian-Luca ;
Gribaudo, Marco ;
Iacono, Mauro ;
Marin, Andrea .
ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2013, 296 :61-77
[4]  
Batyuk A, 2016, PROCEEDINGS OF THE 2016 IEEE FIRST INTERNATIONAL CONFERENCE ON DATA STREAM MINING & PROCESSING (DSMP), P345, DOI 10.1109/DSMP.2016.7583573
[5]  
Bertoli Marco, 2009, Performance Evaluation Review, V36, P10, DOI 10.1145/1530873.1530877
[6]   Exploiting mean field analysis to model performances of big data architectures [J].
Castiglione, Aniello ;
Gribaudo, Marco ;
Iacono, Mauro ;
Palmieri, Francesco .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2014, 37 :203-211
[7]   SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets [J].
Chaiken, Ronnie ;
Jenkins, Bob ;
Larson, Per-Ake ;
Ramsey, Bill ;
Shakib, Darren ;
Weaver, Simon ;
Zhou, Jingren .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2008, 1 (02) :1265-1276
[8]  
Feng Yan, 2012, Proceedings of the 2012 32nd International Conference on Distributed Computing Systems Workshops (ICDCS Workshops), P23, DOI 10.1109/ICDCSW.2012.21
[9]  
Gill D., 2015, INT J COMPUT APPL, V119, P31
[10]  
Gilmore S., 1994, Computer Performance Evaluation. Modelling Techniques and Tools. 7th International Conference Proceedings, P353