First international Competition on Runtime Verification: rules, benchmarks, tools, and final results of CRV 2014

被引:0
作者
Ezio Bartocci
Yliès Falcone
Borzoo Bonakdarpour
Christian Colombo
Normann Decker
Klaus Havelund
Yogi Joshi
Felix Klaedtke
Reed Milewicz
Giles Reger
Grigore Rosu
Julien Signoles
Daniel Thoma
Eugen Zalinescu
Yi Zhang
机构
[1] TU Wien,Inria, CNRS, Laboratoire d’Informatique de Grenoble
[2] Univ. Grenoble-Alpes,undefined
[3] University of Illinois at Urbana-Champaign,undefined
[4] McMaster University,undefined
[5] University of Malta,undefined
[6] Lübeck University,undefined
[7] Jet Propulsion Laboratory,undefined
[8] NASA,undefined
[9] University of Waterloo,undefined
[10] NEC Laboratories Europe,undefined
[11] University of Alabama at Birmingham,undefined
[12] University of Manchester,undefined
[13] CEA,undefined
[14] LIST,undefined
[15] Software Security Laboratory,undefined
[16] ETH Zurich,undefined
来源
International Journal on Software Tools for Technology Transfer | 2019年 / 21卷
关键词
Runtime Verification; Software competition; Monitoring; Benchmarks;
D O I
暂无
中图分类号
学科分类号
摘要
The first international Competition on Runtime Verification (CRV) was held in September 2014, in Toronto, Canada, as a satellite event of the 14th international conference on Runtime Verification (RV’14). The event was organized in three tracks: (1) offline monitoring, (2) online monitoring of C programs, and (3) online monitoring of Java programs. In this paper, we report on the phases and rules, a description of the participating teams and their submitted benchmark, the (full) results, as well as the lessons learned from the competition.
引用
收藏
页码:31 / 70
页数:39
相关论文
共 67 条
[1]  
Basin D(2013)Monitoring data usage in distributed systems IEEE Trans. Softw. Eng. 39 1403-1426
[2]  
Harvan M(2015)Greedily computing associative aggregations on sliding windows Inf. Process. Lett. 115 186-192
[3]  
Klaedtke F(2016)Scalable offline monitoring Form. Methods Syst. Des. 49 75-108
[4]  
Zălinescu E(2015)Monitoring of temporal first-order properties with aggregations Form. Methods Syst. Des. 46 262-285
[5]  
Basin D(2012)Juliet 1.1 C/C++ and Java test suite Computer 45 88-90
[6]  
Klaedtke F(1991)A calculus of durations Inf. Process. Lett. 40 269-276
[7]  
Zălinescu E(2012)Safer asynchronous runtime monitoring using compensations Form. Methods Syst. Des. 41 269-294
[8]  
Basin DA(1986)How not to lie with statistics: the correct way to summarize benchmark results Commun. ACM 29 218-221
[9]  
Caronni G(2014)Rigorous examination of reactive systems—the RERS challenges 2012 and 2013 STTT 16 457-464
[10]  
Ereth S(2015)Verifythis 2012—a program verification competition STTT 17 647-657