Quality-of-Experience driven configuration of WebRTC services through automated testing

被引:2
作者
Bertolino, Antonia [1 ]
Calabro, Antonello [1 ]
De Angelis, Guglielmo [2 ]
Gortazar, Francisco [3 ]
Lonetti, Francesca [1 ]
Maes, Michel [3 ]
Tunon, Guiomar [4 ]
机构
[1] CNR, ISTI, Pisa, Italy
[2] CNR, IASI, Pisa, Italy
[3] Univ Rey Juan Carlos, Madrid, Spain
[4] NAEVA TEC, Madrid, Spain
来源
2020 IEEE 20TH INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY, AND SECURITY (QRS 2020) | 2020年
基金
欧盟地平线“2020”;
关键词
Quality-of-Experience; Non-functional Testing; Configuration Testing; Real-time Services; WebRTC; ElasTest Platform;
D O I
10.1109/QRS51102.2020.00031
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Quality of Experience (QoE) refers to the end users level of satisfaction with a real-time service, in particular in relation to its audio and video quality. Advances in WebRTC technology have favored the spread of multimedia services through use of any browser. Provision of adequate QoE in such services is of paramount importance. The assessment of QoE is costly and can be done only late in the service lifecycle. In this work we propose a simple approach for QoE-driven non-functional testing of WebRTC services that relies on the ElasTest open-source platform for end-to-end testing of large complex systems. We describe the ElasTest platform, the proposed approach and an experimental study. In this study, we compared qualitatively and quantitatively the effort required in the ElasTest supported scenario with respect to a "traditional" solution, showing great savings in terms of effort and time.
引用
收藏
页码:152 / 159
页数:8
相关论文
共 20 条
  • [1] [Anonymous], **DATA OBJECT**, DOI DOI 10.5281/ZENODO.3739091
  • [2] [Anonymous], 2013, 10th international conference on autonomic computing (ICAC 13)
  • [3] Bai XY, 2013, 2013 8TH INTERNATIONAL WORKSHOP ON AUTOMATION OF SOFTWARE TEST (AST), P15, DOI 10.1109/IWAST.2013.6595785
  • [4] End-to-end delay analysis of videoconferencing over packet-switched networks
    Baldi, M
    Ofek, Y
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2000, 8 (04) : 479 - 492
  • [5] Bertolino A., 2019, ELASTEST VALIDATION
  • [6] Governing Regression Testing in Systems of Systems
    Bertolino, Antonia
    De Angelis, Guglielmo
    Lonetti, Francesca
    [J]. 2019 IEEE 30TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2019), 2019, : 144 - 148
  • [7] A Systematic Review on Cloud Testing
    Bertolino, Antonia
    De Angelis, Guglielmo
    Gallego, Micael
    Garcia, Boni
    Gortazar, Francisco
    Lonetti, Francesca
    Marchetti, Eda
    [J]. ACM COMPUTING SURVEYS, 2019, 52 (05)
  • [8] When the testing gets tough, the tough get ElasTest
    Bertolino, Antonia
    Calabro, Antonello
    De Angelis, Guglielmo
    Gallego, Micael
    Garcia, Boni
    Gortazar, Francisco
    [J]. PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION, 2018, : 17 - 20
  • [9] Brunnstrom K., 2013, White Paper
  • [10] Cloud Crawler: a declarative performance evaluation environment for infrastructure-as-a-service clouds
    Cunha, M.
    Mendonca, N. C.
    Sampaio, A.
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (01)