BAITAL: An Adaptive Weighted Sampling Approach for Improved t-wise Coverage

被引:27
作者
Baranov, Eduard [1 ]
Legay, Axel [1 ,2 ]
Meel, Kuldeep S. [3 ]
机构
[1] Catholic Univ Louvain, Ottignies, Belgium
[2] Aalborg Univ, Aalborg, Denmark
[3] Natl Univ Singapore, Singapore, Singapore
来源
PROCEEDINGS OF THE 28TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '20) | 2020年
基金
欧盟地平线“2020”; 新加坡国家研究基金会;
关键词
Configurable software; t-wise coverage; Weighted sampling; GENERATION;
D O I
10.1145/3368089.3409744
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The rise of highly configurable complex software and its widespread usage requires design of efficient testing methodology. t-wise coverage is a leading metric to measure the quality of the testing suite and the underlying test generation engine. While uniform sampling-based test generation is widely believed to be the state of the art approach to achieve t-wise coverage in presence of constraints on the set of configurations, such a scheme often fails to achieve high t-wise coverage in presence of complex constraints. In this work, we propose a novel approach BAITAL, based on adaptive weighted sampling using literal weighted functions, to generate test sets with high t-wise coverage. We demonstrate that our approach reaches significantly higher t-wise coverage than uniform sampling. The novel usage of literal weighted sampling leaves open several interesting directions, empirical as well as theoretical, for future research.
引用
收藏
页码:1114 / 1126
页数:13
相关论文
共 62 条
[1]  
Abal I., 2014, Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering, ASE '14, P421
[2]  
Al-Hajjaji Mustafa, 2016, ACM SIGPLAN NOTICES, V52, DOI [10.1007/BF01588971, DOI 10.1007/BF01588971]
[3]   An orchestrated survey of methodologies for automated software test case generation [J].
Anand, Saswat ;
Burke, Edmund K. ;
Chen, Tsong Yueh ;
Clark, John ;
Cohen, Myra B. ;
Grieskamp, Wolfgang ;
Harman, Mark ;
Harrold, Mary Jean ;
McMinn, Phil ;
Bertolino, Antonia ;
Li, J. Jenny ;
Zhu, Hong .
JOURNAL OF SYSTEMS AND SOFTWARE, 2013, 86 (08) :1978-2001
[4]  
[Anonymous], 2013, Advances in Neural Information Processing Systems (NIPS)
[5]  
Bellare M, 2000, INFORM COMPUT, V163, P510, DOI [10.1006/inco.2000.2885, 10.1006/inco2000.2885]
[6]  
Chakraborty Supratik, 2015, Tools and Algorithms for the Construction and Analysis of Systems. 21st International Conference, TACAS 2015, held as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2015. Proceedings: LNCS 9035, P304, DOI 10.1007/978-3-662-46681-0_25
[7]  
Chakraborty Supratik, 2013, Computer Aided Verification. 25th International Conference, CAV 2013. Proceedings. LNCS 8044, P608, DOI 10.1007/978-3-642-39799-8_40
[8]  
Chakraborty S, 2014, AAAI CONF ARTIF INTE, P1722
[9]   Balancing Scalability and Uniformity in SAT Witness Generator [J].
Chakraborty, Supratik ;
Meel, Kuldeep S. ;
Vardi, Moshe Y. .
2014 51ST ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2014,
[10]  
Chen TY, 2004, LECT NOTES COMPUT SC, V3321, P320