Learning Combinatorial Interaction Test Generation Strategies using Hyperheuristic Search

被引:83
作者
Jia, Yue [1 ]
Cohen, Myra B. [2 ]
Harman, Mark [1 ]
Petke, Justyna [1 ]
机构
[1] UCL, London WC1E 6BT, England
[2] Univ Nebraska, Lincoln, NE 68588 USA
来源
2015 IEEE/ACM 37TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, VOL 1 | 2015年
基金
英国工程与自然科学研究理事会;
关键词
INTERACTION TEST SUITES; HEURISTICS; STATE;
D O I
10.1109/ICSE.2015.71
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The surge of search based software engineering research has been hampered by the need to develop customized search algorithms for different classes of the same problem. For instance, two decades of bespoke Combinatorial Interaction Testing (CIT) algorithm development, our exemplar problem, has left software engineers with a bewildering choice of CIT techniques, each specialized for a particular task. This paper proposes the use of a single hyperheuristic algorithm that learns search strategies across a broad range of problem instances, providing a single generalist approach. We have developed a Hyperheuristic algorithm for CIT, and report experiments that show that our algorithm competes with known best solutions across constrained and unconstrained problems: For all 26 real-world subjects, it equals or outperforms the best result previously reported in the literature. We also present evidence that our algorithm's strong generic performance results from its unsupervised learning. Hyperheuristic search is thus a promising way to relocate CIT design intelligence from human to machine.
引用
收藏
页码:540 / 550
页数:11
相关论文
共 39 条
[1]   A Systematic Review of the Application and Empirical Investigation of Search-Based Test Case Generation [J].
Ali, Shaukat ;
Briand, Lionel C. ;
Hemmati, Hadi ;
Panesar-Walawege, Rajwinder K. .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2010, 36 (06) :742-762
[2]  
Amazon, EC2 EL COMP CLOUD
[3]  
[Anonymous], 2006, PROC 24 PACIFIC NW S
[4]  
[Anonymous], 2007, P 2007 INT S SOFTWAR
[5]  
Bryce RC, 2007, GECCO 2007: GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, VOL 1 AND 2, P1082
[6]   Hyper-heuristics: a survey of the state of the art [J].
Burke, Edmund K. ;
Gendreau, Michel ;
Hyde, Matthew ;
Kendall, Graham ;
Ochoa, Gabriela ;
Oezcan, Ender ;
Qu, Rong .
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2013, 64 (12) :1695-1724
[7]   Combinatorial Interaction Testing with CITLAB [J].
Calvagna, Andrea ;
Gargantini, Angelo ;
Vavassori, Paolo .
2013 IEEE SIXTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2013), 2013, :376-382
[8]   T-wise combinatorial interaction test suites construction based on coverage inheritance [J].
Calvagna, Andrea ;
Gargantini, Angelo .
SOFTWARE TESTING VERIFICATION & RELIABILITY, 2012, 22 (07) :507-526
[9]   A Formal Logic Approach to Constrained Combinatorial Testing [J].
Calvagna, Andrea ;
Gargantini, Angelo .
JOURNAL OF AUTOMATED REASONING, 2010, 45 (04) :331-358
[10]   On the state of strength-three covering arrays [J].
Chateauneuf, M ;
Kreher, DL .
JOURNAL OF COMBINATORIAL DESIGNS, 2002, 10 (04) :217-238