Systematic Review and Aggregation of Empirical Studies on Elicitation Techniques

被引:77
作者
Dieste, Oscar [1 ]
Juristo, Natalia [1 ]
机构
[1] Univ Politecn Madrid, Fac Informat, Boadilla De Monte 28660, Spain
关键词
Elicitation methods; performance measures; experimentation; systematic literature review; KNOWLEDGE ELICITATION; REQUIREMENTS ELICITATION; ELICITING KNOWLEDGE; ACQUISITION; INFORMATION; REPRESENTATIONS; ATTRIBUTES; EXPERTS;
D O I
10.1109/TSE.2010.33
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We have located the results of empirical studies on elicitation techniques and aggregated these results to gather empirically grounded evidence. Our chosen surveying methodology was systematic review, whereas we used an adaptation of comparative analysis for aggregation because meta-analysis techniques could not be applied. The review identified 564 publications from the SCOPUS, IEEEXPLORE, and ACM DL databases, as well as Google. We selected and extracted data from 26 of those publications. The selected publications contain 30 empirical studies. These studies were designed to test 43 elicitation techniques and 50 different response variables. We got 100 separate results from the experiments. The aggregation generated 17 pieces of knowledge about the interviewing, laddering, sorting, and protocol analysis elicitation techniques. We provide a set of guidelines based on the gathered pieces of knowledge.
引用
收藏
页码:283 / 304
页数:22
相关论文
共 101 条
[41]  
Goodrich V., 1990, Proceedings of the Twenty-Third Annual Hawaii International Conference on System Sciences, P201, DOI 10.1109/HICSS.1990.205257
[42]   CONCEPTUAL GRAPH ANALYSIS - KNOWLEDGE ACQUISITION FOR INSTRUCTIONAL-SYSTEM DESIGN [J].
GORDON, SE ;
SCHMIERER, KA ;
GILL, RT .
HUMAN FACTORS, 1993, 35 (03) :459-481
[43]   THE VOICE OF THE CUSTOMER [J].
GRIFFIN, A ;
HAUSER, JR .
MARKETING SCIENCE, 1993, 12 (01) :1-27
[44]  
Hart A., 1986, KNOWLEDGE ACQUISITIO
[45]  
Hedges L. V., 2014, Statistical methods for metaanalysis
[46]  
HICKEY AM, 2003, P 9 ANN AM C INFORM
[47]   Causal cognitive mapping in the organizational strategy field: A comparison of alternative elicitation procedures [J].
Hodgkinson, GP ;
Maule, AJ ;
Bown, NJ .
ORGANIZATIONAL RESEARCH METHODS, 2004, 7 (01) :3-26
[48]  
HOFFMAN RR, 1987, AI MAG, V8, P53
[49]   ELICITING KNOWLEDGE FROM EXPERTS - A METHODOLOGICAL ANALYSIS [J].
HOFFMAN, RR ;
SHADBOLT, NR ;
BURTON, AM ;
KLEIN, G .
ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1995, 62 (02) :129-158
[50]   AN EXPLORATORY-STUDY OF 2 KA METHODS [J].
HOLSAPPLE, CW ;
RAJ, VS .
EXPERT SYSTEMS, 1994, 11 (02) :77-87