Systematic Review and Aggregation of Empirical Studies on Elicitation Techniques

被引:77
作者
Dieste, Oscar [1 ]
Juristo, Natalia [1 ]
机构
[1] Univ Politecn Madrid, Fac Informat, Boadilla De Monte 28660, Spain
关键词
Elicitation methods; performance measures; experimentation; systematic literature review; KNOWLEDGE ELICITATION; REQUIREMENTS ELICITATION; ELICITING KNOWLEDGE; ACQUISITION; INFORMATION; REPRESENTATIONS; ATTRIBUTES; EXPERTS;
D O I
10.1109/TSE.2010.33
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We have located the results of empirical studies on elicitation techniques and aggregated these results to gather empirically grounded evidence. Our chosen surveying methodology was systematic review, whereas we used an adaptation of comparative analysis for aggregation because meta-analysis techniques could not be applied. The review identified 564 publications from the SCOPUS, IEEEXPLORE, and ACM DL databases, as well as Google. We selected and extracted data from 26 of those publications. The selected publications contain 30 empirical studies. These studies were designed to test 43 elicitation techniques and 50 different response variables. We got 100 separate results from the experiments. The aggregation generated 17 pieces of knowledge about the interviewing, laddering, sorting, and protocol analysis elicitation techniques. We provide a set of guidelines based on the gathered pieces of knowledge.
引用
收藏
页码:283 / 304
页数:22
相关论文
共 101 条
[1]   AN EXPERIMENTAL INVESTIGATION OF THE RELATIVE EFFECTIVENESS OF 2 TECHNIQUES FOR STRUCTURING MULTI-ATTRIBUTED HIERARCHIES [J].
ADELMAN, L ;
STICHA, PJ ;
DONNELL, ML .
ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1986, 37 (02) :188-196
[2]   MEASUREMENT ISSUES IN KNOWLEDGE ENGINEERING [J].
ADELMAN, L .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1989, 19 (03) :483-488
[3]  
Agarwal R., 1990, Journal of Management Information Systems, V7, P123
[4]  
[Anonymous], P 24 EUR MARK AC C E
[5]   A comparison of five elicitation techniques for elicitation of attributes of low involvement products [J].
Bech-Larsen, T ;
Nielsen, NA .
JOURNAL OF ECONOMIC PSYCHOLOGY, 1999, 20 (03) :315-341
[6]   Belief assessment: An underdeveloped phase of probability elicitation [J].
Benson, PG ;
Curley, SP ;
Smith, GF .
MANAGEMENT SCIENCE, 1995, 41 (10) :1639-1653
[7]  
Blandford A, 2002, INT J HUM-COMPUT ST, V57, P75, DOI 10.1006/ijhc.1013
[8]  
Boose J. H., 1989, Knowledge Acquisition, V1, P3, DOI 10.1016/S1042-8143(89)80003-2
[9]   Elicitation of product attributes in an evaluation context: A comparison of three elicitation techniques [J].
Breivik, E ;
Supphellen, M .
JOURNAL OF ECONOMIC PSYCHOLOGY, 2003, 24 (01) :77-98
[10]  
BRERETON OP, 2005, TR0501 KEELE U