Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process

被引:276
作者
Belton, Ian [1 ]
MacDonald, Alice [1 ]
Wright, George [1 ]
Hamlin, Iain [1 ]
机构
[1] Univ Strathclyde, Glasgow, Lanark, Scotland
关键词
Delphi; Review; Methodology; Judgment; Expert; Consensus; REAL-TIME DELPHI; TECHNOLOGY FORESIGHT; RESPONSE CATEGORIES; OPTIMAL NUMBER; POLICY DELPHI; NOMINAL GROUP; CONSENSUS; FUTURE; CRITERIA; RELIABILITY;
D O I
10.1016/j.techfore.2019.07.002
中图分类号
F [经济];
学科分类号
02 ;
摘要
This paper provides a practical, systematic approach to the design and delivery of a Delphi survey. We prescribe a sequence of six steps to do with (i) setting up the Delphi process - including selecting respondents and generating a requisite number of focal issues, (ii) software/delivery choice, (iii) developing question items and response scales, (iv) providing feedback between a requisite number of Delphi rounds, (v) preventing and dealing with panellist drop out, and (vi) analysing and presenting the Delphi yield. At each step, the Delphi administrator has a range of choice options and we provide discussion of the pros and cons of each option - in order that the overall design and delivery of a particular Delphi survey is both well-founded and defensible.
引用
收藏
页码:72 / 82
页数:11
相关论文
共 135 条
[21]  
Clayton M. J., 1997, Educational Psychology, V17, P373, DOI [https://doi.org/10.1080/0144341970170401, DOI 10.1080/0144341970170401, 10.1080/0144341970170401]
[22]   Evaluation of current equine welfare issues in Ireland: Causes, desirability, feasibility and means of raising standards [J].
Collins, J. A. ;
Hanlon, A. ;
More, S. J. ;
Wall, P. G. ;
Kennedy, J. ;
Duggan, V. .
EQUINE VETERINARY JOURNAL, 2010, 42 (02) :105-113
[23]  
Coulacoglou C., 2018, Psychometrics and psychological assessment: Principles and applications
[24]   CONSTRUCT VALIDITY IN PSYCHOLOGICAL TESTS [J].
CRONBACH, LJ ;
MEEHL, PE .
PSYCHOLOGICAL BULLETIN, 1955, 52 (04) :281-302
[25]  
CUHLS K, 2002, DELPHI 98 NEW FORESI
[26]  
Cuhls K., 2015, Lessons for policy-making from Foresight in Non-European Countries
[27]   Roadmapping: Comparing cases in China and Germany [J].
Cuhls, Kerstin ;
de Vries, Meike ;
Li, Haili ;
Li, Ling .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2015, 101 :238-250
[28]   Technology foresight for a vision of energy sector development in Poland till 2030. Delphi survey as an element of technology foresighting [J].
Czaplicka-Kolarz, Krystyna ;
Stanczyk, Krzysztof ;
Kapusta, Krzysztof .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2009, 76 (03) :327-338
[29]   STABILITY AND AGREEMENT CRITERIA FOR THE TERMINATION OF DELPHI STUDIES [J].
DAJANI, JS ;
SINCOFF, MZ ;
TALLEY, WK .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 1979, 13 (01) :83-90
[30]  
Dalkey NC, 1969, RM5888PR RAND CORP