Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process

被引:276
作者
Belton, Ian [1 ]
MacDonald, Alice [1 ]
Wright, George [1 ]
Hamlin, Iain [1 ]
机构
[1] Univ Strathclyde, Glasgow, Lanark, Scotland
关键词
Delphi; Review; Methodology; Judgment; Expert; Consensus; REAL-TIME DELPHI; TECHNOLOGY FORESIGHT; RESPONSE CATEGORIES; OPTIMAL NUMBER; POLICY DELPHI; NOMINAL GROUP; CONSENSUS; FUTURE; CRITERIA; RELIABILITY;
D O I
10.1016/j.techfore.2019.07.002
中图分类号
F [经济];
学科分类号
02 ;
摘要
This paper provides a practical, systematic approach to the design and delivery of a Delphi survey. We prescribe a sequence of six steps to do with (i) setting up the Delphi process - including selecting respondents and generating a requisite number of focal issues, (ii) software/delivery choice, (iii) developing question items and response scales, (iv) providing feedback between a requisite number of Delphi rounds, (v) preventing and dealing with panellist drop out, and (vi) analysing and presenting the Delphi yield. At each step, the Delphi administrator has a range of choice options and we provide discussion of the pros and cons of each option - in order that the overall design and delivery of a particular Delphi survey is both well-founded and defensible.
引用
收藏
页码:72 / 82
页数:11
相关论文
共 135 条
[1]   Real-Time Delphi in practice - A comparative analysis of existing software-based tools [J].
Aengenheyster, Stefan ;
Cuhls, Kerstin ;
Gerhold, Lars ;
Heiskanen-Schuettler, Maria ;
Huck, Jana ;
Muszynska, Monika .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2017, 118 :15-27
[2]   A consensus model for Delphi processes with linguistic terms and its application to chronic pain in neonates definition [J].
Agell, Nuria ;
van Ganzewinkel, Christ Jan ;
Sanchez, Monica ;
Rosello, Llorenc ;
Prats, Francesc ;
Andriessen, Peter .
APPLIED SOFT COMPUTING, 2015, 35 :942-948
[3]   Futuribles of learning 2030 - Delphi supports the reform of the core curricula in Finland [J].
Airaksinen, Tiina ;
Halinen, Irmeli ;
Linturi, Hannu .
EUROPEAN JOURNAL OF FUTURES RESEARCH, 2016, 5 (01)
[4]  
Anja Goritz., 2010, Advanced methods for conducting online behavioral research, P219, DOI DOI 10.1037/12076-014
[5]  
Anney V., 2014, J EMERGING TRENDS ED, V5, P272, DOI DOI 10.1080/13623699.2018.1518748
[6]  
[Anonymous], 1985, NATURALISTIC INQUIRY
[7]  
APEC Center for Technology Foresight, 2010, REP DELPH AN LOW CAR
[8]   Using the Theory of Satisficing to Evaluate the Quality of Survey Data [J].
Barge, Scott ;
Gehlbach, Hunter .
RESEARCH IN HIGHER EDUCATION, 2012, 53 (02) :182-200
[9]   Do We Agree? Using a Delphi Technique to Develop Consensus on Skills of Hand Expression [J].
Becker, Genevieve E. ;
Roberts, Trudie .
JOURNAL OF HUMAN LACTATION, 2009, 25 (02) :220-225
[10]  
Belton L.K., 2019, UNPUB