Evaluation in design science: A framework to support project studies in the context of University Research Centres

被引:7
作者
Moutinho, Jose da Assuncao [1 ,2 ]
Fernandes, Gabriela [3 ]
Rabechini, Roque [2 ]
机构
[1] State Univ Rio De Janeiro UERJ, Rua Sao Francisco Xavier 524, BR-20550013 Rio De Janeiro, RJ, Brazil
[2] Univ Nove de Julho UNINOVE, Rua Vergueiro 235-249, BR-01156080 Sao Paulo, SP, Brazil
[3] Univ Coimbra, CEMMPRE, Polo 2,Rua Luis Reis Santos, P-3030788 Coimbra, Portugal
关键词
Design science; Design science research; Framework; Project studies; Delphi method; Project management; DELPHI TECHNIQUE; MANAGEMENT; IMPACT; RELEVANCE; KNOWLEDGE; METHODOLOGY; RETHINKING; CONSENSUS; ARTIFACT; CRITERIA;
D O I
10.1016/j.evalprogplan.2023.102366
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
This paper proposes a discussion of the evaluation of an artefact developed under the Design Science paradigm using the Delphi method. It evaluates the Ecosystem framework of University Research Centres in Project Studies, considering a set of criteria pre-established in the literature. The Delphi method is an evaluation implemented in an electronic platform involving twenty-one participants, among whom were academics, practitioners, and PhD candidates in the field of project management. It reached consensus and stability in two rounds: the results indicate a consensus among the participants in the applicability, novelty, simplicity, completeness, fidelity to modelled phenomena, consistency and internal coherence, scalability, flexibility, interest, elegance, and reusability criteria. Usability was the only criterion that did not attain the predefined percentage of consensus among the participants (70%). Given the framework's characteristics, Delphi participants indicated the need to produce complementary guidelines for its implementation.
引用
收藏
页数:10
相关论文
共 96 条
[1]   Knowledge contributions in design science research: Paths of knowledge types [J].
Akoka, Jacky ;
Comyn-Wattiau, Isabelle ;
Prat, Nicolas ;
Storey, Veda C. .
DECISION SUPPORT SYSTEMS, 2023, 166
[2]   A micro level study of university industry collaborative lifecycle key performance indicators [J].
Albats, Ekaterina ;
Fiegenbaum, Irina ;
Cunningham, James A. .
JOURNAL OF TECHNOLOGY TRANSFER, 2018, 43 (02) :389-431
[3]  
[Anonymous], 2010, SYSTEMS SOFTWARE ENG, P1, DOI DOI 10.1109/IEEESTD.2010.5733835
[4]   Collaborative Value Modelling in corporate contexts with MACBETH [J].
Bana e Costa, Carlos A. ;
Vieira, Ana C. L. ;
Nobrega, Monica ;
Quintino, Antonio ;
Oliveira, Monica D. ;
Bana e Costa, Joao .
7TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT (ITQM 2019): INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT BASED ON ARTIFICIAL INTELLIGENCE, 2019, 162 :786-794
[5]   Design Science Research Contributions: Finding a Balance between Artifact and Theory [J].
Baskerville, Richard ;
Baiyere, Abayomi ;
Gregor, Shirley ;
Hevner, Alan ;
Rossi, Matti .
JOURNAL OF THE ASSOCIATION FOR INFORMATION SYSTEMS, 2018, 19 (05) :358-376
[6]   GENRES OF INQUIRY IN DESIGN-SCIENCE RESEARCH: JUSTIFICATION AND EVALUATION OF KNOWLEDGE PRODUCTION [J].
Baskerville, Richard L. ;
Kaul, Mala ;
Storey, Veda C. .
MIS QUARTERLY, 2015, 39 (03) :541-+
[7]   Management Education for Practicing Managers: Combining Academic Rigor With Personal Change and Organizational Action [J].
Berggren, Christian ;
Soderlund, Jonas .
JOURNAL OF MANAGEMENT EDUCATION, 2011, 35 (03) :377-405
[8]  
Bondi A. B., 2000, Proceedings Second International Workshop on Software and Performance. WOSP2000, P195, DOI 10.1145/350391.350432
[9]   What is societal impact of research and how can it be assessed? a literature survey [J].
Bornmann, Lutz .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2013, 64 (02) :217-233
[10]   Utilizing and Adapting the Delphi Method for Use in Qualitative Research [J].
Brady, Shane R. .
INTERNATIONAL JOURNAL OF QUALITATIVE METHODS, 2015, 14