Introducing and testing an advanced quantitative methodological approach for the evaluation of research centers: a case study on sustainability science

被引:2
作者
Kassab, Omar [1 ]
Mutz, Rudiger [1 ]
Daniel, Hans-Dieter [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Professorship Social Psychol & Res Higher Educ, Dept Humanities Social & Polit Sci, Andreasstr 15, CH-8050 Zurich, Switzerland
[2] Univ Zurich, Dept Psychol, Binzmuehlestr 14, CH-8050 Zurich, Switzerland
关键词
research center; bibliometrics; research performance; accelerated longitudinal design; growth curve modeling; sustainability science; RESEARCH-AND-DEVELOPMENT; UNIVERSITY-RESEARCH CENTERS; INTERRUPTED TIME-SERIES; R-SQUARED MEASURES; REGRESSION-MODELS; CURRICULUM-VITAE; TEAM SCIENCE; IMPACT; COLLABORATION; PRODUCTIVITY;
D O I
10.1093/reseval/rvz029
中图分类号
G25 [图书馆学、图书馆事业]; G35 [情报学、情报工作];
学科分类号
1205 ; 120501 ;
摘要
With the growing complexity of societal and scientific problems, research centers have emerged to facilitate the conduct of research beyond disciplinary and institutional boundaries. While they have become firmly established in the global university landscape, research centers raise some critical questions for research evaluation. Existing evaluation approaches designed to assess universities, departments, projects, or individual researchers fail to capture some of the core characteristics of research centers and their participants, including the diversity of the involved researchers, at what point in time they join and leave the research center, or the intensity of their participation. In addressing these aspects, this article introduces an advanced approach for the ex post evaluation of research centers. It builds on a quasi-experimental within-group design, bibliometric analyses, and multilevel statistics to assess average and individual causal effects of research center affiliation on participants along three dimensions of research performance. The evaluation approach is tested with archival data from a center in the field of sustainability science. Against a widely held belief, we find that participation in research centers entails no disadvantages for researchers as far as their research performance is concerned. However, individual trajectories varied strongly.
引用
收藏
页码:135 / 149
页数:15
相关论文
共 87 条
[1]  
Allison P.D., 2009, Fixed effect regression models, DOI DOI 10.4135/9781412993869
[2]  
[Anonymous], 2013, An Introduction to Latent Variable Growth Curve Modeling: Concepts, Issues, and Applications, DOI DOI 10.4324/9780203879962
[3]  
[Anonymous], 2011, MULTILEVEL STAT MODE
[4]   Multilevel exploration of the realities of interdisciplinary research centers for the management of knowledge integration [J].
Avila-Robinson, Alfonso ;
Sengoku, Shintaro .
TECHNOVATION, 2017, 62-63 :22-41
[5]   Impacts of an interdisciplinary research center on participant publication and collaboration patterns: A case study of the National Institute for Mathematical and Biological Synthesis [J].
Bishop, Pamela R. ;
Huck, Schuyler W. ;
Ownley, Bonnie H. ;
Richards, Jennifer K. ;
Skolits, Gary J. .
RESEARCH EVALUATION, 2014, 23 (04) :327-340
[6]   Transition Processes: A Review and Synthesis Integrating Methods and Theory [J].
Bliese, Paul D. ;
Adler, Amy B. ;
Flynn, Patrick J. .
ANNUAL REVIEW OF ORGANIZATIONAL PSYCHOLOGY AND ORGANIZATIONAL BEHAVIOR, VOL 4, 2017, 4 :263-286
[7]   Role strain in university research centers [J].
Boardman, Craig ;
Bozeman, Barry .
JOURNAL OF HIGHER EDUCATION, 2007, 78 (04) :430-463
[8]   University research centers and the composition of research collaborations [J].
Boardman, P. Craig ;
Corley, Elizabeth A. .
RESEARCH POLICY, 2008, 37 (05) :900-913
[9]   Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references [J].
Bornmann, Lutz ;
Mutz, Ruediger .
JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 2015, 66 (11) :2215-2222
[10]   What is societal impact of research and how can it be assessed? a literature survey [J].
Bornmann, Lutz .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2013, 64 (02) :217-233