What is a high-quality research environment? Evidence from the UK's research excellence framework

被引:0
|
作者
Inglis, Matthew [1 ]
Gadd, Elizabeth [2 ]
Stokoe, Elizabeth [3 ]
机构
[1] Loughborough Univ, Ctr Math Cognit, Loughborough LE11 3TU, England
[2] Loughborough Univ, Res & Innovat Off, Loughborough LE11 3TU, England
[3] London Sch Econ & Polit Sci, Dept Psychol & Behav Sci, London WC2A 2AE, England
基金
英国经济与社会研究理事会;
关键词
research evaluation; research policy; research excellence framework; universities; research culture; research environment; DECISION; IMPACT; JUDGMENT;
D O I
10.1093/reseval/rvae010
中图分类号
G25 [图书馆学、图书馆事业]; G35 [情报学、情报工作];
学科分类号
1205 ; 120501 ;
摘要
As part of the UK university sector's performance-related research funding model, the 'REF' (Research Excellence Framework), each discipline-derived 'Unit of Assessment' must submit a statement to provide information about their environment, culture, and strategy for enabling research and impact. Our aim in this paper is to identify the topics on which these statements focus, and how topic variation predicts funding-relevant research environment quality profiles. Using latent Dirichlet allocation topic modelling, we analysed all 1888 disciplinary 'unit-level' environment statements from REF2021. Our model identified eight topics which collectively predicted a surprisingly large proportion-58.9%-of the variance in units' environment scores, indicating that the way in which statements were written contributed substantially to the perceived quality of a unit's research environment. Assessing research environments will increase in importance in the next REF exercise and the insights found through our analysis may support reflection and discussion about what it means to have a high-quality research environment.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Determinants of quality of research environment: An assessment of the environment submissions in the UK's Research Excellence Framework in 2014
    Pinar, Mehmet
    Unlu, Emre
    RESEARCH EVALUATION, 2020, 29 (03) : 231 - 244
  • [2] How unpredictable is research impact? Evidence from the UK's Research Excellence Framework
    Yaqub, Ohid
    Malkov, Dmitry
    Siepel, Josh
    RESEARCH EVALUATION, 2023, 32 (02) : 273 - 285
  • [3] 'Environment' Submissions in the UK's Research Excellence Framework 2014
    Thorpe, Andy
    Craig, Russell
    Tourish, Dennis
    Hadikin, Glenn
    Batistic, Sasa
    BRITISH JOURNAL OF MANAGEMENT, 2018, 29 (03) : 571 - 587
  • [4] Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021
    Thelwall, Mike
    Kousha, Kayvan
    Abdoli, Mahshid
    Stuart, Emma
    Makita, Meiko
    Wilson, Paul
    Levitt, Jonathan
    JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 2023, 74 (05) : 582 - 593
  • [5] Perceptions of the UK's Research Excellence Framework 2014: a media analysis
    Murphy, Tony
    Sage, Daniel
    JOURNAL OF HIGHER EDUCATION POLICY AND MANAGEMENT, 2014, 36 (06) : 603 - 615
  • [6] Perceptions of the UK's Research Excellence Framework 2014 A small survey of academics
    Murphy, Tony
    Sage, Daniel
    AUSTRALIAN UNIVERSITIES REVIEW, 2015, 57 (02): : 31 - 36
  • [7] The UK Research Excellence Framework and the Matthew effect: Insights from machine learning
    Balbuena, Lloyd D.
    PLOS ONE, 2018, 13 (11):
  • [8] Finding "good enough" metrics for the UK's research excellence framework
    Stuart, David
    ONLINE INFORMATION REVIEW, 2015, 39 (02) : 265 - 269
  • [9] 'Impact' in the proposals for the UK's Research Excellence Framework: Shifting the boundaries of academic autonomy
    Smith, Simon
    Ward, Vicky
    House, Allan
    RESEARCH POLICY, 2011, 40 (10) : 1369 - 1379
  • [10] Predicting article quality scores with machine learning: The UK Research Excellence Framework
    Thelwall, Mike
    Kousha, Kayvan
    Wilson, Paul
    Makita, Meiko
    Abdoli, Mahshid
    Stuart, Emma
    Levitt, Jonathan
    Knoth, Petr
    Cancellieri, Matteo
    QUANTITATIVE SCIENCE STUDIES, 2023, 4 (02): : 547 - 573