Peer Review vs Metric-based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments

被引:20
作者
Clerides, Sofronis [1 ]
Pashardes, Panos [1 ]
Polycarpou, Alexandros [1 ]
机构
[1] Univ Cyprus, Econ Res Ctr, Nicosia, Cyprus
关键词
STATISTICAL-ANALYSIS; FAVORITISM; RANKINGS; PERFORMANCE; JOURNALS; QUALITY; EUROPE;
D O I
10.1111/j.1468-0335.2009.00837.x
中图分类号
F [经济];
学科分类号
02 ;
摘要
RAE ratings have been criticized as biased in favour of universities that are old, in England, large and represented on the panel. We investigate these accusations for the 1996 and 2001 RAE ratings of economics departments using independent rankings from the academic literature as quality controls. We find RAE ratings to be largely in agreement with the profession's view of research quality as documented by independent rankings, although the latter appear to be more focused on research quality at the top end of academic achievement. Accusations of bias find no support in the data, except for panel membership in 1996.
引用
收藏
页码:565 / 583
页数:19
相关论文
共 28 条
[1]  
[Anonymous], 2003, REV RES ASSESSMENT R
[2]   INCENTIVE CONTRACTS AND PERFORMANCE-MEASUREMENT [J].
BAKER, GP .
JOURNAL OF POLITICAL ECONOMY, 1992, 100 (03) :598-614
[3]   Intermediaries as quality assessors: Tour operators in the travel industry [J].
Clerides, Sofronis ;
Nearchou, Paris ;
Pashardes, Panos .
INTERNATIONAL JOURNAL OF INDUSTRIAL ORGANIZATION, 2008, 26 (01) :372-392
[4]   WHERE ARE THE ECONOMISTS WHO PUBLISH? PUBLICATION CONCENTRATION AND RANKINGS IN EUROPE BASED ON CUMULATIVE PUBLICATIONS [J].
Combes, Pierre-Philippe ;
Linnemer, Laurent .
JOURNAL OF THE EUROPEAN ECONOMIC ASSOCIATION, 2003, 1 (06) :1250-1308
[5]  
COUPE T, 2001, STRATEGIC ANAL U MIC
[6]   REVEALED PERFORMANCES: WORLDWIDE RANKINGS OF ECONOMISTS AND ECONOMICS DEPARTMENTS, 1990-2000 [J].
Coupe, Tom .
JOURNAL OF THE EUROPEAN ECONOMIC ASSOCIATION, 2003, 1 (06) :1309-1345
[7]   General test for distortions in performance measures [J].
Courty, Pascal ;
Marschke, Gerald .
REVIEW OF ECONOMICS AND STATISTICS, 2008, 90 (03) :428-441
[8]   The judge, the model of the judge, and the model of the judged as judge: Analyses of the UK 1992 research assessment exercise data for business and management studies [J].
Doyle, JR ;
Arthurs, AJ ;
Green, RH ;
Mcaulay, L ;
Pitt, MR ;
Bottomley, PA .
OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE, 1996, 24 (01) :13-28
[9]   Rankings of US economics departments [J].
Dusansky, R ;
Vernon, CJ .
JOURNAL OF ECONOMIC PERSPECTIVES, 1998, 12 (01) :157-170
[10]  
Gambrill E., 2002, J SOCIAL WORK, V2, P169