Alternatives to peer review: novel approaches for research evaluation

被引:36
作者
Birukou, Aliaksandr [1 ,2 ]
Wakeling, Joseph Rushton [1 ]
Bartolini, Claudio [3 ]
Casati, Fabio [2 ]
Marchese, Maurizio [2 ]
Mirylenka, Katsiaryna [2 ]
Osman, Nardine [4 ]
Ragone, Azzurra [2 ,5 ]
Sierra, Carles [4 ]
Wassef, Aalam [6 ]
机构
[1] European Alliance Innovat, Ghent, Belgium
[2] Univ Trento, Dept Informat Engn & Comp Sci, Trento, Italy
[3] HP Labs, Serv Automat & Integrat Lab, Palo Alto, CA USA
[4] Artificial Intelligence Res Inst IIIA CSIC, Barcelona, Catalonia, Spain
[5] Exprivia SpA, Molfetta, Italy
[6] Peerevaluat Org, Paris, France
关键词
research evaluation; peer review; metrics; bidding; opinions; LiquidPub; UCount; MASKING AUTHOR IDENTITY; PREDICTIVE-VALIDITY; QUALITY; PUBLICATION; SELECTION; SCIENCE; MANUSCRIPTS; ACCEPTANCE; EVOLUTION; FAIRNESS;
D O I
10.3389/fncom.2011.00056
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
In this paper we review several novel approaches for research evaluation. We start with a brief overview of the peer review, its controversies, and metrics for assessing efficiency and overall quality of the peer review. We then discuss five approaches, including reputation-based ones, that come out of the research carried out by the LiquidPub project and research groups collaborated with LiquidPub. Those approaches are alternative or complementary to traditional peer review. We discuss pros and cons of the proposed approaches and conclude with a vision for the future of the research evaluation, arguing that no single system can suit all stakeholders in various communities.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Changing the Peer Review or Changing the Peers - Recent Development in Assessment of Large Research Collaborations
    Hansson, Finn
    Monsted, Mette
    HIGHER EDUCATION POLICY, 2012, 25 (03) : 361 - 379
  • [32] What works for peer review and decision-making in research funding: a realist synthesis
    Recio-Saucedo, Alejandra
    Crane, Ksenia
    Meadmore, Katie
    Fackrell, Kathryn
    Church, Hazel
    Fraser, Simon
    Blatch-Jones, Amanda
    RESEARCH INTEGRITY AND PEER REVIEW, 2022, 7 (01)
  • [33] Changing research on research evaluation: A critical literature review to revisit the agenda
    Thomas, Duncan A.
    Nedeva, Maria
    Tirado, Mayra M.
    Jacob, Merle
    RESEARCH EVALUATION, 2020, 29 (03) : 275 - 288
  • [34] An evaluation of the process of peer review
    Riding, James B. B.
    PALYNOLOGY, 2023, 47 (01)
  • [35] PEER REVIEW SOFTWARE EVALUATION
    Petrov, M.
    Damyanov, D.
    Aleksieva-Petrova, A.
    EDULEARN19: 11TH INTERNATIONAL CONFERENCE ON EDUCATION AND NEW LEARNING TECHNOLOGIES, 2019, : 5831 - 5840
  • [36] Evaluating the Impact of Peer Review on the Completeness of Reporting in Imaging Diagnostic Test Accuracy Research
    Kazi, Sakib
    Frank, Robert A.
    Salameh, Jean-Paul
    Fabiano, Nicholas
    Absi, Marissa
    Pozdnyakov, Alex
    Islam, Nayaar
    Korevaar, Daniel A.
    Cohen, Jeremie F.
    Bossuyt, Patrick M.
    Leeflang, Mariska M. G.
    Cobey, Kelly D.
    Moher, David
    Schweitzer, Mark
    Menu, Yves
    Patlas, Michael
    McInnes, Matthew D. F.
    JOURNAL OF MAGNETIC RESONANCE IMAGING, 2022, 56 (03) : 680 - 690
  • [37] The Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review
    Morey, Richard D.
    Chambers, Christopher D.
    Etchells, Peter J.
    Harris, Christine R.
    Hoekstra, Rink
    Lakens, Daniel
    Lewandowsky, Stephan
    Morey, Candice Coker
    Newman, Daniel P.
    Schoenbrodt, Felix D.
    Vanpaemel, Wolf
    Wagenmakers, Eric-Jan
    Zwaan, Rolf A.
    ROYAL SOCIETY OPEN SCIENCE, 2016, 3 (01):
  • [38] “The Hardest Task”—Peer Review and the Evaluation of Technological Activities
    Federico Vasen
    Miguel Sierra Pereiro
    Minerva, 2022, 60 : 375 - 395
  • [39] The role of editorial peer review in the evaluation of vaccine safety
    Jefferson, T
    VACCINE, 2004, 22 (15-16) : 2073 - 2075
  • [40] The peer review process: an integrative review of the literature
    Jenal, Sabine
    Vituri, Dagmar Willamowius
    Ezaias, Gabriela Machado
    da Silva, Luiz Almeida
    Larcher Caliri, Maria Helena
    ACTA PAULISTA DE ENFERMAGEM, 2012, 25 (05) : 802 - 808