The Influence of Peer Review on the Research Assessment Exercise

This chapter focuses on the review process, the process of writing a proposal and the evaluation of science. The usual way that science is funded these days is through a proposal to a funding agency; if it satisfies peer review and there are sufficient resources available, it is then funded. Peer review is at the heart of academic life, and is used to assess research proposals, progress, publications and institutions. Peer review processes are discussed and, in light of this discussion, the art of proposal writing. The particular features of making fellowship proposals and preparing for an institutional review are described. In addition, several of the methods used for evaluating and ranking research and research institutions are reviewed, including the Research Assessment Exercise and the Research Excellence Framework.

Download Full-text

Social Policy Excellence - Peer Review or Metrics? Analyzing the 2008 Research Assessment Exercise in Social Work and Social Policy and Administration

Social Policy and Administration ◽

10.1111/j.1467-9515.2011.00824.x ◽

2011 ◽

Vol 46 (5) ◽

pp. 526-543 ◽

Cited By ~ 9

Author(s):

Stephen McKay

Keyword(s):

Social Work ◽

Social Policy ◽

Peer Review ◽

Research Assessment ◽

Research Assessment Exercise

Download Full-text

Metrics or Peer Review? Evaluating the 2001 UK Research Assessment Exercise in Political Science

Political Studies Review ◽

10.1111/j.1478-9299.2008.00167.x ◽

2009 ◽

Vol 7 (1) ◽

pp. 3-17 ◽

Cited By ~ 33

Author(s):

Linda Butler ◽

Ian McAllister

Keyword(s):

Political Science ◽

Peer Review ◽

Research Assessment ◽

Research Assessment Exercise

Download Full-text

Just an artifact? The concordance between peer review and bibliometrics in economics and statistics in the Italian research assessment exercise

Quantitative Science Studies ◽

10.1162/qss_a_00172 ◽

2021 ◽

pp. 1-18

Author(s):

Alberto Baccini ◽

Giuseppe De Nicolao

Keyword(s):

Peer Review ◽

Research Assessment ◽

Research Assessment Exercise ◽

Governmental Agency ◽

Peer Reviews ◽

Science Technology ◽

Individual Article ◽

And Mathematics ◽

The One ◽

Shed Light

Abstract During the Italian research assessment exercise (2004–2010), the governmental agency (ANVUR) in charge of its realization performed an experiment on the concordance between peer review and bibliometrics at an individual article level. The computed concordances were at most weak for science, technology, engineering and mathematics. The only exception was the moderate concordance found for the area of economics and statistics. In this paper, the disclosed raw data of the experiment are used to shed light on the anomalous results obtained for economics and statistics. In particular, the data permit to document that the protocol of the experiment adopted for economics and statistics was different from the one used in the other areas. Indeed, in economics and statistics a same group of scholars developed the bibliometric ranking of journals for evaluating articles, managed peer reviews and formed the consensus groups for deciding the final scores of articles after having received the referee’s reports. This paper shows that the highest level of concordance in economics and statistics was an artifact mainly due to the role played by consensus groups in boosting the agreement between bibliometrics and peer review. Peer Review https://publons.com/publon/10.1162/qss_a_00172

Download Full-text