scholarly journals Does Gender Matter in Grant Peer Review?

2012 ◽  
Vol 220 (2) ◽  
pp. 121-129 ◽  
Author(s):  
Rüdiger Mutz ◽  
Lutz Bornmann ◽  
Hans-Dieter Daniel

One of the most frequently voiced criticisms of the peer review process is gender bias. In this study we evaluated the grant peer review process (external reviewers’ ratings, and board of trustees’ final decision: approval or no approval for funding) at the Austrian Science Fund with respect to gender. The data consisted of 8,496 research proposals (census) across all disciplines from 1999 to 2009, which were rated on a scale from 1 to 100 (poor to excellent) by 18,357 external reviewers in 23,977 reviews. In line with the current state of research, we found that the final decision was not associated with applicant’s gender or with any correspondence between gender of applicants and reviewers. However, the decisions on the grant applications showed a robust female reviewer salience effect. The approval probability decreases (up to 10%), when there is parity or a majority of women in the group of reviewers. Our results confirm an overall gender null hypothesis for the peer review process of men’s and women’s grant applications in contrast to claims that women’s grants are systematically downrated.

F1000Research ◽  
2016 ◽  
Vol 5 ◽  
pp. 683 ◽  
Author(s):  
Marco Giordan ◽  
Attila Csikasz-Nagy ◽  
Andrew M. Collings ◽  
Federico Vaggi

BackgroundPublishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications.MethodsHere we examine an element of the editorial process ateLife, in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions toeLifesince June 2012, of which 2,750 were sent for peer review, using R and Python to perform the statistical analysis.ResultsThe Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and 5 days faster for papers that were rejected after peer review (n=1,099). There was no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates for published articles where the Reviewing Editor served as one of the peer reviewers.ConclusionsAn important aspect ofeLife’s peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.


F1000Research ◽  
2016 ◽  
Vol 5 ◽  
pp. 683 ◽  
Author(s):  
Marco Giordan ◽  
Attila Csikasz-Nagy ◽  
Andrew M. Collings ◽  
Federico Vaggi

BackgroundPublishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications.MethodsHere we examine an element of the editorial process ateLife, in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions toeLifesince June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.  ResultsThe Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates.ConclusionsAn important aspect ofeLife’s peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.


2018 ◽  
Vol 115 (12) ◽  
pp. 2952-2957 ◽  
Author(s):  
Elizabeth L. Pier ◽  
Markus Brauer ◽  
Amarette Filut ◽  
Anna Kaatz ◽  
Joshua Raclaw ◽  
...  

Obtaining grant funding from the National Institutes of Health (NIH) is increasingly competitive, as funding success rates have declined over the past decade. To allocate relatively scarce funds, scientific peer reviewers must differentiate the very best applications from comparatively weaker ones. Despite the importance of this determination, little research has explored how reviewers assign ratings to the applications they review and whether there is consistency in the reviewers’ evaluation of the same application. Replicating all aspects of the NIH peer-review process, we examined 43 individual reviewers’ ratings and written critiques of the same group of 25 NIH grant applications. Results showed no agreement among reviewers regarding the quality of the applications in either their qualitative or quantitative evaluations. Although all reviewers received the same instructions on how to rate applications and format their written critiques, we also found no agreement in how reviewers “translated” a given number of strengths and weaknesses into a numeric rating. It appeared that the outcome of the grant review depended more on the reviewer to whom the grant was assigned than the research proposed in the grant. This research replicates the NIH peer-review process to examine in detail the qualitative and quantitative judgments of different reviewers examining the same application, and our results have broad relevance for scientific grant peer review.


Author(s):  
Vishnu Kumar Gupta

<p>This review of related literature on the theme of peer review process in scholarly communication explains the status of research on periodicals, grant peer review and fellowships. The paper highlights the quality related issues of the scholarly communication and peer review process. Peer reviewers are invited to grant applications or assess fellowship or review manuscript in a peer review process undertake the responsibility for confirming top-level quality and standards in their concerned subject fields. <em></em></p>


2017 ◽  
Author(s):  
Jadranka Stojanovski ◽  
Ivana Hebrang Grgić

Most of the journals in Croatia adopted the open access (OA) model and their content is freely accessible and available for reuse without restrictions except that attribution be given to the author(s) and journal. There are 444 Croatian scholarly, professional, popular and trade OA journals available in the national repository of OA journals Hrcak, and 217 of them use peer review process as the primary quality assurance system. The goal of our study was to investigate the peer review process used by the Croatian OA journals and the editors’ attitude towards open peer review.An online survey was sent to the Hrcak journal editors with 39 questions grouped in: journal general information, a number of submitted/rejected/accepted manuscripts and timeliness of publishing, peer review process characteristics, instructions for peer reviewers and open peer review. Responses were obtained from 152 editors (141 complete and 11 partial). All journals employ peer review process except one. The data were collected from February to July 2017.The majority of journals come from the humanities (n=50, 33%) and social sciences (n=37, 24%). Less represented are journals from the field of biomedicine (n=22, 14%), technical sciences (n=16, 11%), natural sciences (n=12, 8%), biotechnical sciences (n=10, 7%) and interdisciplinary journals (n=3, 2%). Average journal submission is 54 manuscripts per year, but there are big differences among journals: maximum submission is 550 manuscripts, and minimum just five. In average journal publishes 23 papers after the reviewers’ and editors’ acceptance. In average it takes 16 days for sending the manuscript to the reviewer, 49 days for all the reviewers to send the journal a detailed report on the manuscript, 14 days to the editors’ decision, and another 60 days for the paper to be published.External peer review process where reviewers are not members of the editorial board or employees of the journal’s parent institution was used by 86 journals (60%). Other journals use external peer review process where reviewers are not members of the editorial board but could be employees of the journal’s parent institution (n=40, 28%), and editorial peer review. Remaining 10% journals combine previous three types of the peer review. Only 20% journals use exclusively reviewers from abroad, 44% are combining international and national reviewers, and 36% journals use only reviewers from Croatia.The majority of journals provide two reviews for each manuscript, and the process is double blind. Detailed instructions for peer reviewers are provided by less than half of the journals (n=57, 40%), but ethical issues like plagiarism, conflict of interest, confidentiality etc., are neglected. Usually, a reviewer is not informed of the final decision upon the manuscript, and reviews are not shared among reviewers.Somehow surprising was the opinion of the majority of the editors that reviewers must get credit for their efforts (n=121, 85%). On the other hand, editors are not familiar with the concept of open peer review, which can be easily used for that purpose. Some editors believe that open peer review is related to the identity disclosure: both authors’ and reviewers’ (n=35, 25%), reviewers’ (n=27, 19%), and authors’ identity (n=14, 10%). For many editors open peer review implies publicly available reviews (n=65, 36%) and authors’ responses (n=46, 33%). Open peer review is an unknown concept for some editors (n=32, 23%).In spite of all criticism traditional peer review is predominant in Croatian OA journals. Our findings show that traditional peer review is still the preferred review mechanism for the majority of journals in the study.


2021 ◽  
pp. 1-7
Author(s):  
Thomas König ◽  
Guido Ropers

ABSTRACT A fair peer-review process is essential for the integrity of a discipline’s scholarly standards. However, underrepresentation of scholarly groups casts doubt on fairness, which currently is raising concerns about a gender bias in the peer-review process of premier scholarly journals such as the American Political Science Review (APSR). This study examines gender differences in APSR reviewing during the period 2007–2020. Our explorative analysis suggests that male reviewers privilege male authors and female reviewers privilege female authors, whereas manuscripts reviewed by both male and female reviewers indicate less gender bias. Using within-manuscript variation to address confounding effects, we then show that manuscripts reviewed by both male and female reviewers receive a more positive evaluation by female reviewers in terms of recommendation and sentiment, but they experience a marginally longer duration. Because these effects are not specific for type of authorship, we recommend that invitations to review should reflect mixed compositions of peers, which also may avoid overburdening an underrepresented group with review workload.


Sign in / Sign up

Export Citation Format

Share Document