scholarly journals Peering into peer review: Good quality reviews of research articles require neither writing too much nor taking too long

2018 ◽  
Vol 30 (2) ◽  
pp. 209-218 ◽  
Author(s):  
Paula CABEZAS Del FIERRO ◽  
Omar SABAJ MERUANE ◽  
Germán VARAS ESPINOZA ◽  
Valeria GONZÁLEZ HERRERA

Abstract The value of scientific knowledge is highly dependent on the quality of the process used to produce it, namely, the quality of the peer-review process. This process is a pivotal part of science as it works both to legitimize and improve the work of the scientific community. In this context, the present study investigated the relationship between review time, length, and feedback quality of review reports in the peer-review process of research articles. For this purpose, the review time of 313 referee reports from three Chilean international journals were recorded. Feedback quality was determined estimating the rate of direct requests by the total number of comments in each report. Number of words was used to describe the average length in the sample. Results showed that average time and length have little variation across review reports, irrespective of their quality. Low quality reports tended to take longer to reach the editor, so neither time nor length were related to feedback quality. This suggests that referees mostly describe, criticize, or praise the content of the article instead of making useful and direct comments to help authors improve their manuscripts.

2020 ◽  
Author(s):  
Erin Peebles ◽  
Marissa Scandlyn ◽  
Blair R. Hesp

AbstractIntroductionPeer review is a volunteer process for improving the quality of publications by providing objective feedback to authors, but also presents an opportunity for reviewers to seek personal reward by requesting self-citations. Open peer review may reduce the prevalence of self-citation requests and encourage author rebuttal over accession. This study aimed to investigate the prevalence of self-citation requests and their inclusion in manuscripts in a journal with open peer review.MethodsRequests for additional references to be included during peer review for articles published between 1 January 2017 and 31 December 2018 in BMC Medicine were evaluated. Data extracted included total number of self-citations requested, self-citations that were included in the final published manuscript and manuscripts that included at least one self-citation, and compared with corresponding data on independent citations.ResultsIn total, 932 peer review reports from 373 manuscripts were analysed. At least one additional citation was requested in 25.9% (n=241) of reports. Self-citation requests were included in 44.4% of reports requesting additional citations (11.5% of all reports). Requests for self-citation were significantly more likely than independent citations to be incorporated in the published manuscript (65.1% vs 52.1%; chi-square p=0.003). At the manuscript level, when requested, self-citations were incorporated in 76.6% of manuscripts (n=72; 19.3% of all manuscripts) compared with 68.5% of manuscripts with independent citation requests (n=102; 27.3% of manuscripts). A significant interaction was observed between the presence of self-citation requests and the likelihood of any citation request being incorporated (100% incorporation in manuscripts with self-citation requests alone versus 62.7–72.2% with any independent citation request; Fisher’s exact test p<0.0005).ConclusionsRequests for self-citations during the peer review process are common. The transparency of open peer review may have the unexpected effect of encouraging authors to incorporate self-citation requests by disclosing peer reviewer identity.


F1000Research ◽  
2018 ◽  
Vol 7 ◽  
pp. 1655 ◽  
Author(s):  
Jeffrey Beck ◽  
Kathryn Funk ◽  
Melissa Harrison ◽  
Jo McEntyre ◽  
Josie Breen ◽  
...  

Publishing peer review materials alongside research articles promises to make the peer review process more transparent as well as making it easier to recognise these contributions and give credit to peer reviewers. Traditionally, the peer review reports, editors letters and author responses are only shared between the small number of people in those roles prior to publication, but there is a growing interest in making some or all of these materials available. A small number of journals have been publishing peer review materials for some time, others have begun this practice more recently, and significantly more are now considering how they might begin. This article outlines the outcomes from a recent workshop among journals with experience in publishing peer review materials, in which the specific operation of these workflows, and the challenges, were discussed. Here, we provide a draft as to how to represent these materials in the JATS and Crossref data models to facilitate the coordination and discoverability of peer review materials, and seek feedback on these initial recommendations.


2020 ◽  
Vol 17 ◽  
pp. 15-19
Author(s):  
Bishnu Bahadur Khatri

Peer review in scholarly communication and scientific publishing, in one form or another, has always been regarded as crucial to the reputation and reliability of scientific research. In the growing interest of scholarly research and publication, this paper tries to discuss about peer review process and its different types to communicate the early career researchers and academics.This paper has used the published and unpublished documents for information collection. It reveals that peer review places the reviewer, with the author, at the heart of scientific publishing. It is the system used to assess the quality of scientific research before it is published. Therefore, it concludes that peer review is used to advancing and testing scientific knowledgeas a quality control mechanism forscientists, publishers and the public.


Author(s):  
Ann Blair Kennedy, LMT, BCTMB, DrPH

  Peer review is a mainstay of scientific publishing and, while peer reviewers and scientists report satisfaction with the process, peer review has not been without criticism. Within this editorial, the peer review process at the IJTMB is defined and explained. Further, seven steps are identified by the editors as a way to improve efficiency of the peer review and publication process. Those seven steps are: 1) Ask authors to submit possible reviewers; 2) Ask reviewers to update profiles; 3) Ask reviewers to “refer a friend”; 4) Thank reviewers regularly; 5) Ask published authors to review for the Journal; 6) Reduce the length of time to accept peer review invitation; and 7) Reduce requested time to complete peer review. We believe these small requests and changes can have a big effect on the quality of reviews and speed in which manuscripts are published. This manuscript will present instructions for completing peer review profiles. Finally, we more formally recognize and thank peer reviewers from 2018–2020.


1970 ◽  
Vol 3 ◽  
pp. 175-184
Author(s):  
Julie Walker

Increasing the visibility of a journal is the key to increasing quality. The International Network for the Availability of Scientific Publications works with journal editors in the global South to publish their journals online and to increase the efficiency of the peer review process. Editors are trained in using the Open Journals System software and in online journal management and strategy so they have the tools and knowledge needed to initiate a ‘virtuous cycle' in which visibility leads to an increase in the number and quality of submissions and in turn, increased citations and impact. In order to maximise this increase in quality, it must be supported by strong editorial office processes and management. This article describes some of the issues and strategies faced by the editors INASP works with, placing a particular emphasis on Nepal Journals Online. Key words: INASP; Open Journals System; Journals Online Projects; Nepal Journals Online; journal visibility; peer review DOI: 10.3126/dsaj.v3i0.2786 Dhaulagiri Journal of Sociology and Anthropology Vol.3 2009 175-184


BMJ Open ◽  
2020 ◽  
Vol 10 (6) ◽  
pp. e035604
Author(s):  
Cecilia Superchi ◽  
Darko Hren ◽  
David Blanco ◽  
Roser Rius ◽  
Alessandro Recchioni ◽  
...  

ObjectiveTo develop a tool to assess the quality of peer-review reports in biomedical research.MethodsWe conducted an online survey intended for biomedical editors and authors. The survey aimed to (1) determine if participants endorse the proposed definition of peer-review report quality; (2) identify the most important items to include in the final version of the tool and (3) identify any missing items. Participants rated on a 5-point scale whether an item should be included in the tool and they were also invited to comment on the importance and wording of each item. Principal component analysis was performed to examine items redundancy and a general inductive approach was used for qualitative data analysis.ResultsA total of 446 biomedical editors and authors participated in the survey. Participants were mainly male (65.9%), middle-aged (mean=50.3, SD=13) and with PhD degrees (56.4%). The majority of participants (84%) agreed on the definition of peer-review report quality we proposed. The 20 initial items included in the survey questionnaire were generally highly rated with a mean score ranging from 3.38 (SD=1.13) to 4.60 (SD=0.69) (scale 1–5). Participants suggested 13 items that were not included in the initial list of items. A steering committee composed of five members with different expertise discussed the selection of items to include in the final version of the tool. The final checklist includes 14 items encompassed in five domains (Importance of the study, Robustness of the study methods, Interpretation and discussion of the study results, Reporting and transparency of the manuscript, Characteristics of peer reviewer’s comments).ConclusionAssessment of Review reports with a Checklist Available to eDItors and Authors tool could be used regularly by editors to evaluate the reviewers’ work, and also as an outcome when evaluating interventions to improve the peer-review process.


2018 ◽  
Vol 12 (2) ◽  
pp. 151
Author(s):  
Paola Gnerre ◽  
Giorgio Vescovo ◽  
Paola Granata ◽  
Cecilia Politi ◽  
Andrea Fontanella ◽  
...  

Peer review is the process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. The peer review of scientific manuscripts is a cornerstone of modern science and medicine. Some journals have difficulty in finding appropriate reviewers who are able to complete reviews on time avoiding publication delay. We discuss some of the main issues involved during the peer review process. The reviewer has a direct and important impact on the quality of a scientific medical Journal. Editors select reviewers on the basis of their expertise. Reviewers are more likely to accept to review a manuscript when it is relevant to their area of interest. They should respond to ethical principles, excluding any conflict of interest condition. The reviewer has to be professional, constructive, tactful, empathetic and respectful. Structured approaches, quality indicators and step-by-step process check list formats could be useful in obtaining a good review.


Sign in / Sign up

Export Citation Format

Share Document