scholarly journals Peer Grading the Peer Reviews: A Dual-Role Approach for Lightening the Scholarly Paper Review Process

Author(s):  
Ines Arous ◽  
Jie Yang ◽  
Mourad Khayati ◽  
Philippe Cudre-Mauroux
2021 ◽  
Vol 1207 (1) ◽  
pp. 011002

All papers published in this volume of IOP Conference Series: Materials Science and Engineering have been peer reviewed through processes administered by the Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing. · Type of peer review: Single-blind · Conference submission management system: SoftConf.com (https://www.softconf.com/l/phm2021) · Number of submissions received: 203 · Number of submissions sent for review: 121 · Number of submissions accepted: 25 · Acceptance Rate (Number of Submissions Accepted/Number of Submissions Received X 100): 12.3% · Average number of reviews per paper: 2 · Total number of reviewers involved: 46 · Any additional info on review process: Papers out of the scopes of the conference had been rejected in an initial paper screening process. Papers passing the initial screening process had been further evaluated by a group of experts in the field to make sure they meet the necessary standards for acceptance and publication. Each paper underwent formal paper review by at least two reviewers in terms of appropriateness, clarity, originality/Innovativeness, and Overall Recommendation. We used professional conference paper management system “SOFTCONF” in coordinating the paper review process and communicating with the authors. A paper was accepted for presentation and publication only if the comments from both reviewers are positive. The reviewers’ comments had been provided to the authors so that they could follow the suggestions from the reviewers to further improve their papers. The authors were required to highlight the revisions in red in the final manuscript so that the Paper Review Committee could check to ensure the reviewers’ comments were accommodated in the revised manuscript. · Contact person for queries: Jie (Peter) Liu, Professor, Carleton University; Email: [email protected]


2003 ◽  
Vol 9 (2) ◽  
pp. 199
Author(s):  
Myung Ja Koh ◽  
Soon Duck Kim ◽  
Young Sung Lee ◽  
Byung Chul Chun

2016 ◽  
pp. ucw066
Author(s):  
Rajesh Bagchi ◽  
Lauren Block ◽  
Rebecca W. Hamilton ◽  
Julie L. Ozanne

2021 ◽  
Vol 2065 (1) ◽  
pp. 011002

All papers published in this volume of Journal of Physics: Conference Series have been peer reviewed through processes administered by the Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing. • Type of peer review: Double-blind • Conference submission management system: Easychair Submission System • Number of submissions received: 38 • Number of submissions sent for review: 38 • Number of submissions accepted: 23 • Acceptance Rate (Number of Submissions Accepted / Number of Submissions Received X 100): 57% • Average number of reviews per paper: 2 • Total number of reviewers involved: 17 • Any additional info on review process: All received submissions were subjected to double-blind peer reviews, who are expert or have been experiencing in the related field for years. The accepted papers must be revised according to the referees’ comments and suggestions, before inclusion in the conference proceedings. Manuscripts submitted should be original & unpublished and written in accordance with the standard IOP paper template. • Contact person for queries: Ms. Ariel Xie ([email protected])


2017 ◽  
Vol 1 (4) ◽  
pp. 60-80 ◽  
Author(s):  
Peiling Wang ◽  
Sukjin You ◽  
Rath Manasa ◽  
Dietmar Wolfram

AbstractPurposeTo understand how authors and reviewers are accepting and embracing Open Peer Review (OPR), one of the newest innovations in the Open Science movement.Design/methodology/approachThis research collected and analyzed data from the Open Access journal PeerJ over its first three years (2013–2016). Web data were scraped, cleaned, and structured using several Web tools and programs. The structured data were imported into a relational database. Data analyses were conducted using analytical tools as well as programs developed by the researchers.FindingsPeerJ, which supports optional OPR, has a broad international representation of authors and referees. Approximately 73.89% of articles provide full review histories. Of the articles with published review histories, 17.61% had identities of all reviewers and 52.57% had at least one signed reviewer. In total, 43.23% of all reviews were signed. The observed proportions of signed reviews have been relatively stable over the period since the Journal’s inception.Research limitationsThis research is constrained by the availability of the peer review history data. Some peer reviews were not available when the authors opted out of publishing their review histories. The anonymity of reviewers made it impossible to give an accurate count of reviewers who contributed to the review process.Practical implicationsThese findings shed light on the current characteristics of OPR. Given the policy that authors are encouraged to make their articles’ review history public and referees are encouraged to sign their review reports, the three years of PeerJ review data demonstrate that there is still some reluctance by authors to make their reviews public and by reviewers to identify themselves.Originality/valueThis is the first study to closely examine PeerJ as an example of an OPR model journal. As Open Science moves further towards open research, OPR is a final and critical component. Research in this area must identify the best policies and paths towards a transparent and open peer review process for scientific communication.


Author(s):  
V.  N. Gureyev ◽  
N.  A. Mazov

The paper summarizes experience of the authors as peer-reviewers of more than 100 manuscripts in twelve Russian and foreign academic journals on Library and Information Science in the last seven years. Prepared peer-reviews were used for making a list of the most usual critical and special comments for each manuscript that were subsequently structured for the conducted analyzes. Typical issues accompanying the peer-review process are shown. Significant differences between the results of peer-review in Russian and foreign journals are detected: although the initial quality of newly submitted manuscripts is approximately equal, the final published versions in foreign journals addressed all critical and the majority of minor reviewers’ comments, while in Russian journals more than one third of final versions were published with critical gaps. We conclude about low interest in high quality peer reviews among both authors and editors-in-chief in Russian journals. Despite the limitations of the samples, the obtained findings can be useful when evaluating the current peer-review system in Russian academic journals on Library and Information Science.


10.28945/2632 ◽  
2003 ◽  
Author(s):  
Guttorm Sindre ◽  
Daniel Moody ◽  
Terje Brasethvik ◽  
Arne Solvberg

This paper reports on the 2002 experiences with students’ peer-review of modeling exercises in a third year Information Systems course. While the peer-reviews did yield some positive and promising results, there were also some problems, and the goals set when introducing peer reviews were not fully achieved. Based on an analysis of student performance and perceptions, main causes for the problems were found to be lacking student motivation combined with unclear demands from teaching staff. For the 2003 offering of the course, the peer review process has been changed to remedy these problems, and this seems to have improved the learning experience for the students.


Author(s):  
Björn Hammarfelt ◽  
Isak Hammar ◽  
Helena Francke

Although established forms of peer review are often criticized for being slow, secretive, and even unfair, they are repeatedly mentioned by academics as the most important indicator of quality in scholarly publishing. In many countries, the peer review of books is a less codified practice than that of journal articles or conference papers, and the processes and actors involved are far from uniform. In Sweden, the review process of books has seldom been formalized. However, more formal peer review of books has been identified as a response to the increasing importance placed on streamlined peer-reviewed publishing of journal articles in English, which has been described as a direct challenge to more pluralistic publication patterns found particularly in the humanities. In this study, we focus on a novel approach to book review, Kriterium, where an independent portal maintained by academic institutions oversees the reviewing of academic books. The portal administers peer reviews, providing a mark of quality through a process which involves reviewers, an academic coordinator, and an editorial board. The paper studies how this process functions in practice by exploring materials concerning 24 scholarly books reviewed within Kriterium. Our analysis specifically targets tensions identified in the process of reviewing books with a focus on three main themes, namely the intended audience, the edited volume, and the novel role of the academic coordinator. Moreover, we find that the two main aims of the portal–quality enhancement (making research better) and certification (displaying that research is of high quality)–are recurrent in deliberations made in the peer review process. Consequently, we argue that reviewing procedures and criteria of quality are negotiated within a broader discussion where more traditional forms of publishing are challenged by new standards and evaluation practices.


1992 ◽  
Vol 47 (12) ◽  
pp. 1679-1681 ◽  
Author(s):  
Daniel Houlihan ◽  
Lisa Hofschulte ◽  
Daniel Sachau ◽  
Christi Patten

Sign in / Sign up

Export Citation Format

Share Document