scholarly journals Ensuring Quality and Status: Peer Review Practices in Kriterium, A Portal for Quality-Marked Monographs and Edited Volumes in Swedish SSH

Author(s):  
Björn Hammarfelt ◽  
Isak Hammar ◽  
Helena Francke

Although established forms of peer review are often criticized for being slow, secretive, and even unfair, they are repeatedly mentioned by academics as the most important indicator of quality in scholarly publishing. In many countries, the peer review of books is a less codified practice than that of journal articles or conference papers, and the processes and actors involved are far from uniform. In Sweden, the review process of books has seldom been formalized. However, more formal peer review of books has been identified as a response to the increasing importance placed on streamlined peer-reviewed publishing of journal articles in English, which has been described as a direct challenge to more pluralistic publication patterns found particularly in the humanities. In this study, we focus on a novel approach to book review, Kriterium, where an independent portal maintained by academic institutions oversees the reviewing of academic books. The portal administers peer reviews, providing a mark of quality through a process which involves reviewers, an academic coordinator, and an editorial board. The paper studies how this process functions in practice by exploring materials concerning 24 scholarly books reviewed within Kriterium. Our analysis specifically targets tensions identified in the process of reviewing books with a focus on three main themes, namely the intended audience, the edited volume, and the novel role of the academic coordinator. Moreover, we find that the two main aims of the portal–quality enhancement (making research better) and certification (displaying that research is of high quality)–are recurrent in deliberations made in the peer review process. Consequently, we argue that reviewing procedures and criteria of quality are negotiated within a broader discussion where more traditional forms of publishing are challenged by new standards and evaluation practices.

2016 ◽  
Vol 26 (3) ◽  
pp. 273-274
Author(s):  
Kristen A. Marrone ◽  
Leisha A. Emens ◽  
Nilofer S. Azad ◽  
Stuart A. Grossman

2021 ◽  
Vol 11 (1) ◽  
pp. 0
Author(s):  
Prof. Dr. Ashok Kumar Jha

The RMC of the campus feels much pleasure to publish the annual multi-disciplinary peer reviewed research journal DRISTIKON as vol. 11(1). The journal and the articles published in it are clear evidence and fulfill the requirements laid down by UGC, Nepal, Tribhuvan University Service Commission, APA 7th ed. and other platforms. The journal is designed to serve as an outlet for an intellectual forum for the communication of intellectual ideas among professionals and other social scientists in relevant areas in general and with special reference to Nepal. The board welcomes all the professionals, researchers and all those interested to publish their research findings with significant contribution to society, education sector and international platform. Authors are also encouraged to submit papers which are related to current international, national or local issues. Almost all the scholarly and research articles published in the journal undergo the editorial peer review process prior to publication to fulfill the requirements of peer review process guided by UGC, Nepal and international standard. The goal of the peer review process is to ensure that the valid article is accepted, the messy article cleaned up, and the invalid article rejected. The board of editors has accepted the reviewer’s recommendations. All the articles submitted for publication are subjected to rigorous double blinded peer review to ensure its quality before it gets published.  Manuscripts submitted to this journal must not have been published or accepted for publication or submitted for publication elsewhere. The journal strictly follows guidelines of APA 7th ed. as well as strongly opposes plagiarized contents without proper citation. Following the necessary corrections and additions resulting from the review process the twenty accepted papers were included into the issue covering the specific areas of Nepali, English, Political Science, Science and Management. The cooperation extended by scholars and institutions in publishing this journal is highly appreciated. The opinions expressed in the articles are the author’s own and do not reflect the view of either the publisher or the editorial board. All manuscripts once published becomes the property of the publisher. We hope that inspiration and encouragement from the readers will continue to keep the ‘Dristikon’ alive and develop. We are also looking forward to receiving your comments and suggestions for further improvement in the future. We are grateful to the peer reviewers for their valuable comments and suggestions. The editorial board heartily thanks all the writers who have contributed research articles. We would also like to give special thanks to the campus chief Mr. Damodar Bhandari for his constant support in terms of finance and administration for the publication of this journal.


2017 ◽  
Vol 1 (4) ◽  
pp. 60-80 ◽  
Author(s):  
Peiling Wang ◽  
Sukjin You ◽  
Rath Manasa ◽  
Dietmar Wolfram

AbstractPurposeTo understand how authors and reviewers are accepting and embracing Open Peer Review (OPR), one of the newest innovations in the Open Science movement.Design/methodology/approachThis research collected and analyzed data from the Open Access journal PeerJ over its first three years (2013–2016). Web data were scraped, cleaned, and structured using several Web tools and programs. The structured data were imported into a relational database. Data analyses were conducted using analytical tools as well as programs developed by the researchers.FindingsPeerJ, which supports optional OPR, has a broad international representation of authors and referees. Approximately 73.89% of articles provide full review histories. Of the articles with published review histories, 17.61% had identities of all reviewers and 52.57% had at least one signed reviewer. In total, 43.23% of all reviews were signed. The observed proportions of signed reviews have been relatively stable over the period since the Journal’s inception.Research limitationsThis research is constrained by the availability of the peer review history data. Some peer reviews were not available when the authors opted out of publishing their review histories. The anonymity of reviewers made it impossible to give an accurate count of reviewers who contributed to the review process.Practical implicationsThese findings shed light on the current characteristics of OPR. Given the policy that authors are encouraged to make their articles’ review history public and referees are encouraged to sign their review reports, the three years of PeerJ review data demonstrate that there is still some reluctance by authors to make their reviews public and by reviewers to identify themselves.Originality/valueThis is the first study to closely examine PeerJ as an example of an OPR model journal. As Open Science moves further towards open research, OPR is a final and critical component. Research in this area must identify the best policies and paths towards a transparent and open peer review process for scientific communication.


Author(s):  
V.  N. Gureyev ◽  
N.  A. Mazov

The paper summarizes experience of the authors as peer-reviewers of more than 100 manuscripts in twelve Russian and foreign academic journals on Library and Information Science in the last seven years. Prepared peer-reviews were used for making a list of the most usual critical and special comments for each manuscript that were subsequently structured for the conducted analyzes. Typical issues accompanying the peer-review process are shown. Significant differences between the results of peer-review in Russian and foreign journals are detected: although the initial quality of newly submitted manuscripts is approximately equal, the final published versions in foreign journals addressed all critical and the majority of minor reviewers’ comments, while in Russian journals more than one third of final versions were published with critical gaps. We conclude about low interest in high quality peer reviews among both authors and editors-in-chief in Russian journals. Despite the limitations of the samples, the obtained findings can be useful when evaluating the current peer-review system in Russian academic journals on Library and Information Science.


10.28945/2632 ◽  
2003 ◽  
Author(s):  
Guttorm Sindre ◽  
Daniel Moody ◽  
Terje Brasethvik ◽  
Arne Solvberg

This paper reports on the 2002 experiences with students’ peer-review of modeling exercises in a third year Information Systems course. While the peer-reviews did yield some positive and promising results, there were also some problems, and the goals set when introducing peer reviews were not fully achieved. Based on an analysis of student performance and perceptions, main causes for the problems were found to be lacking student motivation combined with unclear demands from teaching staff. For the 2003 offering of the course, the peer review process has been changed to remedy these problems, and this seems to have improved the learning experience for the students.


2021 ◽  
Vol 6 (1) ◽  
Author(s):  
Kit Sturgess

2020 will be a year to remember! One of the standout features for me has been the speed with which ‘science’ has responded to the crisis in terms of developing and disseminating new information to the community highlighting the importance of digital communication – a space that Veterinary Evidence comfortably occupies. The availability of pre peer-reviewed papers has become the norm but it has also emphasised the essential need and benefit of the peer-review process as a significant number of pre-review papers have not made it through to ‘publication’ as issues were identified during the peer-review process. As Editor-in-chief it makes me proud and thankful that Veterinary Evidence has a strong but agile peer-review process and I would like to thank all of our editors and reviewers for their continued support and their diligence in meeting demanding timelines during of these challenging times allowing Veterinary Evidence to publish more content than ever before. Without your highly valued knowledge, expertise and insights Veterinary Evidence would not be growing into the key knowledge source that it is today. The Veterinary Evidence Editorial Board Meeting was held for the first time digitally on 7 December with the largest number of editorial board members able to attend. Members from across the globe were able to take part in wide and varied discussions around the development of the journal, resulting in important strategic initiatives and some key action points to pursue. The availability of the board to attend digitally will facilitate more frequent meetings allowing the journal to be more inclusive, and responsive to the changing landscape, as well as providing a digital recording of the event available for those board members unable to attend. Key areas discussed included development of the format of PICOs and further refining the process for approving them, strategies to encourage engagement and submissions from veterinary nurses, and the development of policies to encourage diversity and inclusion within the board and contributors to the journal, as well as ways to increase the reach of the journal. Having only been Editor-in-chief since September, I have been very impressed by how active and dedicated our reviewers and board members are and how dynamic and forward-looking Veterinary Evidence is as it matures into a key contributor to veterinary literature. None of this would be possible without your support for which I am very grateful.  


2017 ◽  
Author(s):  
Jadranka Stojanovski ◽  
Ivana Hebrang Grgić

Most of the journals in Croatia adopted the open access (OA) model and their content is freely accessible and available for reuse without restrictions except that attribution be given to the author(s) and journal. There are 444 Croatian scholarly, professional, popular and trade OA journals available in the national repository of OA journals Hrcak, and 217 of them use peer review process as the primary quality assurance system. The goal of our study was to investigate the peer review process used by the Croatian OA journals and the editors’ attitude towards open peer review.An online survey was sent to the Hrcak journal editors with 39 questions grouped in: journal general information, a number of submitted/rejected/accepted manuscripts and timeliness of publishing, peer review process characteristics, instructions for peer reviewers and open peer review. Responses were obtained from 152 editors (141 complete and 11 partial). All journals employ peer review process except one. The data were collected from February to July 2017.The majority of journals come from the humanities (n=50, 33%) and social sciences (n=37, 24%). Less represented are journals from the field of biomedicine (n=22, 14%), technical sciences (n=16, 11%), natural sciences (n=12, 8%), biotechnical sciences (n=10, 7%) and interdisciplinary journals (n=3, 2%). Average journal submission is 54 manuscripts per year, but there are big differences among journals: maximum submission is 550 manuscripts, and minimum just five. In average journal publishes 23 papers after the reviewers’ and editors’ acceptance. In average it takes 16 days for sending the manuscript to the reviewer, 49 days for all the reviewers to send the journal a detailed report on the manuscript, 14 days to the editors’ decision, and another 60 days for the paper to be published.External peer review process where reviewers are not members of the editorial board or employees of the journal’s parent institution was used by 86 journals (60%). Other journals use external peer review process where reviewers are not members of the editorial board but could be employees of the journal’s parent institution (n=40, 28%), and editorial peer review. Remaining 10% journals combine previous three types of the peer review. Only 20% journals use exclusively reviewers from abroad, 44% are combining international and national reviewers, and 36% journals use only reviewers from Croatia.The majority of journals provide two reviews for each manuscript, and the process is double blind. Detailed instructions for peer reviewers are provided by less than half of the journals (n=57, 40%), but ethical issues like plagiarism, conflict of interest, confidentiality etc., are neglected. Usually, a reviewer is not informed of the final decision upon the manuscript, and reviews are not shared among reviewers.Somehow surprising was the opinion of the majority of the editors that reviewers must get credit for their efforts (n=121, 85%). On the other hand, editors are not familiar with the concept of open peer review, which can be easily used for that purpose. Some editors believe that open peer review is related to the identity disclosure: both authors’ and reviewers’ (n=35, 25%), reviewers’ (n=27, 19%), and authors’ identity (n=14, 10%). For many editors open peer review implies publicly available reviews (n=65, 36%) and authors’ responses (n=46, 33%). Open peer review is an unknown concept for some editors (n=32, 23%).In spite of all criticism traditional peer review is predominant in Croatian OA journals. Our findings show that traditional peer review is still the preferred review mechanism for the majority of journals in the study.


2021 ◽  
Vol 6 (1) ◽  
Author(s):  
Evan Mayo-Wilson ◽  
Meredith L. Phillips ◽  
Avonne E. Connor ◽  
Kelly J. Vander Ley ◽  
Kevin Naaman ◽  
...  

Abstract Background The Patient-Centered Outcomes Research Institute (PCORI) is obligated to peer review and to post publicly “Final Research Reports” of all funded projects. PCORI peer review emphasizes adherence to PCORI’s Methodology Standards and principles of ethical scientific communication. During the peer review process, reviewers and editors seek to ensure that results are presented objectively and interpreted appropriately, e.g., free of spin. Methods Two independent raters assessed PCORI peer review feedback sent to authors. We calculated the proportion of reports in which spin was identified during peer review, and the types of spin identified. We included reports submitted by April 2018 with at least one associated journal article. The same raters then assessed whether authors addressed reviewers’ comments about spin. The raters also assessed whether spin identified during PCORI peer review was present in related journal articles. Results We included 64 PCORI-funded projects. Peer reviewers or editors identified spin in 55/64 (86%) submitted research reports. Types of spin included reporting bias (46/55; 84%), inappropriate interpretation (40/55; 73%), inappropriate extrapolation of results (15/55; 27%), and inappropriate attribution of causality (5/55; 9%). Authors addressed comments about spin related to 47/55 (85%) of the reports. Of 110 associated journal articles, PCORI comments about spin were potentially applicable to 44/110 (40%) articles, of which 27/44 (61%) contained the same spin that was identified in the PCORI research report. The proportion of articles with spin was similar for articles accepted before and after PCORI peer review (63% vs 58%). Discussion Just as spin is common in journal articles and press releases, we found that most reports submitted to PCORI included spin. While most spin was mitigated during the funder’s peer review process, we found no evidence that review of PCORI reports influenced spin in journal articles. Funders could explore interventions aimed at reducing spin in published articles of studies they support.


Sign in / Sign up

Export Citation Format

Share Document