scholarly journals Open Up: A Survey on Open and Non-anonymized Peer Reviewing

Author(s):  
Lonni Besançon ◽  
Niklas Rönnberg ◽  
Jonas Löwgren ◽  
Jonathan P. Tennant ◽  
Matthew Cooper

We present a discussion and analysis regarding the benefits and limitations of open and non-anonymized peer review based on literature results and responses to a survey on the reviewing process of alt.chi, a more or less open-review track within the CHI conference, the predominant conference in the field of human-computer interaction (HCI). This track currently is the only implementation of an open-peer-review process in the field of HCI while, with the recent increase in interest in open science practices, open review is now being considered and used in other fields. We collected 30 responses from alt.chi authors and reviewers and found that, while the benefits are quite clear and the system is generally well liked by alt.chi participants, they are reluctant to see it used in other venues. This concurs with a number of recent studies that suggest a divergence between support for a more open review process and its practical implementation. The data and scripts are available on https://osf.io/vuw7h/, and the figures and follow-up work on http://tiny.cc/OpenReviews.

Author(s):  
Lonni Besançon ◽  
Niklas Rönnberg ◽  
Jonas Löwgren ◽  
Jonathan Tennant ◽  
Matthew Cooper

We present a discussion and analysis regarding the benefits and limitations of open and non-anonymized peer review based on literature results and responses to a survey on the reviewing process of alt.chi, a more or less open-review track within the CHI conference, the predominant conference in the field of human-computer interaction (HCI). This track currently is the only implementation of an open-peer-review process in the field of HCI while, with the recent increase in interest in open science practices, open review is now being considered and used in other fields. We collected 30 responses from alt.chi authors and reviewers and found that, while the benefits are quite clear and the system is generally well liked by alt.chi participants, they are reluctant to see it used in other venues. This concurs with a number of recent studies that suggest a divergence between support for a more open review process and its practical implementation. The data and scripts are available on https://osf.io/vuw7h/, and the figures and follow-up work on http://tiny.cc/OpenReviews.


Author(s):  
Lonni Besançon ◽  
Niklas Rönnberg ◽  
Jonas Löwgren ◽  
Jonathan P. Tennant ◽  
Matthew Cooper

Abstract Background Our aim is to highlight the benefits and limitations of open and non-anonymized peer review. Our argument is based on the literature and on responses to a survey on the reviewing process of alt.chi, a more or less open review track within the so-called Computer Human Interaction (CHI) conference, the predominant conference in the field of human-computer interaction. This track currently is the only implementation of an open peer review process in the field of human-computer interaction while, with the recent increase in interest in open scientific practices, open review is now being considered and used in other fields. Methods We ran an online survey with 30 responses from alt.chi authors and reviewers, collecting quantitative data using multiple-choice questions and Likert scales. Qualitative data were collected using open questions. Results Our main quantitative result is that respondents are more positive to open and non-anonymous reviewing for alt.chi than for other parts of the CHI conference. The qualitative data specifically highlight the benefits of open and transparent academic discussions. The data and scripts are available on https://osf.io/vuw7h/, and the figures and follow-up work on http://tiny.cc/OpenReviews. Conclusion While the benefits are quite clear and the system is generally well-liked by alt.chi participants, they remain reluctant to see it used in other venues. This concurs with a number of recent studies that suggest a divergence between support for a more open review process and its practical implementation.


2020 ◽  
Author(s):  
Bård Smedsrød ◽  
Erik Lieungh

In this episode professor at UIT - The Arctic University of Norway, Bård Smedsrød, gives us an insight into peer review. How does the system work today, and what's problematic with it? Smedsrød also offers some solutions and encourages Universities to be much more involved in the peer review process. The host of this episode is Erik Lieungh. You can also read Bård's latest paper on peer reviewing: Peer reviewing: a private affair between the individual researcher and the publishing houses, or responsibility of the university? This episode was first published 2 November 2018.


Author(s):  
Eleanor Loughlin ◽  
Alicja Syska ◽  
Gita Sedghi ◽  
Christina Howell-Richardson

Editors and publishers of scholarly journals rarely agree on what makes for a good publication; they do, however, agree on the need for a robust peer review process as a crucial means to judge the merits of potential publications. While fraught with issues and inefficiencies, a critical and supportive peer review is not only what editors rely on when assessing scholarship presented for publication but also what authors hope for in order to improve their work. Understanding how peer review may best serve all parties involved: authors, editors, and reviewers, is thus at the heart of this article. The analysis offered here is based on a session the Journal for Learning Development in Higher Education editors gave at the 2020 LD@3 seminar series, entitled ‘The Art of Reviewing’. It explores the different aspects of the peer review process while formulating recommendations regarding best practices and outlining JLDHE initiatives for supporting reviewers’ vital work.


2017 ◽  
Vol 1 (4) ◽  
pp. 60-80 ◽  
Author(s):  
Peiling Wang ◽  
Sukjin You ◽  
Rath Manasa ◽  
Dietmar Wolfram

AbstractPurposeTo understand how authors and reviewers are accepting and embracing Open Peer Review (OPR), one of the newest innovations in the Open Science movement.Design/methodology/approachThis research collected and analyzed data from the Open Access journal PeerJ over its first three years (2013–2016). Web data were scraped, cleaned, and structured using several Web tools and programs. The structured data were imported into a relational database. Data analyses were conducted using analytical tools as well as programs developed by the researchers.FindingsPeerJ, which supports optional OPR, has a broad international representation of authors and referees. Approximately 73.89% of articles provide full review histories. Of the articles with published review histories, 17.61% had identities of all reviewers and 52.57% had at least one signed reviewer. In total, 43.23% of all reviews were signed. The observed proportions of signed reviews have been relatively stable over the period since the Journal’s inception.Research limitationsThis research is constrained by the availability of the peer review history data. Some peer reviews were not available when the authors opted out of publishing their review histories. The anonymity of reviewers made it impossible to give an accurate count of reviewers who contributed to the review process.Practical implicationsThese findings shed light on the current characteristics of OPR. Given the policy that authors are encouraged to make their articles’ review history public and referees are encouraged to sign their review reports, the three years of PeerJ review data demonstrate that there is still some reluctance by authors to make their reviews public and by reviewers to identify themselves.Originality/valueThis is the first study to closely examine PeerJ as an example of an OPR model journal. As Open Science moves further towards open research, OPR is a final and critical component. Research in this area must identify the best policies and paths towards a transparent and open peer review process for scientific communication.


2022 ◽  
Vol 8 ◽  
Author(s):  
Anne Zimmerman

Dear readers, advisors, authors, editors, and peer reviewers, As we welcome the new year, we look forward to the opportunity to publish new arguments and pose challenging questions about ethical dilemmas in the realm of medicine, science, and technology. Reflecting on the peer review process at this juncture seems especially important considering the bioethics climate and the challenges in doing justice to ethical dilemmas. Unlike scientific peer review, replicability, reliability, and evaluation of methods are largely irrelevant to much of the bioethics literature, except for empirical research. Much like papers published in law, the humanities, and social sciences, peer reviewing contextual arguments in bioethics requires us to evaluate argument validity and ensure that arguments are based on facts or appropriate hypotheticals. The risk that voices are quieted merely because the editorial staff or peer reviewers would choose the other side of an argument is high and requires mitigation steeped in serious processes built into the peer review system. It is especially important to hear diverse views that represent many points along a continuum during polarized times. The papers that offer conceptual arguments that we tend to publish at Voices in Bioethics call for an examination of logic and argument foremost, with a special emphasis on which conclusions are drawn from the premises supplied. At Voices in Bioethics, the peer review process aims to be inclusive, so we balance our instincts to criticize with our goal to accept as many papers that meet our guidelines as possible. We welcome new arguments, especially ones that highlight overlooked viewpoints, considerations, or stakeholders. We acknowledge how many great ideas result from people who speak English as a second or third language, or who do not use English at all. All of those affected by or who observe an ethical dilemma are welcome to submit their ethics arguments surrounding health care, technology, the environment, and the broader sciences. We are happy to read papers by those outside of bioethics and those with any level of education. We use the peer review questions about mechanics only to inform editors of what the process might entail. We do not accept or reject based on mechanics or style alone. The nature of many bioethics journals is to publish papers that may reflect the bioethics status quo or apply common bioethical frameworks to new problems. In addition to that, we try to showcase new ways of thinking and additional considerations. After all, publishing is not about publishing papers that mimic older well-cited articles or that apply only those frameworks learned in the classroom. It is about giving voice and contributing to an open access ecosystem where new and old ideas coexist, their worth measured not in hits or likes, but in their contribution to ethical analysis. Wishing a happy new year to our advisors, editors, peer reviewers, authors, and readers.


2021 ◽  
Vol 10 (2) ◽  
pp. e1-e15
Author(s):  
Taif Alawsi ◽  
Ula Al-Kawaz

In editors of the Iraqi Journal of Embryos and Infertility Researches (IJEIR) are thankful to the huge efforts made by the reviewers in peer reviewing the submitted manuscripts. Thanks to their efforts the second issue of the 10th volume is now available online with open access to the articles content. We are looking forward in inclusion in relevant indexing in the near future. We would like to acknowledge the reviewers for their contribution, and we wish them the greatest success. We ensured the anonymity of both reviewers and authors and followed a double-blind peer-review procedure. We strictly followed the COPE ethical code in the published studies. As of now, the IJEIR is published in new website https://ijeir.net/index.php/ijeir supported by the Open Journal Systems (OJS), therefore all the activities were strictly by the online system. Journal reviewers were given the proper credit via Publons (an online platform that promotes the peer review process). Currently, IJEIR is indexed in Google Scholar, Science gate, Crossref, Iraqi academic journals, Publons, Dimensions, LOCKSS, and CLOCKSS. Our articles are published under the Creative Commons Attribution 4.0 International License and the rights are with the authors which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. http://creativecommons.org/licenses/by/4.0  


F1000Research ◽  
2017 ◽  
Vol 6 ◽  
pp. 588 ◽  
Author(s):  
Tony Ross-Hellauer

Background: “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with a myriad of overlapping and often contradictory definitions. While the term is used by some to refer to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods: Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are then systematically analysed to build a coherent typology of the many different innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results: This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how  ambiguously the phrase “open peer review”  has been used thus far, for the literature offers a total of 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature. Conclusions: Based on this work, I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the ethos of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.


2021 ◽  
Vol 23 (2) ◽  
pp. 38-42
Author(s):  
Margie Ruppel

PsyArXiv, an Open Access preprint service, is the only platform in North America dedicated to making psychology and psychological science papers available to scholars, students, and the general public prior to peer review. The Society for the Improvement of Psychological Science operates PsyArXiv; two governing boards provide guidance; and member institutions provide financial support. Key features include an abundance of new scholarship in all areas of psychology, an Open Access infrastructure using the Open Science Framework, and links to associated outputs, thus improving access to research and grey literature. Drawbacks include some accessibility issues and a lack of prominent notices on preprints indicating they have not gone through the peer review process.


Author(s):  
Shantanu Kumar Rahut ◽  
Razwan Ahmed Tanvir ◽  
Sharfi Rahman ◽  
Shamim Akhter

In general, peer reviewing is known as an inspection of a work that is completed by one or more qualified people from the same profession and from the relevant field to make the work more error-free, readable, presentable, and adjustable according to the pre-published requirements and also considered as the primary metric for publishing a research paper, accepting research grants, or selecting award nominees. However, many recent publications are pointing to the biasness and mistreatment in the peer-review process. Thus, the scientific community is involved to generate ideas to advance the reviewing process including standardizing procedures and protocols, blind and electronic reviewing, rigorous methods in reviewer selection, rewarding reviewers, providing detailed feedback or checklist to reviewers, etc. In this chapter, the authors propose a decentralized and anonymous scientific peer-reviewing system using blockchain technology. This system will integrate all the above concern issues and eliminate the bias or trust issues interconnected with the peer-reviewing process.


Sign in / Sign up

Export Citation Format

Share Document