scholarly journals Peers in Systematic Review: Gate Keeping Understandings of Research in the Field

Author(s):  
Tine S. Prøitz

AbstractIn this chapter, the role of scholarly peers in systematic review is analysed and discussed. Peer evaluation is an essential element of quality assurance of the strictly defined methods of systematic review. The involvement of scholarly peers in the systematic review processes has similarities with traditional peer review processes in academic publishing, but also important differences. Drawing on an analysis of the functions of peers in systematic review relevant questions for all peers are raised regarding what peer work is about and what peers in varied academic contexts including systematic review are ‘gatekeepers’ of? In systematic review, peers are not only making re-judgements of already reviewed and published research but also gatekeeping the given standards, guidelines and procedures of the review method. The analysis lays a groundwork for a debate on peers in different contexts framed by different processes with different purposes, and questions whether a peer review is the same when the premise of the scholarly activity changes.

2021 ◽  
Author(s):  
S. Kumar ◽  
D. Spencer ◽  
J. Brown ◽  
T. Esmaiel

Abstract Oil & gas companies leverage value of information to deliver asset performance from their portfolio to achieve their strategic targets. This requires a transparent, consistent, and balanced reporting of any subsurface project's technical evaluation. To undertake such quality assurance and to build confidence in any evaluation, peer reviews are an essential element of the generally accepted industry standard procedure. Peers aim to review work to identify deficiencies due to inadequate technical investigation, recognize cost effective opportunities and advise for any additional technical work. Any international upstream oil & gas company will deal with various subsurface challenges, especially for a new field. A standardization of peer assists and peer reviews by qualitative analysis has been designed, starting with development projects. Checklists help quality assurance in a structured manner by organizing the facts into a framework, and they are intended to serve two main purposes: (1) Assist the systematic review of the subsurface work to request further technical assistance if necessary, and (2) Aid the review of various subsurface disciplines to ensure that the data supports the appropriate conclusions. It is important to streamline the technical assurance process within any organization. Ideally, informal peer assists concentrate on specific discipline interactions before a formalized technical peer review. A set of review checklists has been developed to aid Geophysicists, Geologists, Petrophysicists, and Reservoir Engineers in their review of subsurface projects. The checklist for a field development project consists of 213 subsurface standards in total: 60 Geophysical, 36 Geological, 62 Petrophysical and 55 Reservoir Engineering standards. Each discipline review is then followed by two key recommendations: (1) further work is required or not, and/or (2) a recommendation to proceed to the next phase is made or not. Because of the high level of detail for the analysis of each subsurface discipline, it is recommended that the checklists be used as part of an informal peer assist rather than a formal peer review. For each discipline, a summary of the outcome is agreed between the project member and the peer (typically a subject matter expert). The use of such qualitative analysis is a big step in the right direction to resolve issues of detailed technical assurance before the formal peer review. Such integration of the subsurface approach drives better business decisions. A case study is presented to show how this systematic approach was used and how the results are consistent, comparable, encompassing and objective. This paper outlines a clear and concise method that has been tried and tested and that allows for relevant technical work to be presented at the correct decision gates and thereby allow data evaluation to be done in a more ordered and efficient way, and this would be of interest to organizations that are required to undertake several review steps prior to project execution.


Publications ◽  
2020 ◽  
Vol 8 (2) ◽  
pp. 17 ◽  
Author(s):  
Bo-Christer Björk ◽  
Sari Kanto-Karvonen ◽  
J. Tuomas Harviainen

Predatory journals are Open Access journals of highly questionable scientific quality. Such journals pretend to use peer review for quality assurance, and spam academics with requests for submissions, in order to collect author payments. In recent years predatory journals have received a lot of negative media. While much has been said about the harm that such journals cause to academic publishing in general, an overlooked aspect is how much articles in such journals are actually read and in particular cited, that is if they have any significant impact on the research in their fields. Other studies have already demonstrated that only some of the articles in predatory journals contain faulty and directly harmful results, while a lot of the articles present mediocre and poorly reported studies. We studied citation statistics over a five-year period in Google Scholar for 250 random articles published in such journals in 2014 and found an average of 2.6 citations per article, and that 56% of the articles had no citations at all. For comparison, a random sample of articles published in the approximately 25,000 peer reviewed journals included in the Scopus index had an average of 18, 1 citations in the same period with only 9% receiving no citations. We conclude that articles published in predatory journals have little scientific impact.


2009 ◽  
Vol 59 (4) ◽  
pp. 391-405 ◽  
Author(s):  
Liv Langfeldt ◽  
Bjørn Stensaker ◽  
Lee Harvey ◽  
Jeroen Huisman ◽  
Don F. Westerheijden

2021 ◽  
pp. 8-13
Author(s):  
M. N. Alekhin ◽  
S. I. Ivanov ◽  
A. I. Stepanova

This systematic review is dedicated to the role of echocardiography in diagnostics of possible cardiovascular complications in patients with COVID-19, the emerging infectious disease that has recently challenged global healthcare. The results of the largest current available clinical studies on the given topic from the leading medical databases were analyzed. Up-to-date data about the beneficial advantages and possible limitations of the use of echocardiography in the highly contagious disease pandemic is provided.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Ying He ◽  
Kun Tian ◽  
Jiangyang Fu

PurposePreprint has become an important vehicle for academic communications and discussions. However, in preprint, there is a lack of a sufficient quality control mechanism such as peer review, which is a proven quality assurance practice that is used in traditional academic publishing services. To address the problem leveraging on the power of this practice, the authors introduce into preprint a self-organizing peer review method by applying the concept of token economy and the blockchain technology.Design/methodology/approachSpecifically, this paper proposes an idea that applies the token economy concept to the design of the incentive and penalty mechanisms for peer reviewers in preprint to assure the qualities of its publications. Steemit has been studied to demonstrate the characteristics of the mechanisms.FindingsA token economy-enhanced framework for self-organizing peer review in preprint is also proposed. The resulting preprint system is an academic community-oriented, self-organizing and blockchain-based content publishing system that is designed to run on both permissioned and permissionless blockchains.Research limitations/implicationsFirst, since peer review is on a voluntary basis and not profits oriented, the “monetary” incentive and penalty mechanisms borrowed from Steemit may conflict with academic ethics. Second, the authors proposed to deploy the authors’ token economy on blockchain, but the current mainstream decentralized blockchain services are too few to warrant a foreseeable successful future for the authors’ application. In fact, as the flagship of blockchain 2.0, the Ethereum blockchain suffers from the problem of scalability, which leads to its applications' lower performances, longer response times and eventually more negative user experiences as time goes by. Finally, the authors’ proposed version of preprint has not been implemented, and hence, its practical effectiveness and acceptance by academia are yet to be evaluated.Practical implicationsIn this paper, the authors proposed a token economy-based framework for self-organizing peer review in preprint leveraging on blockchain technology. This framework encourages positive interactions between authors and reviewers, which helps to establish a healthy academic ecology that produces more contents with better qualities. Application of a solution based on the authors’ framework should impact the current academic communities by offering a new academic peer reviewing tool that has a built-in mechanism for self-behavior correction and quality assurance.Social implicationsThrough adaption, the framework can be applied to other domains as well. In such domains, a large amount of feedbacks from partakers are needed and there exists a tremendous amount of work to filter noises in feedbacks so as to ensure that as many the quality ones as possible are delivered for a variety of purposes. The authors’ framework essentially impacts almost all domains where there exists a need to collect and filter large amount of feedbacks, and using the authors’ framework-based solution is cost-saving, which can be seen as a major potential contribution of the research.Originality/valueThe incentive and penalty mechanisms encourage positive interactions between authors and reviewers, and it helps to establish a healthy academic ecology that produces high-volume contents with good qualities.


2020 ◽  
Vol 13 ◽  
Author(s):  
Yılmaz Serkan ◽  
Utku Beyazit ◽  
Aynur Bütün Ayhan

Background and objective: Exposure to mycotoxins may delay and/or negatively influence the development of neurological, gastrointestinal and inflammatory mechanisms in individuals with Autism Spectrum Disorder (ASD). Therefore, there is a need to address the possible links between mycotoxins and the risk and prevalence of ASD to increase the understanding of the molecular mechanism underlying these links. In this context, the aim of this study was to investigate the molecular mechanism underpinning mycotoxin exposure and autism. Methods: The study was based on a systematic approach which focused on the possible associations between mycotoxins and ASD in addition to the role of the mycotoxins on the risk and prevalence of ASD. The systematic review included all molecular mechanism studies examining mycotoxin exposure and autism, and was not limited to a specific period of time. A search was performed on the PubMed, Web of Science, Scopus, and Google Scholar databases. Results: The investigation of the literature revealed that a total number of 11 studies with a specific focus on the molecular mechanism of mycotoxin exposure and autism were published between 2008 and 2019. Out of these studies, 7 were research and 4 were review articles. In almost all the articles, possible links between mycotoxins and ASD were revealed. Conclusion: The examination of the given studies provided data related to the links between mycotoxins and ASD. However, evidence related to these links needs to be investigated in larger samples, while the effects of separate mycotoxins and their metabolisms should also be examined.


Pathology ◽  
1998 ◽  
Vol 30 (3) ◽  
pp. 309-313 ◽  
Author(s):  
Ibrahim M. Zardawi ◽  
Genevieve Bennett ◽  
Sanjiv Jain ◽  
Michael Brown

Sign in / Sign up

Export Citation Format

Share Document