Value of Information through Standardization of Peer Reviews by Qualitative Analysis

2021 ◽  
Author(s):  
S. Kumar ◽  
D. Spencer ◽  
J. Brown ◽  
T. Esmaiel

Abstract Oil & gas companies leverage value of information to deliver asset performance from their portfolio to achieve their strategic targets. This requires a transparent, consistent, and balanced reporting of any subsurface project's technical evaluation. To undertake such quality assurance and to build confidence in any evaluation, peer reviews are an essential element of the generally accepted industry standard procedure. Peers aim to review work to identify deficiencies due to inadequate technical investigation, recognize cost effective opportunities and advise for any additional technical work. Any international upstream oil & gas company will deal with various subsurface challenges, especially for a new field. A standardization of peer assists and peer reviews by qualitative analysis has been designed, starting with development projects. Checklists help quality assurance in a structured manner by organizing the facts into a framework, and they are intended to serve two main purposes: (1) Assist the systematic review of the subsurface work to request further technical assistance if necessary, and (2) Aid the review of various subsurface disciplines to ensure that the data supports the appropriate conclusions. It is important to streamline the technical assurance process within any organization. Ideally, informal peer assists concentrate on specific discipline interactions before a formalized technical peer review. A set of review checklists has been developed to aid Geophysicists, Geologists, Petrophysicists, and Reservoir Engineers in their review of subsurface projects. The checklist for a field development project consists of 213 subsurface standards in total: 60 Geophysical, 36 Geological, 62 Petrophysical and 55 Reservoir Engineering standards. Each discipline review is then followed by two key recommendations: (1) further work is required or not, and/or (2) a recommendation to proceed to the next phase is made or not. Because of the high level of detail for the analysis of each subsurface discipline, it is recommended that the checklists be used as part of an informal peer assist rather than a formal peer review. For each discipline, a summary of the outcome is agreed between the project member and the peer (typically a subject matter expert). The use of such qualitative analysis is a big step in the right direction to resolve issues of detailed technical assurance before the formal peer review. Such integration of the subsurface approach drives better business decisions. A case study is presented to show how this systematic approach was used and how the results are consistent, comparable, encompassing and objective. This paper outlines a clear and concise method that has been tried and tested and that allows for relevant technical work to be presented at the correct decision gates and thereby allow data evaluation to be done in a more ordered and efficient way, and this would be of interest to organizations that are required to undertake several review steps prior to project execution.

Author(s):  
Tine S. Prøitz

AbstractIn this chapter, the role of scholarly peers in systematic review is analysed and discussed. Peer evaluation is an essential element of quality assurance of the strictly defined methods of systematic review. The involvement of scholarly peers in the systematic review processes has similarities with traditional peer review processes in academic publishing, but also important differences. Drawing on an analysis of the functions of peers in systematic review relevant questions for all peers are raised regarding what peer work is about and what peers in varied academic contexts including systematic review are ‘gatekeepers’ of? In systematic review, peers are not only making re-judgements of already reviewed and published research but also gatekeeping the given standards, guidelines and procedures of the review method. The analysis lays a groundwork for a debate on peers in different contexts framed by different processes with different purposes, and questions whether a peer review is the same when the premise of the scholarly activity changes.


2010 ◽  
Vol 96 (1) ◽  
pp. 20-29
Author(s):  
Jerry C. Calvanese

ABSTRACT Study Objective: The purpose of this study was to obtain data on various characteristics of peer reviews. These reviews were performed for the Nevada State Board of Medical Examiners (NSBME) to assess physician licensees' negligence and/or incompetence. It was hoped that this data could help identify and define certain characteristics of peer reviews. Methods: This study examined two years of data collected on peer reviews. The complaints were initially screened by a medical reviewer and/or a committee composed of Board members to assess the need for a peer review. Data was then collected from the peer reviews performed. The data included costs, specialty of the peer reviewer, location of the peer reviewer, and timeliness of the peer reviews. Results: During the two-year study, 102 peer reviews were evaluated. Sixty-nine percent of the peer-reviewed complaints originated from civil malpractice cases and 15% originated from complaints made by patients. Eighty percent of the complaint physicians were located in Clark County and 12% were located in Washoe County. Sixty-one percent of the physicians who performed the peer reviews were located in Washoe County and 24% were located in Clark County. Twelve percent of the complaint physicians were in practice in the state for 5 years or less, 40% from 6 to 10 years, 20% from 11 to 15 years, 16% from 16 to 20 years, and 13% were in practice 21 years or more. Forty-seven percent of the complaint physicians had three or less total complaints filed with the Board, 10% had four to six complaints, 17% had 7 to 10 complaints, and 26% had 11 or more complaints. The overall quality of peer reviews was judged to be good or excellent in 96% of the reviews. A finding of malpractice was found in 42% of the reviews ordered by the medical reviewer and in 15% ordered by the Investigative Committees. There was a finding of malpractice in 38% of the overall total of peer reviews. The total average cost of a peer review was $791. In 47% of the peer reviews requested, materials were sent from the Board to the peer reviewer within 60 days of the original request and 33% took more than 120 days for the request to be sent. In 48% of the reviews, the total time for the peer review to be performed by the peer reviewer was less than 60 days. Twenty seven percent of the peer reviews took more than 120 days to be returned. Conclusion: Further data is needed to draw meaningful conclusions from certain peer review characteristics reported in this study. However, useful data was obtained regarding timeliness in sending out peer review materials, total times for the peer reviews, and costs.


Author(s):  
E Reunis ◽  
C Bloomfield ◽  
H Finegan ◽  
F Zahir ◽  
M Bandhakavi ◽  
...  

2020 ◽  
Vol 11 (1) ◽  
Author(s):  
Thomas C. Kwee ◽  
Hugo J. A. Adams ◽  
Robert M. Kwee

Abstract Objective To investigate peer review practices by medical imaging journals. Methods Journals in the category "radiology, nuclear medicine and medical imaging" of the 2018 Journal Citation Reports were included. Results Of 119 included journals, 62 (52.1%) used single-blinded peer review, 49 (41.2%) used double-blinded peer review, two (1.7%) used open peer review and one (0.8%) used both single-blinded and double-blinded peer reviews, while the peer review model of five journals (4.2%) remained unclear. The use of single-blinded peer review was significantly associated with a journal’s impact factor (correlation coefficient of 0.218, P = 0.022). On subgroup analysis, only subspecialty medical imaging journals had a significant association between the use of single-blinded peer review and a journal’s impact factor (correlation coefficient of 0.354, P = 0.025). Forty-eight journals (40.3%) had a reviewer preference option, 48 journals (40.3%) did not have a reviewer recommendation option, and 23 journals (19.3%) obliged authors to indicate reviewers on their manuscript submission systems. Sixty-four journals (53.8%) did not provide an explicit option on their manuscript submission Web site to indicate nonpreferred reviewers, whereas 55 (46.2%) did. There were no significant associations between the option or obligation to indicate preferred or nonpreferred reviewers and a journal’s impact factor. Conclusion Single-blinded peer review and the option or obligation to indicate preferred or nonpreferred reviewers are frequently employed by medical imaging journals. Single-blinded review is (weakly) associated with a higher impact factor, also for subspecialty journals. The option or obligation to indicate preferred or nonpreferred reviewers is evenly distributed among journals, regardless of impact factor.


2021 ◽  
Vol 36 (1) ◽  
Author(s):  
Edwin Adrianta Surijah

Academic bullying in peer reviews is a cultural problem. This Editorial Note is intended to identify the unhelpful comments/critiques and to highlight the impact of unprofessional peer reviews toward the well-being and career development of fellow researchers. We acknowledge that we are part of the problems, and the necessary steps are needed to break the chain of the academic bullying culture in peer reviews. New guidelines for editors and reviewers are part of the solutions to promote constructive comments, as well as stronger internal consolidation throughout the peer reviews process.   Perundungan akademik dalam penilaian sejawat (peer review) adalah sebuah permasalahan kultur. Catatan Editorial ini bertujuan mengindentifikasi komentar atau kritik yang tidak membangun, serta menggarisbawahi dampak penilaian sejawat yang tidak profesional terhadap kesejahteraan dan pengembangan karir sesama peneliti. Kami menyadari bahwa kami merupakan bagian dari permasalahan ini, dan diperlukan langkah-langkah untuk memutus rantai kultur perundungan akademik dalam penilaian sejawat. Pedoman baru bagi editor dan mitra bestari merupakan bagian dari solusi untuk mendorong komentar yang konstruktif, serta konsolidasi internal yang lebih kuat dalam proses penilaian sejawat.


2021 ◽  
Author(s):  
Cynthia Shih ◽  
Ruhi Pudipeddi ◽  
Arany Uthayakumar ◽  
Peter Washington

UNSTRUCTURED These are authors' responses to peer review of ms#24972.


Sign in / Sign up

Export Citation Format

Share Document