A Study of Medical Board Peer Reviews in Nevada

2010 ◽  
Vol 96 (1) ◽  
pp. 20-29
Author(s):  
Jerry C. Calvanese

ABSTRACT Study Objective: The purpose of this study was to obtain data on various characteristics of peer reviews. These reviews were performed for the Nevada State Board of Medical Examiners (NSBME) to assess physician licensees' negligence and/or incompetence. It was hoped that this data could help identify and define certain characteristics of peer reviews. Methods: This study examined two years of data collected on peer reviews. The complaints were initially screened by a medical reviewer and/or a committee composed of Board members to assess the need for a peer review. Data was then collected from the peer reviews performed. The data included costs, specialty of the peer reviewer, location of the peer reviewer, and timeliness of the peer reviews. Results: During the two-year study, 102 peer reviews were evaluated. Sixty-nine percent of the peer-reviewed complaints originated from civil malpractice cases and 15% originated from complaints made by patients. Eighty percent of the complaint physicians were located in Clark County and 12% were located in Washoe County. Sixty-one percent of the physicians who performed the peer reviews were located in Washoe County and 24% were located in Clark County. Twelve percent of the complaint physicians were in practice in the state for 5 years or less, 40% from 6 to 10 years, 20% from 11 to 15 years, 16% from 16 to 20 years, and 13% were in practice 21 years or more. Forty-seven percent of the complaint physicians had three or less total complaints filed with the Board, 10% had four to six complaints, 17% had 7 to 10 complaints, and 26% had 11 or more complaints. The overall quality of peer reviews was judged to be good or excellent in 96% of the reviews. A finding of malpractice was found in 42% of the reviews ordered by the medical reviewer and in 15% ordered by the Investigative Committees. There was a finding of malpractice in 38% of the overall total of peer reviews. The total average cost of a peer review was $791. In 47% of the peer reviews requested, materials were sent from the Board to the peer reviewer within 60 days of the original request and 33% took more than 120 days for the request to be sent. In 48% of the reviews, the total time for the peer review to be performed by the peer reviewer was less than 60 days. Twenty seven percent of the peer reviews took more than 120 days to be returned. Conclusion: Further data is needed to draw meaningful conclusions from certain peer review characteristics reported in this study. However, useful data was obtained regarding timeliness in sending out peer review materials, total times for the peer reviews, and costs.

1999 ◽  
Vol 21 (2) ◽  
pp. 95-107 ◽  
Author(s):  
Michael J. Calegari ◽  
Gregory G. Geisler ◽  
Ernest R. Larkins

Extant literature suggests that the process of constructing a teaching portfolio can identify areas to improve, motivate positive changes, and elevate the importance of teaching in academe. This study describes the experience of the tax faculty at a public university in using teaching portfolios and peer reviews to improve the quality of the first two tax courses. The type of teaching portfolio used in this project consists of a course syllabus and a reflective statement that documents the rationale for all components of a course (i.e., lectures, projects, exams, writing assignments, presentations, etc.). The peer review aspect involves written feedback from a colleague on this teaching portfolio. Though research publications are usually subject to extensive peer review, teaching generally is not. Like research, however, teaching can be evaluated and ultimately improved through peer review. Thus, this study can provide valuable guidance to tax professors attempting to improve their courses.


Publications ◽  
2019 ◽  
Vol 7 (1) ◽  
pp. 13 ◽  
Author(s):  
Afshin Sadeghi ◽  
Sarven Capadisli ◽  
Johannes Wilm ◽  
Christoph Lange ◽  
Philipp Mayr

An increasing number of scientific publications are created in open and transparent peer review models: a submission is published first, and then reviewers are invited, or a submission is reviewed in a closed environment but then these reviews are published with the final article, or combinations of these. Reasons for open peer review include giving better credit to reviewers, and enabling readers to better appraise the quality of a publication. In most cases, the full, unstructured text of an open review is published next to the full, unstructured text of the article reviewed. This approach prevents human readers from getting a quick impression of the quality of parts of an article, and it does not easily support secondary exploitation, e.g., for scientometrics on reviews. While document formats have been proposed for publishing structured articles including reviews, integrated tool support for entire open peer review workflows resulting in such documents is still scarce. We present AR-Annotator, the Automatic Article and Review Annotator which employs a semantic information model of an article and its reviews, using semantic markup and unique identifiers for all entities of interest. The fine-grained article structure is not only exposed to authors and reviewers but also preserved in the published version. We publish articles and their reviews in a Linked Data representation and thus maximise their reusability by third party applications. We demonstrate this reusability by running quality-related queries against the structured representation of articles and their reviews.


2018 ◽  
pp. 136-146
Author(s):  
V.O. Lyubchenko ◽  
M.Ya. Postan

In our paper, the methodical approach is proposed for risks minimization of classification society (CS) related to providing the low quality service by recognized vendors. For example, above vendors provide measurement of residual thicknesses of hull, radio expertise, underwater observations, etc. Safe operation of a ship is immediately determined by qualitative and reliable action of vendors. The method is worked out for optimization of  quality level of services providing  to CS by the vendors which allows us to assess reliability and qua-lity of vendors’ work, and the methodical approach for expediency of risks    insurance determination is proposed, as well. This methodical approach is based on the methods of mathematical reliability theory and evaluation of fai-lures probabilities of some subsystems of ship under operation. It is assumed that quality of vendors work is determined by the volumes of works for each subsystem. The optimization problem is formulated for determination of these volumes which minimize the total average cost for ship observation  by vendors and liquidation of failures sequences. The criterion of insurance expediency  of  failures risk  for the ship under operation (between two neighbor examinations) is formulated. The method is illustrated by numerical results.


Author(s):  
V.  N. Gureyev ◽  
N.  A. Mazov

The paper summarizes experience of the authors as peer-reviewers of more than 100 manuscripts in twelve Russian and foreign academic journals on Library and Information Science in the last seven years. Prepared peer-reviews were used for making a list of the most usual critical and special comments for each manuscript that were subsequently structured for the conducted analyzes. Typical issues accompanying the peer-review process are shown. Significant differences between the results of peer-review in Russian and foreign journals are detected: although the initial quality of newly submitted manuscripts is approximately equal, the final published versions in foreign journals addressed all critical and the majority of minor reviewers’ comments, while in Russian journals more than one third of final versions were published with critical gaps. We conclude about low interest in high quality peer reviews among both authors and editors-in-chief in Russian journals. Despite the limitations of the samples, the obtained findings can be useful when evaluating the current peer-review system in Russian academic journals on Library and Information Science.


2016 ◽  
Vol 113 (30) ◽  
pp. 8414-8419 ◽  
Author(s):  
Stefano Balietti ◽  
Robert L. Goldstone ◽  
Dirk Helbing

To investigate the effect of competitive incentives under peer review, we designed a novel experimental setup called the Art Exhibition Game. We present experimental evidence of how competition introduces both positive and negative effects when creative artifacts are evaluated and selected by peer review. Competition proved to be a double-edged sword: on the one hand, it fosters innovation and product diversity, but on the other hand, it also leads to more unfair reviews and to a lower level of agreement between reviewers. Moreover, an external validation of the quality of peer reviews during the laboratory experiment, based on 23,627 online evaluations on Amazon Mechanical Turk, shows that competition does not significantly increase the level of creativity. Furthermore, the higher rejection rate under competitive conditions does not improve the average quality of published contributions, because more high-quality work is also rejected. Overall, our results could explain why many ground-breaking studies in science end up in lower-tier journals. Differences and similarities between the Art Exhibition Game and scholarly peer review are discussed and the implications for the design of new incentive systems for scientists are explained.


2020 ◽  
Vol 13 (1) ◽  
pp. 1-27 ◽  
Author(s):  
Tine Köhler ◽  
M. Gloria González-Morales ◽  
George C. Banks ◽  
Ernest H. O’Boyle ◽  
Joseph A. Allen ◽  
...  

AbstractPeer review is a critical component toward facilitating a robust science in industrial and organizational (I-O) psychology. Peer review exists beyond academic publishing in organizations, university departments, grant agencies, classrooms, and many more work contexts. Reviewers are responsible for judging the quality of research conducted and submitted for evaluation. Furthermore, they are responsible for treating authors and their work with respect, in a supportive and developmental manner. Given its central role in our profession, it is curious that we do not have formalized review guidelines or standards and that most of us never receive formal training in peer reviewing. To support this endeavor, we are proposing a competency framework for peer review. The purpose of the competency framework is to provide a definition of excellent peer reviewing and guidelines to reviewers for which types of behaviors will lead to good peer reviews. By defining these competencies, we create clarity around expectations for peer review, standards for good peer reviews, and opportunities for training the behaviors required to deliver good peer reviews. We further discuss how the competency framework can be used to improve peer reviewing and suggest additional steps forward that involve suggestions for how stakeholders can get involved in fostering high-quality peer reviewing.


2015 ◽  
Vol 96 (2) ◽  
pp. 191-201 ◽  
Author(s):  
Matthew S. Mayernik ◽  
Sarah Callaghan ◽  
Roland Leigh ◽  
Jonathan Tedds ◽  
Steven Worley

Abstract Peer review holds a central place within the scientific communication system. Traditionally, research quality has been assessed by peer review of journal articles, conference proceedings, and books. There is strong support for the peer review process within the academic community, with scholars contributing peer reviews with little formal reward. Reviewing is seen as a contribution to the community as well as an opportunity to polish and refine understanding of the cutting edge of research. This paper discusses the applicability of the peer review process for assessing and ensuring the quality of datasets. Establishing the quality of datasets is a multifaceted task that encompasses many automated and manual processes. Adding research data into the publication and peer review queues will increase the stress on the scientific publishing system, but if done with forethought will also increase the trustworthiness and value of individual datasets, strengthen the findings based on cited datasets, and increase the transparency and traceability of data and publications. This paper discusses issues related to data peer review—in particular, the peer review processes, needs, and challenges related to the following scenarios: 1) data analyzed in traditional scientific articles, 2) data articles published in traditional scientific journals, 3) data submitted to open access data repositories, and 4) datasets published via articles in data journals.


2021 ◽  
Author(s):  
Godwin Ubong Akpan ◽  
Johnson Ticha ◽  
Fiona Lau ◽  
Reuben Ngofa ◽  
Diallo Mamadou ◽  
...  

Abstract Background The Auto-Visual AFP Detection and Reporting (AVADAR) digital health intervention programme is a programme that was introduced to Africa in 2016. The programme adopts the use of the AVADAR SMS – based smartphone application (app) in community-based AFP surveillance activities in order to enhance the detection and reporting of AFP (polio) cases and improve AFP surveillance quality. As at 2020, the AVADAR application is being used in 11 African countries. The need to conduct regular and relevant evaluations of the AVADAR programme is very essential towards improving polio eradication programme performance and effectiveness in Africa. Hence, this study aimed to review and evaluate the quality of the AFP cases reported through the AVADAR intervention and as well evaluate the documentation process of AVADAR alerts and investigations, and the assimilation of AFP cases found via AVADAR into the national databases. Methods This study reviewed and evaluated the quality of AVADAR-involved AFP case reporting and documentation process in 7 of the 11 African countries implementing the AVADAR programme (Cameroon, Chad, the DRC, Liberia, Mali, Niger, and South Sudan). Case validations of all AFP cases reported via AVADAR app, iterations of methods used for peer reviewing AVADAR reporting and documentation, informal interview of community informants (CIs) and health workers (HWs), as well as the development of interactive dashboard to showcase the results of peer reviews, were the approaches used for the review and evaluation process. Results Thirty-nine districts, cutting across the participating 7 African countries were selected for the study. A total of 581 AFP cases were reviewed in the selected districts; of which 496 AFP cases were physically seen with 384 cases confirmed as true AFP cases by the peer reviewers. Thematic findings obtained the interview with CIs and HWs identified key areas (communication, multi-disease reporting, and periodic evaluation) that needs to be improved in the AVADAR surveillance system. Also, the interactive dashboard gave a summary of the peer review outcomes at few glances. Conclusions The findings of the AVADAR AFP peer reviews revealed the app’s efficacy in reporting AFP cases and improving surveillance indicators at district level. However, its documentation at health facility level needs to be re-emphasized and improved via a systematic accountability framework implementation for the actors in the reporting cycle. In order to significantly improve AFP surveillance, we recommend on-going commitment to improve knowledge and collaboration between all AVADAR surveillance reporting teams involved in identifying children presenting with AFP. Keywords: AVADAR, Mobile Health, Peer Review, Acute Flaccid Paralysis, surveillance , Africa


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Sonja P. Brubacher ◽  
Martine B. Powell ◽  
Linda C. Steele ◽  
David Boud

Purpose Investigative interviewers assess their colleagues' interviews (‘peer review’) as a necessary part of their practice, and for their self-development. Yet, there is little guidance around what the process involves and how they might do it. Research suggests that effective peer review is supported by using guidance material. The goal of the present work was to describe the use of such a guide by a group of professionals who regularly conduct investigative interviews with children, to share what was learned with other professionals seeking to create a formalized peer review process. Design/methodology/approach Sixty US child witness interviewers completed a guided peer review assessment of an anonymous interview, as an assignment at the conclusion of an 18-hour training program that focused on developing their interviewing skills. They consented to the use of their learning data in research, and the research was approved by the university's research ethics board. Peer reviews were coded for the extent to which they used the guide to support their evaluations, and the overall quality of the review to assess the utility of the guide in supporting them to conduct effective assessments. Findings In general, the guide and instructions for providing feedback were moderately effective in supporting the peer assessments, but results suggested specific training in how to deliver peer review would be useful. Practical implications Through this process, the authors identified components that would be helpful to further increase the efficacy of peer review. Originality/value The aim of this work was to spark a greater conversation among practitioners and academics about professionalizing the peer review process and aiding interviewers to develop peer review tools that would support their continued growth. The authors conclude with five key tips for professionals that stem from the experiences creating and evaluating the guide in combination with existing literature and three areas for future investigation.


2020 ◽  
Vol 3 ◽  
pp. 1-8
Author(s):  
H. C. Okeke ◽  
P. Bassey ◽  
O. A. Oduwole ◽  
A. Adindu

Different mix of clients visit primary health care (PHC) facilities, and the quality of services is critical even in rural communities. The study objective was to determine the relationship between socio-demographic characteristics and client satisfaction with the quality of PHC services in Calabar Municipality, Cross River State, Nigeria. Specifically to describe aspects of the health facilities that affect client satisfaction; determine the health-care providers’ attitude that influences client satisfaction; and determine the socio-demographic characteristics that influence client satisfaction with PHC services. A cross-sectional survey was adopted. Ten PHCs and 500 clients utilizing services in PHC centers in Calabar Municipality were randomly selected. Clients overall satisfaction with PHC services was high (80.8%). Divorced clients were less (75.0%) satisfied than the singles and the married counterparts (81%), respectively. Clients that were more literate as well as those with higher income were less satisfied, 68.0% and 50.0%, respectively, compared to the less educated and lower-income clients, 92.0% and 85.0% respectively. These differences in satisfaction were statistically significant (P = 0.001). Hence, it was shown that client characteristics such as income and literacy level show a significant negative relationship with the clients satisfaction with the quality of PHC services in Calabar Municipality.


Sign in / Sign up

Export Citation Format

Share Document