scholarly journals Correction to: Direct observation of procedural skills (DOPS) assessment in diagnostic gastroscopy: nationwide evidence of validity and competency development during training

2019 ◽  
Vol 34 (1) ◽  
pp. 115-115
Author(s):  
Keith Siau ◽  
◽  
James Crossley ◽  
Paul Dunckley ◽  
Gavin Johnson ◽  
...  
Keyword(s):  
Direct Observation ◽  
Competency Development ◽  
Procedural Skills

scholarly journals Colonoscopy Direct Observation of Procedural Skills Assessment Tool for Evaluating Competency Development During Training

2019 ◽  
Vol 115 (2) ◽  
pp. 234-243 ◽  
Author(s):  
Keith Siau ◽  
James Crossley ◽  
Paul Dunckley ◽  
Gavin Johnson ◽  
Mark Feeney ◽  
...  
Keyword(s):  
Direct Observation ◽  
Assessment Tool ◽  
Skills Assessment ◽  
Competency Development ◽  
Procedural Skills

scholarly journals PWE-109 Direct observation of procedural skills (dops) assessment in colonoscopy: validity and competency development during training

2019 ◽  
Author(s):  
Keith Siau ◽  
James Crossley ◽  
Paul Dunckley ◽  
Mark Feeney ◽  
Gavin Johnson ◽  
...  
Keyword(s):  
Direct Observation ◽  
Competency Development ◽  
Procedural Skills

scholarly journals PWE-107 Direct observation of procedural skills (dops) assessment in gastroscopy: validity and competency development during training

2019 ◽  
Author(s):  
Keith Siau ◽  
Prof James Crossley ◽  
Paul Dunckley ◽  
Gavin Johnson ◽  
Mark Feeney ◽  
...  
Keyword(s):  
Direct Observation ◽  
Competency Development ◽  
Procedural Skills

scholarly journals Direct observation of procedural skills (DOPS) assessment in diagnostic gastroscopy: nationwide evidence of validity and competency development during training

2019 ◽  
Vol 34 (1) ◽  
pp. 105-114 ◽  
Author(s):  
Keith Siau ◽  
◽  
James Crossley ◽  
Paul Dunckley ◽  
Gavin Johnson ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Exploratory Factor Analysis ◽  
Direct Observation ◽  
Roc Analysis ◽  
Assessment Tool ◽  
Technical Skills ◽  
Competency Assessment ◽  
Competency Development ◽  
Procedural Skills ◽  
Post Procedure

AbstractBackgroundValidated competency assessment tools and the data supporting milestone development during gastroscopy training are lacking. We aimed to assess the validity of the formative direct observation of procedural skills (DOPS) assessment tool in diagnostic gastroscopy and study competency development using DOPS.MethodsThis was a prospective multicentre (N = 275) analysis of formative gastroscopy DOPS assessments. Internal structure validity was tested using exploratory factor analysis and reliability estimated using generalisability theory. Item and global DOPS scores were stratified by lifetime procedure count to define learning curves, using a threshold determined from receiver operator characteristics (ROC) analysis. Multivariable binary logistic regression analysis was performed to identify independent predictors of DOPS competence.ResultsIn total, 10086 DOPS were submitted for 987 trainees. Exploratory factor analysis identified three distinct item groupings, representing ‘pre-procedure’, ‘technical’, and ‘post-procedure non-technical’ skills. From generalisability analyses, sources of variance in overall DOPS scores included trainee ability (31%), assessor stringency (8%), assessor subjectivity (18%), and trainee case-to-case variation (43%). The combination of three assessments from three assessors was sufficient to achieve the reliability threshold of 0.70. On ROC analysis, a mean score of 3.9 provided optimal sensitivity and specificity for determining competency. This threshold was attained in the order of ‘pre-procedure’ (100–124 procedures), ‘technical’ (150–174 procedures), ‘post-procedure non-technical’ skills (200–224 procedures), and global competency (225–249 procedures). Higher lifetime procedure count, DOPS count, surgical trainees and assessors, higher trainee seniority, and lower case difficulty were significant multivariable predictors of DOPS competence.ConclusionThis study establishes milestones for competency acquisition during gastroscopy training and provides validity and reliability evidence to support gastroscopy DOPS as a competency assessment tool.

scholarly journals Training and Assessment in Flexible Sigmoidoscopy: using a Novel Direct Observation of Procedural Skills (DOPS) Assessment Tool

2019 ◽  
Vol 28 (1) ◽  
pp. 33-40
Author(s):  
Keith Siau ◽  
James Crossley ◽  
Paul Dunckley ◽  
Gavin Johnson ◽  
Adam Haycock ◽  
...  
Keyword(s):  
Direct Observation ◽  
Flexible Sigmoidoscopy ◽  
Assessment Tool ◽  
Binary Logistic Regression ◽  
Learning Curves ◽  
Competency Development ◽  
Theory Analysis ◽  
Procedural Skills ◽  
Reliability Estimates ◽  
National Training

Background & Aims: Data supporting milestone development during flexible sigmoidoscopy (FS) training are lacking. We aimed to present validity evidence for our formative direct observation of procedural skills (DOPS) assessment in FS, and use DOPS to establish competency benchmarks and define learning curves for a national training cohort.Methods: This prospective UK-wide (211 centres) study included all FS formative DOPS assessments submitted to the national e-portfolio. Reliability was estimated from generalisability theory analysis. Item and global DOPS scores were correlated with lifetime procedure count to study learning curves, with competency benchmarks defined using contrasting groups analysis. Multivariable binary logistic regression was performedto identify independent predictors of DOPS competence.Results: This analysis included 3,616 DOPS submitted for 468 trainees. From generalisability analysis, sources of overall competency score variance included: trainee ability (27%), assessor stringency (15%), assessor subjectivity attributable to the trainee (18%) and case-to-case variation (40%), which enabled the modelling of reliability estimates. The competency benchmark (mean DOPS score: 3.84) was achieved after 150-174 procedures. Across the cohort, competency development occurred in the order of: pre-procedural (50-74), non-technical (75-149), technical (125-174) and post-procedural (175-199) skills. Lifetime procedural count (p<0.001), case difficulty (p<0.001), and lifetime formative DOPS count (p=0.001) were independently associated with DOPS competence, but not trainee or assessor specialty.Conclusion: Sigmoidoscopy DOPS can provide valid and reliable assessments of competency during training and can be used to chart competency development. Contrary to earlier studies, based on destination-orientated endpoints, overall competency in sigmoidoscopy was attained after 150 lifetime procedures.

scholarly journals The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: A systematic review and meta-analysis

PLoS ONE ◽  
2018 ◽  
Vol 13 (6) ◽  
pp. e0198009 ◽  
Author(s):  
Andrea C. Lörwald ◽  
Felicitas-Maria Lahner ◽  
Zineb M. Nouns ◽  
Christoph Berendonk ◽  
John Norcini ◽  
...  
Keyword(s):  
Systematic Review ◽  
Direct Observation ◽  
Clinical Evaluation ◽  
Meta Analysis ◽  
Educational Impact ◽  
Procedural Skills ◽  
Evaluation Exercise
Sign in / Sign up

Export Citation Format

Share Document