scholarly journals Development of a Behavioural Marker System for Rating Cadet’s Non-Technical Skills

2017 ◽  
Vol 11 (2) ◽  
pp. 69-76 ◽  
Author(s):  
Victor Fernando PlÁcido da ConceiçÌo ◽  
JoÌo Cruz Basso ◽  
Custodio Lopes ◽  
Joakim Dahlman
Keyword(s):  
Technical Skills ◽  
Marker System

scholarly journals Anaesthesiology students’ Non-Technical skills: development and evaluation of a behavioural marker system for students (AS-NTS)

2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Parisa Moll-Khosrawi ◽  
Anne Kamphausen ◽  
Wolfgang Hampe ◽  
Leonie Schulte-Uentrop ◽  
Stefan Zimmermann ◽  
...  
Keyword(s):  
Technical Skills ◽  
Skills Development ◽  
Marker System

Experimental Evaluation of a Behavioural Marker System for Surgeons' Non-Technical Skills (NOTSS)

2006 ◽  
Vol 50 (10) ◽  
pp. 969-972 ◽  
Author(s):  
R. Flin ◽  
S. Yule ◽  
S. Paterson-Brown ◽  
N. Maran ◽  
D. Rowley ◽  
...  
Keyword(s):  
Experimental Evaluation ◽  
Technical Skills ◽  
Marker System

Medical Students’ Non-Technical Skills (Medi-StuNTS): preliminary work developing a behavioural marker system for the non-technical skills of medical students in acute care

2018 ◽  
Vol 5 (3) ◽  
pp. 130-139 ◽  
Author(s):  
Ailsa L Hamilton ◽  
Joanne Kerins ◽  
Marc A MacCrossan ◽  
Victoria R Tallentire
Keyword(s):  
Medical Students ◽  
Acute Care ◽  
Situation Awareness ◽  
Rating Scale ◽  
Medical Training ◽  
Poor Performance ◽  
Technical Skills ◽  
Face Validity ◽  
Self Awareness ◽  
Marker System

IntroductionGood non-technical skills (NTS) are critical to the delivery of high-quality patient care. It is increasingly recognised that training in such skills should be incorporated into primary medical training curricula. This study aimed to develop an NTS behavioural marker system (BMS), specifically applicable to medical students, for use within simulated acute care scenarios.MethodsThe methodology used to develop other BMS was adopted and modified. Following ethical approval, 16 final year medical students participated in acute care simulated scenarios. Semistructured interviews were performed to gauge the understanding of NTS. A panel meeting of subject matter experts was convened to translate key NTS into skill elements and observable behaviours. A second expert panel was consulted to refine aspects of the BMS. Further refinement and initial face validity was undertaken by a third panel of experts using the prototype BMS to observe prerecorded simulation scenarios.ResultsFive categories of NTS were identified: situation awareness, teamwork and communication, decision-making and prioritisation, self-awareness, and escalating care. Observable behaviours in each category describe good and poor performance. Escalating care was identified as a unique component that incorporated behaviours related to each of the other four skill categories. A 5-point rating scale was developed to enable both peer-to-peer and tutor-to–student feedback.ConclusionThe Medi-StuNTS (Medical Students’ Non-Technical Skills) system is the first BMS for the NTS of medical students. It reinforces the importance of escalating care effectively. It provides an exciting opportunity to provide feedback to medical students and may ultimately aid their preparedness for professional practice.

Development of a behavioural marker system for scrub practitioners' non-technical skills (SPLINTS system)

2012 ◽  
Vol 19 (2) ◽  
pp. 317-323 ◽  
Author(s):  
Lucy Mitchell ◽  
Rhona Flin ◽  
Steven Yule ◽  
Janet Mitchell ◽  
Kathy Coutts ◽  
...  
Keyword(s):  
Technical Skills ◽  
Marker System

scholarly journals Validation of a Behavioral Marker System for Rating Cadet’s Non-Technical Skills

2019 ◽  
Vol 13 (1) ◽  
pp. 89-96
Author(s):  
Victor Fernando PlÁcido da ConceiçÌo ◽  
J.B. Mendes ◽  
M.F. Teodoro ◽  
Joakim Dahlman
Keyword(s):  
Technical Skills ◽  
Marker System ◽  
Behavioral Marker

Validity of the Medi-StuNTS behavioural marker system: assessing the non-technical skills of medical students during immersive simulation

2020 ◽  
Vol 7 (1) ◽  
pp. 3-10 ◽  
Author(s):  
Emma Claire Phillips ◽  
Samantha Eve Smith ◽  
Benjamin Clarke ◽  
Ailsa Lauren Hamilton ◽  
Joanne Kerins ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Medical Students ◽  
Acute Care ◽  
Situation Awareness ◽  
Test Performance ◽  
Technical Skills ◽  
Strong Positive Correlation ◽  
Marker System ◽  
Significant Difference ◽  
Better Than

BackgroundThe Medical Students’ Non-Technical Skills (Medi-StuNTS) behavioural marker system (BMS) is the first BMS to be developed specifically for medical students to facilitate training in non-technical skills (NTS) within immersive simulated acute care scenarios. In order to begin implementing the tool in practice, validity evidence must be sought. We aimed to assess the validity of the Medi-StuNTS system with reference to Messick’s contemporary validity framework.MethodsTwo raters marked video-recorded performances of acute care simulation scenarios using the Medi-StuNTS system. Three groups were marked: third-year and fourth-year medical students (novices), final-year medical students (intermediates) and core medical trainees (experts). The scores were used to make assessments of relationships to the variable of clinical experience through expert–novice comparisons, inter-rater reliability, observability, exploratory factor analysis, inter-rater disagreements and differential item functioning.ResultsA significant difference was found between the three groups (p<0.005), with experts scoring significantly better than intermediates (p<0.005) and intermediates scoring significantly better than novices (p=0.001). There was a strong positive correlation between the two raters’ scores (r=0.79), and an inter-rater disagreement of more than one point in less than one-fifth of cases. Across all scenarios, 99.7% of skill categories and 84% of skill elements were observable. Factor analysis demonstrated appropriate grouping of skill elements. Inconsistencies in test performance across learner groups were shown specifically in the skill categories of situation awareness and decision making and prioritisation.ConclusionWe have demonstrated evidence for several aspects of validity of the Medi-StuNTS system when assessing medical students’ NTS during immersive simulation. We can now begin to introduce this system into simulation-based education to maximise NTS training in this group.

Reliability of assessment of medical students’ non-technical skills using a behavioural marker system: does clinical experience matter?

2020 ◽  
pp. bmjstel-2020-000705
Author(s):  
Benjamin Clarke ◽  
Samantha E Smith ◽  
Emma Claire Phillips ◽  
Ailsa Hamilton ◽  
Joanne Kerins ◽  
...  
Keyword(s):  
Medical Students ◽  
Clinical Experience ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Technical Skills ◽  
Rater Reliability ◽  
Single Measure ◽  
Marker System ◽  
Intraclass Correlation Coefficients ◽  
Reliability Coefficients

IntroductionNon-technical skills are recognised to play an integral part in safe and effective patient care. Medi-StuNTS (Medical Students’ Non-Technical Skills) is a behavioural marker system developed to enable assessment of medical students’ non-technical skills. This study aimed to assess whether newly trained raters with high levels of clinical experience could achieve reliability coefficients of >0.7 and to compare differences in inter-rater reliability of raters with varying clinical experience.MethodsForty-four raters attended a workshop on Medi-StuNTS before independently rating three videos of medical students participating in immersive simulation scenarios. Data were grouped by raters’ levels of clinical experience. Inter-rater reliability was assessed by calculating intraclass correlation coefficients (ICC).ResultsEleven raters with more than 10 years of clinical experience achieved single-measure ICC of 0.37 and average-measures ICC of 0.87. Fourteen raters with more than or equal to 5 years and less than 10 years of clinical experience achieved single-measure ICC of 0.09 and average-measures ICC of 0.59. Nineteen raters with less than 5 years of clinical experience achieved single-measure ICC of 0.09 and average-measures ICC 0.65.ConclusionsUsing 11 newly trained raters with high levels of clinical experience produced highly reliable ratings that surpassed the prespecified inter-rater reliability standard; however, a single rater from this group would not achieve sufficiently reliable ratings. This is consistent with previous studies using other medical behavioural marker systems. This study demonstrated a decrease in inter-rater reliability of raters with lower levels of clinical experience, suggesting caution when using this population as raters for assessment of non-technical skills.

Rating non-technical skills: developing a behavioural marker system for use in anaesthesia

2004 ◽  
Vol 6 (3) ◽  
Author(s):  
G. Fletcher ◽  
R. Flin ◽  
P. McGeorge ◽  
R. Glavin ◽  
N. Maran ◽  
...  
Keyword(s):  
Technical Skills ◽  
Marker System
Sign in / Sign up

Export Citation Format

Share Document