scholarly journals Reply to: Wanted: Automated objective proficiency assessment metrics for the FAST exam (and other POCUS studies)

2019 ◽  
Vol 45 (4) ◽  
pp. 765-765 ◽  
Author(s):  
Mauro Zago ◽  
Chiarella Sforza ◽  
Matteo Zago
Keyword(s):  
Proficiency Assessment ◽  
Assessment Metrics ◽  
Fast Exam

Pilot Project: Does formal bedside training of medical students with a FAST exam increase their knowledge and comfort level with ultrasound use in a community family medicine practice setting?

POCUS Journal ◽  
2017 ◽  
Vol 2 (2) ◽  
pp. 15-17
Author(s):  
Rimi Sambi, MD ◽  
Heather Sawula, MD ◽  
Brent Wolfrom, MD ◽  
Joseph Newbigging, MD
Keyword(s):  
Medical Students ◽  
Family Medicine ◽  
Point Of Care ◽  
Training Session ◽  
Undergraduate Curriculum ◽  
Knowledge Retention ◽  
Comfort Level ◽  
Point Of Care Ultrasound ◽  
Medical Undergraduate ◽  
Fast Exam

As point of care ultrasound (PoCUS) becomes increasingly popular and a standard of care in many clinical settings, the interest for integration in medical undergraduate curriculum is also growing [1]. This project aims to assess whether formal bedside Focused Abdominal Scan for Trauma (FAST) exam training of medical students increases their knowledge and comfort with the use of bedside ultrasound in a family medicine setting at Queen’s University. Third year medical students (n=18) were recruited to participate in a training session involving a 1-hour online video and 2-hour hands-on session. Knowledge based surveys were completed before and after the training. A survey was completed 4 months after the teaching session evaluating knowledge retention, comfort, and application of skills. Student knowledge of PoCUS and FAST increased and was maintained (pre-training 56%±20%, post-training 82%±10%, p<0.001). Self-evaluation of comfort performing a FAST examination (5-point Likert scale) similarly increased post-training session (pre-training 1.4±0.8, post-training 3.8±0.9, p<0.005), but decreased 4 months later (3±1.2, p<0.005). Students in this study were unanimously interested in ultrasound training and the methods used effectively increased theoretical knowledge and comfort with use. Students did not retain their comfort levels with FAST exam 4 months after the training session, nor did they have the opportunity to utilize the skills learned. Further evidence is required to identify the applicability of these results to undergraduate curriculum development.

scholarly journals Objective Assessment Metrics for Central Line Simulators: An Exploration of Causal Factors

2020 ◽  
Vol 64 (1) ◽  
pp. 2008-2012
Author(s):  
Jessica M. Gonzalez-Vargas ◽  
Dailen C. Brown ◽  
Jason Z. Moore ◽  
David C. Han ◽  
Elizabeth H. Sinz ◽  
...  
Keyword(s):  
Central Venous Catheterization ◽  
Objective Assessment ◽  
Central Line ◽  
Expert Interviews ◽  
Central Venous ◽  
Patient Case ◽  
Causal Factors ◽  
Venous Catheterization ◽  
Assessment Metrics ◽  
Automated Feedback

The Dynamic Haptic Robotic Trainer (DHRT) was developed to minimize the up to 39% of adverse effects experienced by patients during Central Venous Catheterization (CVC) by standardizing CVC training, and provide automated assessments of performance. Specifically, this system was developed to replace manikin trainers that only simulate one patient anatomy and require a trained preceptor to evaluate the trainees’ performance. While the DHRT system provides automated feedback, the utility of this system with real-world scenarios and expertise has yet to be thoroughly investigated. Thus, the current study was developed to determine the validity of the current objective assessment metrics incorporated in the DHRT system through expert interviews. The main findings from this study are that experts do agree on perceptions of patient case difficulty, and that characterizations of patient case difficulty is based on anatomical characteristics, multiple needle insertions, and prior catheterization.

scholarly journals Assessing and Benchmarking Learning Outcomes of Robotics-Enabled STEM Education

2021 ◽  
Vol 11 (2) ◽  
pp. 84
Author(s):  
S. M. Mizanoor Rahman
Keyword(s):  
Learning Outcomes ◽  
Science Teachers ◽  
Stem Education ◽  
User Study ◽  
Research Approach ◽  
Traditional Teaching ◽  
Assessment Metrics ◽  
Social Scientific ◽  
Survey Responses ◽  
Mathematics And Science Teachers

Experienced middle school mathematics and science teachers were recruited for a pilot study. The teachers separately responded to a survey related to determining expected learning outcomes based on their traditional teaching, classroom experiences and observations, and self-brainstorming. The teachers then received training on how to design, develop, and implement robotics-enabled lessons under a design-based research approach for experiential learning, and taught robotics-enabled lessons to a selected student population in classroom settings. The teachers then responded to the survey for the robotics-enabled teaching. For each case (traditional and robotics-enabled), the survey responses were analyzed, and a set of expected learning outcomes of math and science lessons was derived separately. The thematic analysis results showed that the expected learning outcomes for the robotics-enabled lessons were not only related to the educational gains (content knowledge) observed in traditional teaching, but also to the improvements in the behavioral, social, scientific, cognitive, and intellectual aptitudes of the students. Then, a set of metrics and methods were proposed for assessing the learning outcomes separately. To validate the assessment metrics and methods, teachers from different schools taught two selected robotics-enabled lessons (one math, one science) to same grade students, and separately assessed the learning outcomes of each student using the proposed metrics and methods. The learning outcomes were then compared and benchmarked between schools and subjects. The results of a user study with the teachers showed user acceptance, effectiveness, and suitability of the assessment metrics and methods. The proposed scheme of assessing learning outcomes can be used to assess and justify the benefits and advantages of robotics-enabled STEM education, benchmark the outcomes, help improve teaching preparations, motivate decision-makers to confer on robotics-enabled STEM education and curricula development, and promote robotics-enabled STEM education.

Sign in / Sign up

Export Citation Format

Share Document