scholarly journals Validation of the Colorado Psychiatry Evidence-Based Medicine Test

2013 ◽  
Vol 5 (3) ◽  
pp. 412-416 ◽  
Author(s):  
Brian Rothberg ◽  
Robert E. Feinstein ◽  
Gretchen Guiton
Keyword(s):  
Test Data ◽  
Evidence Based Medicine ◽  
Interrater Reliability ◽  
Evidence Based ◽  
Expert Performance ◽  
Internal Reliability ◽  
Entry Level ◽  
Fresno Test ◽  
Before And After ◽  
Based Medicine

Abstract Background Evidence-based medicine (EBM) has become an important part of residency education, yet many EBM curricula lack a valid and standardized tool to identify learners' prior knowledge and assess progress. Objective We developed an EBM examination in psychiatry to measure our effectiveness in teaching comprehensive EBM to residents. Methods We developed a psychiatry EBM test using the validated EBM Fresno Test of Competence for family medicine. The test consists of case scenarios with open-ended questions. We also developed a scoring rubric and obtained reliability with multiple raters. Fifty-seven residents provided test data after completing 3, 6, 25, or 31 EBM sessions. The number of sessions for each resident was based on their length of training in our program. Results The examination had strong interrater reliability, internal reliability, and item discrimination. Many residents showed significant improvement on their examination scores when data were compared from tests taken before and after a sequence of teaching sessions. Also, a threshold for the level of expert on the examination was established using test data from 5 EBM teacher-experts. Conclusions We successfully developed a valid and reliable EBM examination for use with psychiatry residents to measure essential EBM skills as part of a larger project to encourage EBM practice for residents in routine patient care. The test provides information on residents' knowledge in EBM from entry level concepts through expert performance. It can be used to place incoming residents in appropriate levels of an EBM curriculum and to monitor the effectiveness of EBM instruction.

scholarly journals A Study on How Using an Interactive Multimedia E-Book Improves Teachers’ Ability to Teach Evidence-Based Medicine, Depending on Their Seniority

2021 ◽  
Author(s):  
Yu-Hsuan Liao ◽  
Kuo-Shu Tang ◽  
Chih-Jen Chen ◽  
Ying-Hsien Huang ◽  
Mao-Meng Tiao
Keyword(s):  
Evidence Based Medicine ◽  
Clinical Teaching ◽  
Teaching Method ◽  
Control Group ◽  
Study Group ◽  
Evidence Based ◽  
Fresno Test ◽  
Before And After ◽  
Study Type ◽  
Based Medicine

Abstract Background Teaching evidence-based medicine (EBM) is not an easy task. The role of the electronic book (e-book) is a useful supplement to traditional methods for improving skills. Our aim is to use an e-book or PowerPoint to evaluate instructors’ teaching effects. Methods Our study group was introduced to learning evidence-based medicine (EBM) using an interactive e-book available on the Internet, while the control group used a PowerPoint presentation. We adopted the Modified Fresno test to assess EBM skills before and after their learning. EBM teaching sessions via e-book or PowerPoint were 20–30 minutes long, followed by students’ feedback. We adopted the Mann-Whitney U tests to compare teachers’ evaluation of their EBM skills and the students’ assessment of the teachers’ instruction. Results We found no difference of EBM skills between the two groups prior to their experimental learning. Physicians in the study group ranked higher in “Choose a case to explain which kind of research design is used for the study type of the question and explain your choice” (P = 0.011) and “How are the important results expressed in the articles found” (P = 0.023), which was assessed by the Modified Fresno test. Teaching effect was better in the e-book group than in the control group for the items, “I am satisfied with this lesson,” “The teaching was of high quality,” “This was a good teaching method,” and “It aroused my interest in EBM.” No difference was observed between the two groups in the physicians with more than 10 years’ experience. Conclusions The use of interactive e-books in clinical teaching can enhance teachers’ EBM skills and teaching and is thus clinically useful.

scholarly journals Validation of an Evidence-Based Medicine Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET)

2013 ◽  
Vol 5 (2) ◽  
pp. 252-256 ◽  
Author(s):  
Hans B. Kersten ◽  
John G. Frohna ◽  
Erin L. Giudice
Keyword(s):  
Internal Consistency ◽  
Evidence Based Medicine ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Evidence Based ◽  
Evaluation Tool ◽  
Intraclass Correlation Coefficients ◽  
Excellent Internal Consistency ◽  
Based Medicine

Abstract Background Competence in evidence-based medicine (EBM) is an important clinical skill. Pediatrics residents are expected to acquire competence in EBM during their education, yet few validated tools exist to assess residents' EBM skills. Objective We sought to develop a reliable tool to evaluate residents' EBM skills in the critical appraisal of a research article, the development of a written EBM critically appraised topic (CAT) synopsis, and a presentation of the findings to colleagues. Methods Instrument development used a modified Delphi technique. We defined the skills to be assessed while reviewing (1) a written CAT synopsis and (2) a resident's EBM presentation. We defined skill levels for each item using the Dreyfus and Dreyfus model of skill development and created behavioral anchors using a frame-of-reference training technique to describe performance for each skill level. We evaluated the assessment instrument's psychometric properties, including internal consistency and interrater reliability. Results The EBM Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET) is composed of 14 items that assess residents' EBM and global presentation skills. Resident presentations (N  =  27) and the corresponding written CAT synopses were evaluated using the EBM C-PET. The EBM C-PET had excellent internal consistency (Cronbach α  =  0.94). Intraclass correlation coefficients were used to assess interrater reliability. Intraclass correlation coefficients for individual items ranged from 0.31 to 0.74; the average intraclass correlation coefficients for the 14 items was 0.67. Conclusions We identified essential components of an assessment tool for an EBM CAT synopsis and presentation with excellent internal consistency and a good level of interrater reliability across 3 different institutions. The EBM C-PET is a reliable tool to document resident competence in higher-level EBM skills.

scholarly journals Evaluation of an Evidence-Based Medicine Curriculum in a PGY1 Pharmacy Residency Program Using the Fresno Test

2018 ◽  
Vol 82 (5) ◽  
pp. 6294
Author(s):  
Julie B. Cooper ◽  
Michelle Turner ◽  
Meera Patel ◽  
Jennifer Markle ◽  
Caron Amend ◽  
...  
Keyword(s):  
Residency Program ◽  
Evidence Based Medicine ◽  
Evidence Based ◽  
Fresno Test ◽  
Based Medicine

scholarly journals Brazilian version of the Fresno test of competence in Evidence-Based Medicine: a validation study

2019 ◽  
Vol 29 (1) ◽  
pp. 32295
Author(s):  
Margareth Rodrigues Salerno ◽  
Fábio Herrmann ◽  
Leticia Manoel Debon ◽  
Matheus Dorigatti Soldatelli ◽  
Gabriele Carra Forte ◽  
...  
Keyword(s):  
Medical Students ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Validation Study ◽  
Evidence Based Medicine ◽  
Evidence Based ◽  
Fresno Test ◽  
Brazilian Version ◽  
Significant Difference ◽  
Based Medicine

AIMS: To validate the Brazilian version of the Fresno test of competence in Evidence-Based Medicine.METHODS: This is a cross-sectional, validation study. Phase 1: translation of the Fresno instrument. Phase 2: validation of the translated version, which was tested in 70 undergraduate medical students. The psychometric properties evaluated were validity, internal consistency, and sensitivity to change.RESULTS: Overall, validity was adequate; most items showed a moderate to strong and significant correlation with the total score; there was an important and significant difference between both groups, with and without previous contact with Evidence-Based Medicine (median, 55 [IQ25-75, 45.2-61.7] vs. median, 18.5 [IQ25-75, 6.0-29.7]) (p <0.001). Internal consistency was also adequate (α-C 0.718), and sensitivity to change showed a considerable and significant difference between pre and post-test (median, 18.5 [IQ25-75, 6.0-29.7] vs. median, 44 [IQ25-75, 34.0-60.0]) (p <0.001).CONCLUSIONS: The Brazilian version of the Fresno test showed satisfactory psychometric properties, and it can now be used as a tool to assess the knowledge and skills of Evidence-Based Medicine in Brazilian medical students.

scholarly journals Evaluating the impact of clinical librarians on clinical questions during inpatient rounds

2018 ◽  
Vol 106 (2) ◽  
Author(s):  
Riley Brian ◽  
Nicola Orlov ◽  
Debra Werner ◽  
Shannon K. Martin ◽  
Vineet M. Arora ◽  
...  
Keyword(s):  
Evidence Based Medicine ◽  
Effective Means ◽  
Median Number ◽  
Evidence Based ◽  
Test Quality ◽  
Team Members ◽  
Fresno Test ◽  
Attending Rounds ◽  
Based Medicine ◽  
The Impact

Objective: The investigation sought to determine the effects of a clinical librarian (CL) on inpatient team clinical questioning quality and quantity, learner self-reported literature searching skills, and use of evidence-based medicine (EBM).Methods: Clinical questioning was observed over 50 days of inpatient pediatric and internal medicine attending rounds. A CL was present for 25 days and absent for 25 days. Questioning was compared between groups. Question quality was assessed by a blinded evaluator, who used a rubric adapted from the Fresno Test of Competence in Evidence-Based Medicine. Team members were surveyed to assess perceived impacts of the CL on rounds.Results: Rounds with a CL (CLR) were associated with significantly increased median number of questions asked (5 questions CLR vs. 3 NCLR; p<0.01) and answered (3 CLR vs. 2 NCLR; p<0.01) compared to rounds without a CL (NCLR). CLR were also associated with increased mean time spent asking (1.39 minutes CLR vs. 0.52 NCLR; p<0.01) and answering (2.15 minutes CLR vs. 1.05 NCLR; p=0.02) questions. Rounding time per patient was not significantly different between CLR and NCLR. Questions during CLR were 2 times higher in adapted Fresno Test quality than during NCLR (p<0.01). Select participants described how the CL’s presence improved their EBM skills and care decisions.Conclusions: Inpatient CLR were associated with more and improved clinical questioning and subjectively perceived to improve clinicians’ EBM skills. CLs may directly affect patient care; further study is required to assess this. CLs on inpatient rounds may be an effective means for clinicians to learn and use EBM skills.

Sign in / Sign up

Export Citation Format

Share Document