scholarly journals Using Item Analysis to Assess Objectively the Quality of the Calgary-Cambridge OSCE Checklist

2011 ◽  
Vol 2 (1) ◽  
pp. e16-e22 ◽  
Author(s):  
Tyrone Donnon ◽  
Murray Lee ◽  
Sarah Cairncross

Background:  The purpose of this study was to investigate the use of item analysis to assess objectively the quality of items on the Calgary-Cambridge Communications OSCE checklist.Methods:  A total of 150 first year medical students were provided with extensive teaching on the use of the Calgary-Cambridge Guidelines for interviewing patients and participated in a final year end 20 minute communication OSCE station.  Grouped into either the upper half (50%) or lower half (50%) communication skills performance groups, discrimination, difficulty and point biserial values were calculated for each checklist item.Results:  The mean score on the 33 item communication checklist was 24.09 (SD = 4.46) and the internal reliability coefficient was ? = 0.77. Although most of the items were found to have moderate (k = 12, 36%) or excellent (k = 10, 30%) discrimination values, there were 6 (18%) identified as ‘fair’ and 3 (9%) as ‘poor’. A post-examination review focused on item analysis findings resulted in an increase in checklist reliability (? = 0.80).Conclusions:  Item analysis has been used with MCQ exams extensively. In this study, it was also found to be an objective and practical approach to use in evaluating the quality of a standardized OSCE checklist.

2021 ◽  
Author(s):  
Aidos K. Bolatov

Abstract The study aimed to investigate the relationships between academic motivation and the psychological well-being of 1st-year medical students during the COVID-19 pandemic. The total number of respondents in the cross-sectional study was 273. Intrinsic motivation was positively correlated with fear of COVID-19 and negatively correlated with psychological collapse and negative changes in quality of life due to the COVID-19. Extrinsic motivation positively associated with fear of COVID-19. Amotivation positively correlated with psychological collapse and negative changes in quality of life. In conclusion, COVID-19-related changes in quality of life and psychological destruction were predictors of academic motivation among 1st-year medical students.


2020 ◽  
Vol 06 (01) ◽  
pp. E7-E13
Author(s):  
Fauzia Nausheen ◽  
Corey Young ◽  
John Brazil ◽  
Timothy Dunagan ◽  
Renu Bhupathy ◽  
...  

AbstractDetermine the confidence level and ability of first year medical students to identify abdominal structures using a wireless portable ultrasound scanner.The students were assessed for their confidence and ability to perform abdominal ultrasound. The 5-point Likert survey included questions on their perception about ultrasound as a resource for learning anatomy, physical examination skills, and the quality of the pre-session instructions. Data was also recorded by the faculty about the students’ ultrasound skills and confidence. Goodman and Kruskal's gamma was used to demonstrate an association between the students’ ability to identify the structures and the self-reported student confidence level. Most of the students had confidence and were able to identify the liver, kidney, and urinary bladder, while almost half of them needed faculty help them to identify the inferior vena cava and aorta. The spleen and gall bladder were the most difficult to locate even for the very confident students. The perception of supervising faculty was that the confidence level was low in most of the students and only 13–20% of students felt “very confident” about performing ultrasound. Almost 37% needed encouragement and support and almost 10% of the students were not willing to try to locate difficult organs. Some students started locating the ureteric jet and portal vein. Most of the students agreed that ultrasound is an excellent resource for learning anatomy and physical examination skills. All students suggested having more ultrasound sessions. Most of the students feel confident about performing ultrasound and they perceive that ultrasound can enhance their basic sciences and physical examination skills.


2020 ◽  
Vol 11 (5) ◽  
pp. 8-11
Author(s):  
Jitendra Sorout ◽  
Satyanath Reddy Kodidala ◽  
Harsha Soni ◽  
Priyanka Singh ◽  
Nirmal Sharma

Background: Newly admitted medical students experience a different curriculum, which can be a stressor and may be the reason of stress during student life. Stress may affect physiological, psychological and cognitive functions of the students. Aims and Objective: Aim of the study was to assess the effect of academic stress on physical activity level and cognitive functions in first year medical students. Materials and Methods: This observational study was conducted on 30 healthy newly admitted medical students (18 -25 years). The data was collected thrice, baseline, after two months and after four months. Stress was assessed by using DASS and Cohen perceived stress scale (PSS). GPAQ was used to estimate the physical activity level. And cognitive functions were assessed by using subjective method (MMSE questionnaire) and objective method (P300). Results: No significant difference of mean values of age, height, weight, BMI, physical activity level, DASS score, PSS and P300 latency were observed over the time to which recording was taken. The mean score of PAL represents the high physical activity. But the score of DASS and PSS represent severe and moderate stress level respectively. The significant difference was seen in the mean values of MMSE score and P300 amplitude over the time to which recording taken. Conclusion: The present study results we can conclude that students have stress during their academic period. And this stress might be helpful in potentiating the cognitive functions with the optimum physical activity.


2014 ◽  
Vol 38 (1) ◽  
pp. 42-45 ◽  
Author(s):  
Sushma Pande ◽  
Santosh Pande ◽  
Vrushali Parate ◽  
Sanket Pande ◽  
Neelam Sukhsohale

Poor awareness among medical graduates about basic life support (BLS) is a matter of great concern. The presence of a trained rescuer is the key determinant of ultimate survival from life-threatening emergencies. To achieve this goal, early exposure to such life-saving skills is the right decision to foster these skills for medical students, which can be reenforced in succeeding years. Forty-two first-year medical students participated in this study. The entire procedure consisted of faculty training, assessment of knowledge of students by a pretest questionnaire, a lecture, a demonstration, and hands-on training using a mannequin (with special emphasis on the site, depth, rate, and sustainment of uninterrupted chest compressions). Posttest 1 was conducted to assess the knowledge gained. The retention of knowledge and skills in the second year was evaluated by posttest 2 and directly observed procedural skills, respectively. Student feedback was collected on five-point Likert scale. Analysis using a Freidman test indicated the mean rank for posttest 1 (2.81) to be significantly higher than the pretest (1.26), indicating a gain in knowledge. The mean rank for posttest 2 (1.93) was lower than for posttest 1 (2.81) but was significantly higher compared with the pretest (1.26), indicating a significant retention of knowledge during the second year. Directly observed procedural skill evaluation showed that 7% students could perform all the seven steps correctly and that 74% students could perform three or more steps correctly, signifying a good retention of skill. Two students taught BLS skills to their family members as well. The results of this study suggest that the program provides students with sound basic knowledge and adequate practical skills in BLS.


Author(s):  
Novonil Deb ◽  
Poulami Roy

Background: Dunning Kruger (DK) effect refers to overestimation of one’s ability which is attributed to their inadequacy of metacognitive skills i.e., the low-performing individuals are often nescient of their incompetence which leads them to reach fallacious conclusions and make regrettable choices. Objectives of the study were to assess the degree of DK effect among the first-year medical students and to compare the associated socio-economic variables.Methods:  A descriptive cross-sectional study was conducted among the interested first-year medical students of North Bengal medical college and hospital from March 2021 to April 2021 using a questionnaire. Responses were recorded in Microsoft excel 2017, analysed, and presented in form of tables and charts following principles of descriptive statistics.Results: The overall prevalence of DK effect was found to be 78.38% among the first-year medical students. Higher prevalence was observed among females (80.28%) as compared to males (75%). Students having low study hours (79.13%), no academic achievements (77.5%), and greater hours of sleep (79.74%) manifested more predisposition to DK effect.Conclusions: In our research, we have noticed a higher DK effect among the first-year medical students, which might hamper the quality of treatment and patient care in the future. Proper orientation and counselling methods are required to overcome this phenomenon.


PRiMER ◽  
2020 ◽  
Vol 4 ◽  
Author(s):  
Catherine F. Pipas ◽  
John A. Damianos ◽  
Leah Montalbano ◽  
Allison L. Matous ◽  
Jianjun Hua ◽  
...  

Introduction: Self-care has not been traditionally taught in medical education, but the epidemic of burnout among health professionals necessitates a change in culture, and consequently a change in curriculum. Burnout begins early in training and negatively impacts health professionals, patients, and institutions. Interventions that prevent and avert burnout are necessary at all stages of a doctor’s career to assure well-being over a lifetime. Evidence-based strategies supporting both personal and system wellness have begun to emerge, but more research is needed. Methods: We present a collaborative and comprehensive wellness program: “A Culture of Wellness.” We offered this pilot jointly for first-year medical students and faculty volunteers at the Geisel School of Medicine at Dartmouth. We gave participants the following: (1) time—60 minutes per week for 8 weeks; (2) tools—weekly cases highlighting evidence-based wellness strategies; and (3) permission—opportunities to discuss and apply the strategies personally and within their community. Results: Pre- and postsurvey results show that dedicated time combined with student-faculty collaboration and application of strategies was associated with significantly lower levels of burnout and perceived stress and higher levels of mindfulness and quality of life in participants. Components of the curriculum were reported by all to add value to personal well-being. Conclusions: This pilot presents a feasible and promising model that can be reproduced at other medical schools and disseminated to enhance personal health and promote a culture of well-being among medical students and faculty.


Sign in / Sign up

Export Citation Format

Share Document