scholarly journals Performance of the Ebel standard-setting method for the spring 2019 Royal College of Physicians and Surgeons of Canada internal medicine certification examination consisting of multiple-choice questions

Author(s):  
Jimmy Bourque ◽  
Haley Skinner ◽  
Jonathan Dupré ◽  
Maria Bacchus ◽  
Martha Ainslie ◽  
...  

Purpose: This study aimed to assess the performance of the Ebel standard-setting method for the spring 2019 Royal College of Physicians and Surgeons of Canada internal medicine certification examination consisting of multiple-choice questions. Specifically, the following parameters were evaluated: inter-rater agreement, the correlations between Ebel scores and item facility indices, the impact of raters’ knowledge of correct answers on the Ebel score, and the effects of raters’ specialty on inter-rater agreement and Ebel scores.Methods: Data were drawn from a Royal College of Physicians and Surgeons of Canada certification exam. The Ebel method was applied to 203 multiple-choice questions by 49 raters. Facility indices came from 194 candidates. We computed the Fleiss kappa and the Pearson correlations between Ebel scores and item facility indices. We investigated differences in the Ebel score according to whether correct answers were provided or not and differences between internists and other specialists using the t-test.Results: The Fleiss kappa was below 0.15 for both facility and relevance. The correlation between Ebel scores and facility indices was low when correct answers were provided and negligible when they were not. The Ebel score was the same whether the correct answers were provided or not. Inter-rater agreement and Ebel scores were not significantly different between internists and other specialists.Conclusion: Inter-rater agreement and correlations between item Ebel scores and facility indices were consistently low; furthermore, raters’ knowledge of the correct answers and raters’ specialty had no effect on Ebel scores in the present setting.

1970 ◽  
Vol 11 (1) ◽  
Author(s):  
Debra Pugh MD, MHPE, FRCPC

A certification exam for the new sub-specialty of General Internal Medicine (GIM) was recently developed by an examination board at the Royal College of Physicians and Surgeons (RCPSC). The board sought to create an exam that would reflect the challenges faced by practising general internists, while minimizing repetition of material already assessed by the Internal Medicine certification exam. In this paper, the authors present evidence for the validity of the content of the exam.


2018 ◽  
Vol 12 (2) ◽  
pp. 88 ◽  
Author(s):  
Flavio Tangianu ◽  
Antonino Mazzone ◽  
Franco Berti ◽  
Giuliano Pinna ◽  
Irene Bortolotti ◽  
...  

There are many feasible tools for the assessment of clinical practice, but there is a wide consensus on the fact that the simultaneous use of several different methods could be strategic for a comprehensive overall judgment of clinical competence. Multiple-choice questions (MCQs) are a well-established reliable method of assessing knowledge. Constructing effective MCQ tests and items requires scrupulous care in the design, review and validation stages. Creating high-quality multiple-choice questions requires a very deep experience, knowledge and large amount of time. Hereby, after reviewing their construction, strengths and limitations, we debate their completeness for the assessment of professional competence.


2009 ◽  
Vol 37 (1) ◽  
pp. 74-78 ◽  
Author(s):  
L. Nunnink ◽  
A.-M. Welsh ◽  
M. Abbey ◽  
C. Buschel

Emergency chest reopen of the post cardiac surgical patient in the intensive care unit is a high-stakes but infrequent procedure which requires a high-level team response and a unique skill set. We evaluated the impact on knowledge and confidence of team-based chest reopen training using a patient simulator compared with standard video-based training. We evaluated 49 medical and nursing participants before and after training using a multiple choice questions test and a questionnaire of self-reported confidence in performing or assisting with emergency reopen. Both video- and simulation-based training significantly improved results in objective and subjective domains. Although the post-test scores did not differ between the groups for either the objective (P=0.28) or the subjective measures (P=0.92), the simulation-based training produced a numerically larger improvement in both domains. In a multiple choice question out of 10, participants improved by a mean of 1.9 marks with manikin-based training compared to 0.9 with video training (P=0.03). On a questionnaire out of 20 assessing subjective levels of confidence, scores improved by 3.9 with manikin training compared to 1.2 with video training (P=0.002). Simulation-based training appeared to be at least as effective as video-based training in improving both knowledge and confidence in post cardiac surgical emergency resternotomy.


Pediatric Anesthesiology: A Comprehensive Board Review is a high-yield, streamlined study aid. It contains more than 800, realistic, multiple-choice questions tailored to the keywords in the outline of the Pediatric Anesthesiology Certification Examination published by the American Board of Anesthesiology (ABA). To maximize reading efficiency, annotated answers are followed by bulleted key facts and key references. With this book as guide, readers will be able to efficiently prepare for the written primary certification pediatric anesthesiology board exam.


2021 ◽  
pp. 73-77

In this account we report a study that surveyed and quantified the opinion on the acceptability of genetically modified (GM) crops by farmers working in Szabolcs-Szatmár-Bereg County located in North Easter Hungary. Authors answered the question whether there is a difference in perception and reasoning of the county’s agricultural workers regarding GM crops. We evaluated the impact of age, gender, education, and agricultural education of responders on rating GM plants to be more dangerous than traditional crops. Is there a relevant difference when responders are administered multiple choice questions, rather than single choice questions? Can we change farmers’ position on the GM technology by using multiple choice questions?


2020 ◽  
Vol 1 (2) ◽  
pp. 1-7
Author(s):  
Erni Kurniati ◽  
Soeprijanto ◽  
Irzan Zakir

Abstract This research has the purpose to knowing the value of the lighting level in the room at primary school, is in conformity with applicable regulations or not and to knowing teacher’s knowledge and understanding level about the school lighting system. This research conducted in May until July 2016 at primary school in Kelurahan Rawamangun, East Jakarta. This research is quantitative descriptive with survey method. The sampling technique used in this research is random purposive sampling, where purposive that schools are not taken in a period of improvement and the respondent teachers are permanent teachers. Samples taken random with a degree of error of ± 10 %, so sample taken is 10 schools and 80 teachers. The results of this research is a translation percentage descriptive of the data suitability lighting levels at one to six classrooms, a teachers' room, library and science laboratories when sunny weather use the lights and do not use lights. And data of teacher’s understanding of school lighting system, which divided into five dimensions is healthy condition in classrooms, the lighting in the classrooms, electrical energy-saving concept of the school, the impact of lighting on health and health dan safety in the classroom as stated in 15 item multiple-choice questions. The results of this research stated that 10 schools have measured lighting levels can be concluded that the 0 % suitability rate of illumination for the one classroom, second classroom, third classroom, fourth classroom and science laboratories, 10 % suitability for the five classroom, six classroom dan teacher’s room when using the lights and do not use the lights. And suitability for the library is 11.1 % when not using lights and 12.5 % when using light. And from the research data of objective tests 15 item multiple-choice question for teacher's understanding can be concluded that the percentage of comprehension for the dimensions of healthy condition in classroom is 83.33 %, the dimensions of the lighting in the classroom is 40.416 % , the dimensions of the electrical energy-saving concept of the school is 92.5 % , dimensions of the impact of lighting on health is 68.75 % , and the dimensions of health and safety in the classroom is 49.58 % . There are several dimensions that are not understood by the teacher’s, because it need an advanced program for theacher’s follow-up to can better understand the kind of school lighting system. Abstrak Penelitian ini bertujuan untuk mengetahui nilai tingkat pencahayaan pada ruang-ruang sekolah dasar apakah sudah sesuai dengan ketentuan yang berlaku dan untuk mengetahui tingkat pemahaman guru mengenai sistem pencahayaan sekolah. Penelitian ini dilaksanakan pada bulan Mei sampai dengan bulan Juli 2016 di sekolah dasar di lingkungan kelurahan Rawamangun, Jakarta Timur. Penelitian ini merupakan penelitian kuntitatif deskriptif dengan menggunakan metode survei. Teknik pengambilan sampel yang digunakan dalam penelitian ini yaitu teknik acak dengan pertimbangan tertentu (random purposive sampling), dimana pertimbangannya yaitu sekolah yang diambil tidak dalam masa perbaikan dan responden guru-guru merupakan guru tetap. Sampel pada penelitian ini diambil secara acak (random) dengan taraf kesalahan penelitian ±10 %, sehingga jumlah sampel yang diambil yaitu sebanyak 10 sekolah dan 80 orang guru-guru Hasil penelitian ini berupa penjabaran secara persentase deskriptif mengenai data kesesuaian tingkat pencahayaan pada ruang kelas satu sampai enam, ruang guru, perpustakaan dan laboratorium IPA saat cuaca cerah menggunakan lampu dan tidak menggunakan lampu. Serta data pemahaman responden guru-guru tentang sistem pencahayaan sekolah yang terjabarkan dalam lima dimensi yaitu kondisi ruang belajar yang sehat, pencahayaan pada ruang belajar, konsep hemat energi listrik sekolah, dampak pencahayaan terhadap kesehatan dan kesehatan dan keselamatan kerja pada ruang belajar yang tertuang dalam 15 item pertanyaan pilihan ganda. Hasil penelitian ini menyatakan bahwa dari 10 sekolah yang diukur tingkat pencahayaan didapatkan kesimpulan bahwa 0% kesesuaian tingkat pencahayaan untuk ruang kelas satu, kelas dua, kelas tiga, kelas empat dan ruang laboratorium IPA, 10 % kesesuaian untuk ruang kelas lima, ruang kelas enam dan ruang guru baik saat menggunakan lampu dan tidak menggunakan lampu. Untuk ruang perpustakaan yaitu 11.1 % kesesuaiannya saat tidak menggunakan lampu dan 12.5 % kesesuaiannya saat menggunakan lampu. Dari data hasil penelitian tes objektif berbentuk pilihan ganda 15 item pertanyaan untuk pemahaman guru dapat ditarik kesimpulan bahwa persentase pemahaman untuk dimensi kondisi ruang belajar yang sehat yaitu 83.33%, dimensi pencahayaan pada ruang belajar yaitu 40.416%, dimensi konsep hemat energi listrik sekolah yaitu 92.5%, dimensi dampak pencahayaan terhadap kesehatan yaitu 68.75%, dan dimensi kesehatan dan keselamatan kerja pada ruang belajar yaitu 49.58%. Masih terdapat beberapa dimensi yang tidak dipahami oleh guru dengan baik oleh karena itu perlu diadakan sebuah program lanjutan agar guru-guru dapat lebih memahami sistem pencahayaan yang baik pada sekolah.


Author(s):  
Dwi Yunita ◽  
Astuti Wijayanti

This research is aimed to know the impact of using video as a media toward the learning result of sciences for students in class VII in SMPN 1 Turi on 2016/2017 which is looked by the student’s creativity. This research is quasi experiment. The object of this research is the student’s result. The technique of data collection is using test, questioner and documentation techniques. Instrument test is containing with 30 multiple-choice questions, and questioner instrument is containing with 20 statements. As the result, the researcher obtained Fcalculate = 19,747 and p = 0,000, the average of learning result is 20,78, the average of questioner is 60,09. Based on the average of learning result and questioner, then there is an impact by video as a media toward the learning result of sciences for students in class VII which is looked by the student’s creativity.


Sign in / Sign up

Export Citation Format

Share Document