scholarly journals Investigating the Impact of a Multiple Choice Questions Standardization Workshop on the Performance and Satisfaction of Nursing and Midwifery Faculty Members for Designing the Final Examination Questions and Student Satisfaction in Zanjan University of Medical Sciences

2020 ◽  
Vol 13 (38) ◽  
pp. 65-75
Author(s):  
azam maleki ◽  
zeinab ghahremani ◽  
fatemeh gorbani ◽  
◽  
◽  
...  
Author(s):  
Shiva Soraya ◽  
Amir Shabani ◽  
Leila Kamalzadeh ◽  
Fatemeh Kashaninasab ◽  
Vahid Rashedi ◽  
...  

Background:  Multiple-choice questions are among the most common written tests. This study aimed to evaluate the faculty members’ability to determine and predict the level of difficulty and discrimination coefficient of multiple-choice tests at Psychiatry Department. Methods: All faculty members at Psychiatry Department of Iran University of Medical Sciences participated in this study. The difficulty and discrimination coefficient of all questions (150 questions) of the mid-term exam of psychiatric residents were measured with both software program and formulas by hand. Then, from each group of questions with high, medium, and low difficulty coefficient, 10 questions (30 questions in total) were selected and provided to faculty members for ranking each question in terms of difficulty and discrimination coefficient. Finally, the correlation between faculty members’ evaluation and standard results was measured by the Spearman’s correlation. To calculate the discrimination coefficient, the number of people who answered a question correctly in the low-score group was subtracted from the high-score group and then the result was divided by the number of people in a group. Results: Twenty-five faculty members participated in this study. There was a significant negative correlation between difficulty level and discrimination coefficient in the whole group (r=-0.196, p=0.045), but this was not the case in the upper and lower groups (r=-0.063, p=0.733). In addition, the correlation between the discrimination coefficient obtained from the formula and the average discrimination coefficient of faculty members was not significant (r=-0.047, p=0.803). Conclusion: It seems that the ability of faculty members to predict the discrimination coefficient and difficulty level of questions is not sufficient.


2009 ◽  
Vol 37 (1) ◽  
pp. 74-78 ◽  
Author(s):  
L. Nunnink ◽  
A.-M. Welsh ◽  
M. Abbey ◽  
C. Buschel

Emergency chest reopen of the post cardiac surgical patient in the intensive care unit is a high-stakes but infrequent procedure which requires a high-level team response and a unique skill set. We evaluated the impact on knowledge and confidence of team-based chest reopen training using a patient simulator compared with standard video-based training. We evaluated 49 medical and nursing participants before and after training using a multiple choice questions test and a questionnaire of self-reported confidence in performing or assisting with emergency reopen. Both video- and simulation-based training significantly improved results in objective and subjective domains. Although the post-test scores did not differ between the groups for either the objective (P=0.28) or the subjective measures (P=0.92), the simulation-based training produced a numerically larger improvement in both domains. In a multiple choice question out of 10, participants improved by a mean of 1.9 marks with manikin-based training compared to 0.9 with video training (P=0.03). On a questionnaire out of 20 assessing subjective levels of confidence, scores improved by 3.9 with manikin training compared to 1.2 with video training (P=0.002). Simulation-based training appeared to be at least as effective as video-based training in improving both knowledge and confidence in post cardiac surgical emergency resternotomy.


2018 ◽  
Vol 5 (suppl_1) ◽  
pp. S401-S401
Author(s):  
Jennifer O Spicer ◽  
Varun K Phadke

Abstract Background In medical education, there has been a push to implement innovative teaching techniques that encourage critical thinking rather than just knowledge dissemination. Debate promotes critical thinking by challenging individuals to consider alternate viewpoints, which could make it an ideal format to review the evidence relevant to common clinical dilemmas in infectious diseases (ID). We describe a pilot of one such debate format in our ID fellowship program. Methods We reviewed literature regarding the effectiveness of ceftriaxone for outpatient antibiotic therapy (OPAT) in methicillin-susceptible Staphylococcus aureus (MSSA) osteoarticular infections. The evidence was presented as a structured debate in place of our weekly case conference. Pre- and post-session surveys containing multiple choice questions and Likert items were administered to assess the impact of the debate on attendees’ knowledge, attitudes, and practices on this topic along with their attitudes toward the debate format. Differences between pre- and post-session surveys were analyzed using paired t-tests and McNemar’s test. Results At the first debate 33 residents, fellows, and faculty members were present, and 24 (73%) completed both the pre- and post-session surveys. Attendees demonstrated significant improvement between the pre- and post-session knowledge questions, which covered the following topics: study design of articles supporting ceftriaxone use (31% vs. 62%, P = 0.008), appropriate method to assess ceftriaxone susceptibility (64% vs. 100%, P = 0.004), and whether the inoculum effect applies to ceftriaxone (35% vs. 77%, P = 0.003). After the debate, attendees were more willing to use ceftriaxone (P = 0.001) and felt more familiar with the literature (P < 0.001). The post-session survey showed that individuals both enjoyed the format and found it effective (Figure 1). Most individuals stated that they were either extremely likely (85%) or likely (8%) to attend if this format was used again. Written comments included “strongly recommend continuing this format” and “much better than regular case conference with more discussion and critical thinking.” Conclusion Debate appears to be an effective and enjoyable format to teach clinical controversies in ID. Disclosures All authors: No reported disclosures.


2021 ◽  
pp. 73-77

In this account we report a study that surveyed and quantified the opinion on the acceptability of genetically modified (GM) crops by farmers working in Szabolcs-Szatmár-Bereg County located in North Easter Hungary. Authors answered the question whether there is a difference in perception and reasoning of the county’s agricultural workers regarding GM crops. We evaluated the impact of age, gender, education, and agricultural education of responders on rating GM plants to be more dangerous than traditional crops. Is there a relevant difference when responders are administered multiple choice questions, rather than single choice questions? Can we change farmers’ position on the GM technology by using multiple choice questions?


2020 ◽  
Vol 1 (2) ◽  
pp. 1-7
Author(s):  
Erni Kurniati ◽  
Soeprijanto ◽  
Irzan Zakir

Abstract This research has the purpose to knowing the value of the lighting level in the room at primary school, is in conformity with applicable regulations or not and to knowing teacher’s knowledge and understanding level about the school lighting system. This research conducted in May until July 2016 at primary school in Kelurahan Rawamangun, East Jakarta. This research is quantitative descriptive with survey method. The sampling technique used in this research is random purposive sampling, where purposive that schools are not taken in a period of improvement and the respondent teachers are permanent teachers. Samples taken random with a degree of error of ± 10 %, so sample taken is 10 schools and 80 teachers. The results of this research is a translation percentage descriptive of the data suitability lighting levels at one to six classrooms, a teachers' room, library and science laboratories when sunny weather use the lights and do not use lights. And data of teacher’s understanding of school lighting system, which divided into five dimensions is healthy condition in classrooms, the lighting in the classrooms, electrical energy-saving concept of the school, the impact of lighting on health and health dan safety in the classroom as stated in 15 item multiple-choice questions. The results of this research stated that 10 schools have measured lighting levels can be concluded that the 0 % suitability rate of illumination for the one classroom, second classroom, third classroom, fourth classroom and science laboratories, 10 % suitability for the five classroom, six classroom dan teacher’s room when using the lights and do not use the lights. And suitability for the library is 11.1 % when not using lights and 12.5 % when using light. And from the research data of objective tests 15 item multiple-choice question for teacher's understanding can be concluded that the percentage of comprehension for the dimensions of healthy condition in classroom is 83.33 %, the dimensions of the lighting in the classroom is 40.416 % , the dimensions of the electrical energy-saving concept of the school is 92.5 % , dimensions of the impact of lighting on health is 68.75 % , and the dimensions of health and safety in the classroom is 49.58 % . There are several dimensions that are not understood by the teacher’s, because it need an advanced program for theacher’s follow-up to can better understand the kind of school lighting system. Abstrak Penelitian ini bertujuan untuk mengetahui nilai tingkat pencahayaan pada ruang-ruang sekolah dasar apakah sudah sesuai dengan ketentuan yang berlaku dan untuk mengetahui tingkat pemahaman guru mengenai sistem pencahayaan sekolah. Penelitian ini dilaksanakan pada bulan Mei sampai dengan bulan Juli 2016 di sekolah dasar di lingkungan kelurahan Rawamangun, Jakarta Timur. Penelitian ini merupakan penelitian kuntitatif deskriptif dengan menggunakan metode survei. Teknik pengambilan sampel yang digunakan dalam penelitian ini yaitu teknik acak dengan pertimbangan tertentu (random purposive sampling), dimana pertimbangannya yaitu sekolah yang diambil tidak dalam masa perbaikan dan responden guru-guru merupakan guru tetap. Sampel pada penelitian ini diambil secara acak (random) dengan taraf kesalahan penelitian ±10 %, sehingga jumlah sampel yang diambil yaitu sebanyak 10 sekolah dan 80 orang guru-guru Hasil penelitian ini berupa penjabaran secara persentase deskriptif mengenai data kesesuaian tingkat pencahayaan pada ruang kelas satu sampai enam, ruang guru, perpustakaan dan laboratorium IPA saat cuaca cerah menggunakan lampu dan tidak menggunakan lampu. Serta data pemahaman responden guru-guru tentang sistem pencahayaan sekolah yang terjabarkan dalam lima dimensi yaitu kondisi ruang belajar yang sehat, pencahayaan pada ruang belajar, konsep hemat energi listrik sekolah, dampak pencahayaan terhadap kesehatan dan kesehatan dan keselamatan kerja pada ruang belajar yang tertuang dalam 15 item pertanyaan pilihan ganda. Hasil penelitian ini menyatakan bahwa dari 10 sekolah yang diukur tingkat pencahayaan didapatkan kesimpulan bahwa 0% kesesuaian tingkat pencahayaan untuk ruang kelas satu, kelas dua, kelas tiga, kelas empat dan ruang laboratorium IPA, 10 % kesesuaian untuk ruang kelas lima, ruang kelas enam dan ruang guru baik saat menggunakan lampu dan tidak menggunakan lampu. Untuk ruang perpustakaan yaitu 11.1 % kesesuaiannya saat tidak menggunakan lampu dan 12.5 % kesesuaiannya saat menggunakan lampu. Dari data hasil penelitian tes objektif berbentuk pilihan ganda 15 item pertanyaan untuk pemahaman guru dapat ditarik kesimpulan bahwa persentase pemahaman untuk dimensi kondisi ruang belajar yang sehat yaitu 83.33%, dimensi pencahayaan pada ruang belajar yaitu 40.416%, dimensi konsep hemat energi listrik sekolah yaitu 92.5%, dimensi dampak pencahayaan terhadap kesehatan yaitu 68.75%, dan dimensi kesehatan dan keselamatan kerja pada ruang belajar yaitu 49.58%. Masih terdapat beberapa dimensi yang tidak dipahami oleh guru dengan baik oleh karena itu perlu diadakan sebuah program lanjutan agar guru-guru dapat lebih memahami sistem pencahayaan yang baik pada sekolah.


Author(s):  
Dwi Yunita ◽  
Astuti Wijayanti

This research is aimed to know the impact of using video as a media toward the learning result of sciences for students in class VII in SMPN 1 Turi on 2016/2017 which is looked by the student’s creativity. This research is quasi experiment. The object of this research is the student’s result. The technique of data collection is using test, questioner and documentation techniques. Instrument test is containing with 30 multiple-choice questions, and questioner instrument is containing with 20 statements. As the result, the researcher obtained Fcalculate = 19,747 and p = 0,000, the average of learning result is 20,78, the average of questioner is 60,09. Based on the average of learning result and questioner, then there is an impact by video as a media toward the learning result of sciences for students in class VII which is looked by the student’s creativity.


Author(s):  
Amit P. Date ◽  
Archana S. Borkar ◽  
Rupesh T. Badwaik ◽  
Riaz A. Siddiqui ◽  
Tanaji R. Shende ◽  
...  

Background: Multiple choice questions (MCQs) are a common method for formative and summative assessment of medical students. Item analysis enables identifying good MCQs based on difficulty index (DIF I), discrimination index (DI), distracter efficiency (DE). The objective of this study was to assess the quality of MCQs currently in use in pharmacology by item analysis and develop a MCQ bank with quality items.Methods: This cross-sectional study was conducted in 148 second year MBBS students at NKP Salve institute of medical sciences from January 2018 to August 2018. Forty MCQs twenty each from the two term examination of pharmacology were taken for item analysis A correct response to an item was awarded one mark and each incorrect response was awarded zero. Each item was analyzed using Microsoft excel sheet for three parameters such as DIF I, DI, and DE.Results: In present study mean and standard deviation (SD) for Difficulty index (%) Discrimination index (%) and Distractor efficiency (%) were 64.54±19.63, 0.26±0.16 and 66.54±34.59 respectively. Out of 40 items large number of MCQs has acceptable level of DIF (70%) and good in discriminating higher and lower ability students DI (77.5%). Distractor efficiency related to presence of zero or 1 non-functional distrator (NFD) is 80%.Conclusions: The study showed that item analysis is a valid tool to identify quality items which regularly incorporated can help to develop a very useful, valid and a reliable question bank.


2021 ◽  
Vol 45 (1) ◽  
pp. 182-190
Author(s):  
Justin W. Merry ◽  
Mary Kate Elenchin ◽  
Renee N. Surma

Multiple choice exams are ubiquitous, but advice on test-taking strategies varies and is not always well informed by research. This study evaluated the question of whether students benefit or are harmed when they change their initial answers on multiple choice questions in the context of physiology and biology courses. Previously marked examinations were reviewed for eraser marks that indicated answer changes, and the impact of these changes on exam grades was tabulated. In addition, faculty and students were surveyed for their opinions about changing answers. A plurality of faculty (36%) reported a belief that answer changes usually harm student grades, whereas a slim majority of students (51%) believed that answer changing helped their scores (χ2 = 60.52, P < 0.0001). Empirically, across two exams, students changed their answer from an incorrect answer to a correct one 2.8 times (SD 2.2) compared with 1.0 time (SD 1.4) changing in the negative direction. Therefore, on average, students benefited ( V =  123.5, P < 0.0001) from answer changing. Furthermore, comparing across two exams in the same course, some students were consistently more likely to change their answers than others (adjusted R2= 0.23, P < 0.0001), but the impact of changing answers on the first exam provided no prediction of how much a student would benefit from answer changing on the second exam (adjusted R2= −0.004, P = 0.42). These data support the argument that students should be advised to review and revise responses to exam questions before submitting them.


Sign in / Sign up

Export Citation Format

Share Document