Assessing the Quality of MCQs in the Final Examination of UUM Foundation Students

2021 ◽  
Vol 12 (3) ◽  
pp. 2368-2375
Author(s):  
Nurul Syazanabinti Hishamuddin Et.al
Keyword(s):  
Multiple Choice ◽  
Multiple Choice Question ◽  
Final Examination ◽  
Student Knowledge ◽  
Final Exam ◽  
Final Exams ◽  
Discriminant Index ◽  
Difficulty Index ◽  
Selection Of

The multiple-choice question (MCQ) format is commonly used to assess student knowledge as it is able to accommodate a large number of participants. The advantages of MCQs are that they are easy to handle and the results are able to be obtained quickly. To ensure that students are effectively tested, it is important to analyse the quality of MCQs by assessing the questions or items using educational measurements. The aim of this study is to assess the quality of MCQs of final exam questions of foundation students by using the Difficulty Index and Discriminant Index. The sample for this study is the Introduction to Philosophy final exam paper which is one of the courses taken by foundation students. The analysis involves 33 graded final exams and 20 MCQ items. The findings showed that there are 3 items that are ‘good’ that can be retained, 9 items that are considered as ‘fair acceptable/not acceptable’ which can be retained or revised, and 8 items that should be revised or discarded. The results of this study show that it is important to assess the quality of items in the assessment as it is able to change the selection of items in the assessment.

scholarly journals Evaluating the Quality of Multiple Choice Question in Paediatric Dentistry Postgraduate Examinations

2019 ◽  
Vol 19 (2) ◽  
pp. 135 ◽  
Author(s):  
Mawlood Kowash ◽  
Iyad Hussein ◽  
Manal Al Halabi
Keyword(s):  
United Arab Emirates ◽  
Multiple Choice ◽  
Essential Element ◽  
Pediatric Dentistry ◽  
Paediatric Dentistry ◽  
Multiple Choice Question ◽  
Oral Diseases ◽  
Cognitive Level ◽  
Difficulty Index

ABSTRACT: Objectives: This study aimed to evaluate the quality of multiple choice question (MCQ) items in two postgraduate paediatric dentistry (PD) examinations by determining item writing flaws (IWFs), difficulty index (DI)and cognitive level. Methods: This study was conducted at Mohamed Bin Rashid University of Medicine and Health Sciences, Dubai, UAE. Virtual platform-based summative versions of the general paediatric medicine (GPM) and prevention of oral diseases (POD) examinations administered during the second semester of the 2017–2018 academic year were used. Two PD faculty members independently reviewed each question to assess IWFs, DI and cognitive level. Results: A total of 185 single best answer MCQs with 4–5 options were analysed. Most of the questions (81%) required information recall, with the remainder (19%) requiring higher levels of thinking and data explanation. The most common errors among IWFs were the use of “except” or “not” in the lead-in, tricky or unfocussed stems and opportunities for students to use convergence strategies. There were more IWFs in the GPM than the POD examination, but this was not statistically significant (P = 0.105). The MCQs in the GPM and POD examination were considered easy since the mean DIs (89.1% ± 8.9% and 76.5% ± 7.9%, respectively) were more than 70%. Conclusion: Training is an essential element of adequate MCQ writing. A general comprehensive review of all programme’s MCQs is needed to emphasise the importance of avoiding IWFs. A faculty development programme is recommended to improve question-writing skills in order to align examinations with programme learning outcomes and enhance the ability to measure student competency through questions requiring higher level thinking. Keywords: Examination Question; Student; Educational Measurement; Discriminant Analysis; Pediatric Dentistry; United Arab Emirates.

CORRELATION OF DIFFICULTY INDEX AND DISCRIMINATING INDEX IN MEDICAL STUDENT’S ASSESSMENT.

2021 ◽  
pp. 9-10
Author(s):  
Bhoomika R. Chauhan ◽  
Jayesh Vaza ◽  
Girish R. Chauhan ◽  
Pradip R. Chauhan
Keyword(s):  
Medical Students ◽  
Formative Assessment ◽  
Item Difficulty ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Discriminating Power ◽  
Good Discriminator ◽  
Difficulty Index ◽  
The Relationship

Multiple choice questions are nowadays used in competitive examination and formative assessment to assess the student's eligibility and certification.Item analysis is the process of collecting,summarizing and using information from students' responses to assess the quality of test items.Goal of the study was to identify the relationship between the item difficulty index and item discriminating index in medical student's assessment. 400 final year medical students from various medical colleges responded 200 items constructed for the study.The responses were assessed and analysed for item difficulty index and item discriminating power. Item difficulty index an item discriminating power were analysed by statical methods to identify correlation.The discriminating power of the items with difficulty index in 40%-50% was the highest. Summary and Conclusion:Items with good difficulty index in range of 30%-70% are good discriminator.

scholarly journals Quality of multiple choice questions in undergraduate pharmacology assessments in a teaching hospital of Kerala, India: an item analysis

2017 ◽  
Vol 6 (6) ◽  
pp. 1265
Author(s):  
Manju K. Nair ◽  
Dawnji S. R.
Keyword(s):  
Item Analysis ◽  
Multiple Choice ◽  
Discrimination Index ◽  
Response Type ◽  
Multiple Choice Questions ◽  
Microsoft Excel ◽  
Best Response ◽  
Difficulty Index ◽  
Upper Third

Background: Carefully constructed, high quality multiple choice questions can serve as effective tools to improve standard of teaching. This item analysis was performed to find the difficulty index, discrimination index and number of non functional distractors in single best response type questions.Methods: 40 single best response type questions with four options, each carrying one mark for the correct response, was taken for item analysis. There was no negative marking. The maximum marks was 40. Based on the scores, the evaluated answer scripts were arranged with the highest score on top and the least score at the bottom. Only the upper third and lower third were included. The response to each item was entered in Microsoft excel 2010. Difficulty index, Discrimination index and number of non functional distractors per item were calculated.Results: 40 multiple choice questions and 120 distractors were analysed in this study. 72.5% items were good with a difficulty index between 30%-70%. 25% items were difficult and 2.5% items were easy. 27.5% items showed excellent discrimination between high scoring and low scoring students. One item had a negative discrimination index (-0.1). There were 9 items with non functional distractors.Conclusions: This study emphasises the need for improving the quality of multiple choice questions. Hence repeated evaluation by item analysis and modification of non functional distractors may be performed to enhance standard of teaching in Pharmacology.

scholarly journals Evaluation of quality of life and oral health of athletes in combat sportsMücadele sporcularının ağız sağlığı ve yaşam kalitesinin değerlendirilmesi

2016 ◽  
Vol 13 (3) ◽  
pp. 5434
Author(s):  
Bahar Odabaş Özgür ◽  
Murşit Aksoy ◽  
Turgay Özgür ◽  
Ata Bora Başar ◽  
Arda Öztürk
Keyword(s):  
Quality Of Life ◽  
Health Status ◽  
Oral Health ◽  
Dental Health ◽  
Pearson Correlation ◽  
Multiple Choice ◽  
Oral Health Status ◽  
Multiple Choice Question ◽  
Combat Sports

The purpose of this study was to evaluate the oral health and quality of life of athletes in combat sports.68 elite athletes consisting of 18 men and 50 women (Age =18,63±3,61) participated in the study. Data obtained in this research were collected on 15.03.2016. The population of the research consists of elite active combat athletes in Marmara region Turkey. five-point Likert type Oral Health Impact Profile (OHIP-14) and General Oral Health Assessment Index (GOHAI) applied to participants. The scales have subsections as Functional Limitations, pain and discomfort, psychologic factors and behavioral factors. “How do you describe your oral and dental health?” multiple choice question has been asked to understand the subjects’ perception on their oral and dental health. Also “How often do you brush your teeth?” multiple choice question has been asked to understand the subjects’ teeth brushing habit. Pearson Correlation test, Mann-Whitney U test and Kruskall Wallis test in IBM SPSS 20 Software was used to analyze the statistical data. OHIP-14 and GOHAI scores were determined as 26,80±5,93 and 20,61±5,40.There was a positively strong significant correlation between each OHIP-14 and GOHAI scores. There was a positively strong significant correlation between both scores and variables of self-reported oral health status and tooth brushing habit. No significant difference was found between OHIP-14 and GOHAI scores in education or gender variables.As a result, athletes did not report any serious oral health problems. Participants mostly evaluated their oral health as “fine”. The correlation between scales shows that both scales useful to get information about oral health status and oral health related quality of life.  ÖzetBu çalışmanın amacı, mücadele sporcularının ağız sağlığı ve yaşam kalitelerini değerlendirmektir.Araştırma grubunu 18’i erkek 50’si kadın 68 elit sporcu (Yaş =18,63±3,61) oluşturdu. 15.03.2016 tarihinde verilerin toplanmaya başlandı. Bu çalışmadaki veriler anket yöntemi ile toplandı. Çalışmasının evrenini Türkiye’nin Marmara bölgesinde aktif spor yapan elit mücadele sporcuları oluşturdu. Çalışmamıza katılan sporculara 5 nokta Likert tipi Ağız Sağlığı Etkilenme Profili (OHIP-14) ve Genel Ağız Sağlığı Değerlendirme İndeksi (GOHAI) anketleri uygulandı. Anketler; fonksiyonel limitasyon, ağrı ve rahatsızlık, psikolojik etkenler ve davranışsal etkiler alt bölümlerine sahiptir. Ayrıca sporcuların ağız ve diş sağlıklarını nasıl algıladıklarını değerlendirmek için, “Ağız ve Dişeti Sağlığınızı nasıl tanımlarsınız?” çoktan seçmeli sorusu yöneltildi. Sporcuların diş fırçalama alışkanlığı ve sıklığı hakkında bilgi almak için “Diş fırçalar mısınız?” sorusu soruldu ve çoktan seçmeli bir cevap istendi. IBM SPSS Statistics 20 Paket programı kullanılarak Pearson Correlation, Kruskall Wallis ve Mann-Witney U testleri ile analizler gerçekleştirildi.OHIP-14 ve GOHAI puan ortalamaları sırasıyla 26,808±5,930 ve 20,617±5,406 olarak tespit edildi. OHIP-14 ve GOHAI skorları arasında pozitif güçlü ve istatistiksel olarak anlamlı korelasyon bulundu.OHIP-14 ve GOHAI skorları ile katılımcıların kendi ağız sağlığını tanımlamaları ve diş fırçalama alışkanlıkları arasında pozitif güçlü ve istatistiksel olarak anlamlı korelasyon bulundu.  Ayrıca, sporcuların eğitim ve cinsiyet değişkenine göre OHIP-14 ve GOHAI puanlarında anlamlı fark tespit edilmedi.Bu araştırmanın sonucunda sporcular, ağız sağlıklarına ilişkin ciddi bir sorun bildirmediler. Elde edilen skorlar sporcuların ağız sağlığı ile ilişkili yaşam kalitelerinin “iyi” olduğunu gösterdi. İki ölçek skorları arasındaki pozitif güçlü ve istatistiksel olarak anlamlı korelasyon her iki ölçeğin de sporcularda ağız sağlığı ve ağız sağlığı ile ilişkili yaşam kalitesi değerlendirilmesinde ayrı ayrı kullanılabilir olduğunu gösterdi.

scholarly journals AN ANALYSIS OF STUDENTS READING FINAL EXAMINATION BY USING ITEM ANALYSIS PROGRAM ON ELEVENTH GRADE OF SMA NEGERI 8 MEDAN

2019 ◽  
Vol 1 (1) ◽  
pp. 13-19
Author(s):  
Dewi Manalu ◽  
Kammer Tuahman Sipayung ◽  
Febrika Dwi Lestari
Keyword(s):  
Quantitative Research ◽  
Item Analysis ◽  
Multiple Choice ◽  
Final Examination ◽  
Multiple Choice Questions ◽  
Discrimination Power ◽  
Reliability Level ◽  
The Subject ◽  
Program Version

The purpose of this study was to determine the quality of the reading final examination in SMA N8 Medan grade eleventh in terms of reliability, level difficulty, discrimination power and level of distractor. This research is qualitative-quantitative research. The subject of research are the grade XI of SMA N8 Medan. Data is analyzed by ANATES program version 4.0.9. The analysis shows that: (1) items of multiple choice question that can be said as valid are 14 items ( 56%), while the invalid items amounted to 11 items ( 44%). (2) Items mutiple choice question can said as reliable because it equal 0,90 so it can said reliable. (3) items of multiple choice questions that categorized easy are 3 items (12%), satisfactory category 7 ( 28%) difficult category 2 (8%) and the other calculate categorized very easy 3 items (12%) and very difficult 3 (12%). (4) items of multiple choice questions that categorized poor are 12 items (48%),average category are 2 items (8%), good items category 1 items (4%) and excellent items are 8 items (32%).

scholarly journals Study on item and test analysis of multiple choice questions amongst undergraduate medical students

2017 ◽  
Vol 4 (5) ◽  
pp. 1562
Author(s):  
Abhijeet S. Ingale ◽  
Purushottam A. Giri ◽  
Mohan K. Doibale
Keyword(s):  
Item Analysis ◽  
Multiple Choice ◽  
Test Methods ◽  
Discrimination Index ◽  
Multiple Choice Questions ◽  
Undergraduate Medical Students ◽  
Test Quality ◽  
Test Analysis ◽  
Difficulty Index

Background: Item analysis is the process of collecting, summarizing and using information from students’ response to assess the quality of test items. However it is said that MCQs emphasize recall of factual information rather than conceptual understanding and interpretation of concepts. There is more to writing good MCQs than writing good questions. The objectives of the study was to assess the item and test quality of multiple choice questions and to deal with the learning difficulties of students, identify the low achievers in the test. Methods: The hundred MBBS students from Government medical college were examined. A test comprising of thirty MCQs was administered. All items were analysed for Difficulty Index, Discrimination Index and Distractor Efficiency. Data entered in MS Excel 2007 and SPSS 21 analysed with statistical test of significance. Results: Majority 80% items difficulty index is within acceptable range. 63% items showed excellent discrimination Index. Distractor efficiency was overall satisfactory. Conclusions: Multiple choice questions with average difficulty and also having high discriminating power with good distracter efficiency should be incorporated into student’s examination. 

scholarly journals A Pilot Study Assessing Knowledge of Clinical Signs and Physical Examination Skills in Incoming Medicine Residents

2010 ◽  
Vol 2 (2) ◽  
pp. 232-235 ◽  
Author(s):  
Subha Ramani ◽  
Brandi N. Ring ◽  
Robert Lowe ◽  
David Hunter
Keyword(s):  
Clinical Skills ◽  
Multiple Choice ◽  
Clinical Signs ◽  
Skills Training ◽  
Physical Exam ◽  
Multiple Choice Question ◽  
Internal Medicine Residents ◽  
And Performance ◽  
Physical Findings ◽  
Selection Of

Abstract Background Physical exam skills of medical trainees are declining, but most residencies do not offer systematic clinical skills teaching or assessment. Objective To assess knowledge of clinical signs and physical exam performance among incoming internal medicine residents. Method For this study, 45 incoming residents completed a multiple choice question test to assess knowledge of clinical signs. A random selection of 20 underwent a faculty-observed objective structured clinical examination (OSCE) using patients with abnormal physical findings. Mean percentage scores were computed for the multiple choice question test, overall OSCE, and the 5 individual OSCE systems. Results The mean scores were 58.4% (14.6 of 25; SD 11. 5) for the multiple choice question test and 54.7% (31.7 of 58; SD 11.0) for the overall OSCE. Mean OSCE scores by system were cardiovascular 30.0%, pulmonary 69.2%, abdominal 61.6%, neurologic 67.0%, and musculoskeletal 41.7%. Analysis of variance showed a difference in OSCE system scores (P < .001) with cardiovascular and musculoskeletal scores significantly lower than other systems. Conclusion Overall, physical exam knowledge and performance of new residents were unsatisfactory. There appears to be a pressing need for additional clinical skills training during medical school and residency training and we are planning a new clinical skills curriculum to address this deficiency.

scholarly journals Item Analysis of Multiple Choice Questions in Pharmacology

2020 ◽  
Vol 10 (2) ◽  
Author(s):  
Imtiaz Uddin ◽  
Iftikhar Uddin ◽  
Izaz Ur Rehman ◽  
Muhammad Siyar ◽  
Usman Mehboob
Keyword(s):  
Medical Education ◽  
Item Analysis ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Cross Sectional ◽  
Teaching Programme ◽  
Medical College ◽  
Item Writing ◽  
Difficulty Index

Background: MCQs type assessment in medical education is replacing old theory style. There are concerns regarding the quality of the Multiple Choice Questions.Objectives: To determine the quality of Multiple Choice Questions by item analysis. Material and Methods: Study was a cross sectional descriptive .Fifty Multiple Choice Questions in the final internal evaluation exams in 2015 of Pharmacology at Bacha khan Medical College were analyzed. The quality of each Multiple Choice Questions item was assessed by the Difficulty index (Dif.I), Discriminative Index (D.I) and Distracter Efficiency (D.E).Results: Multiple Choice Questions that were of moderate difficulty were 66%. Easy were 4% and high difficulty were 30%.Reasons for high difficult Multiple Choice Questions were analyzed as Item Writing Flaws 41%, Irreverent Difficulty 36% and C2 level 23%. Discrimination Index shows that majority of MCQs were of Excellent Level (DI greater than 0.25) i.e 52 , Good 32% . (DI=2.15-0.25), Poor 16%. MCQs Distracter Effectiveness (DE)= 4, 3,2,1 were 52%, 34%, 14%, and 0% respectively. Conclusion: Item analysis gives us different parameters with reasons to recheck MCQ pool and teaching programme. High proportions of difficult and sizable amount of poor discriminative indices MCQs were the finding in this study and need to be resolved

Sign in / Sign up

Export Citation Format

Share Document