Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study

Background: Multiple choice questions (MCQs) are routinely used for formative and summative assessment in medical education. Item analysis is a process of post validation of MCQ tests, whereby items are analyzed for difficulty index, discrimination index and distractor efficiency, to obtain a range of items of varying difficulty and discrimination indices. This study was done to understand the process of item analysis and analyze MCQ test so that a valid and reliable MCQ bank in otorhinolaryngology is developed.Methods: 158 students of 7th Semester were given an 8 item MCQ test. Based on the marks achieved, the high achievers (top 33%, 52 students) and low achievers (bottom 33%, 52 students) were included in the study. The responses were tabulated in Microsoft Excel Sheet and analyzed for difficulty index, discrimination index and distractor efficiency. Results: The mean (SD) difficulty index (Diff-I) of 8 item test was 61.41% (11.81%). 5 items had a very good difficulty index (41% to 60%), while 3 items were easy (Diff-I >60%). There was no item with Diff-I <30%, i.e. a difficult item, in this test. The mean (SD) discrimination index (DI) of the test was 0.48 (0.15), and all items had very good discrimination indices of more than 0.25. Out of 24 distractors, 6 (25%) were non-functional distractors (NFDs). The mean (SD) distractor efficiency (DE) of the test was 74.62% (23.79%).Conclusions: Item analysis should be an integral and regular activity in each department so that a valid and reliable MCQ question bank is developed.

Download Full-text

Item analysis as tool to validate multiple choice question bank in pharmacology

International Journal of Basic & Clinical Pharmacology ◽

10.18203/2319-2003.ijbcp20194106 ◽

2019 ◽

Vol 8 (9) ◽

pp. 1999

Author(s):

Amit P. Date ◽

Archana S. Borkar ◽

Rupesh T. Badwaik ◽

Riaz A. Siddiqui ◽

Tanaji R. Shende ◽

...

Keyword(s):

Item Analysis ◽

Multiple Choice ◽

Incorrect Response ◽

Cross Sectional Study ◽

Discrimination Index ◽

Multiple Choice Questions ◽

Medical Sciences ◽

Cross Sectional ◽

Lower Ability ◽

Difficulty Index

Background: Multiple choice questions (MCQs) are a common method for formative and summative assessment of medical students. Item analysis enables identifying good MCQs based on difficulty index (DIF I), discrimination index (DI), distracter efficiency (DE). The objective of this study was to assess the quality of MCQs currently in use in pharmacology by item analysis and develop a MCQ bank with quality items.Methods: This cross-sectional study was conducted in 148 second year MBBS students at NKP Salve institute of medical sciences from January 2018 to August 2018. Forty MCQs twenty each from the two term examination of pharmacology were taken for item analysis A correct response to an item was awarded one mark and each incorrect response was awarded zero. Each item was analyzed using Microsoft excel sheet for three parameters such as DIF I, DI, and DE.Results: In present study mean and standard deviation (SD) for Difficulty index (%) Discrimination index (%) and Distractor efficiency (%) were 64.54±19.63, 0.26±0.16 and 66.54±34.59 respectively. Out of 40 items large number of MCQs has acceptable level of DIF (70%) and good in discriminating higher and lower ability students DI (77.5%). Distractor efficiency related to presence of zero or 1 non-functional distrator (NFD) is 80%.Conclusions: The study showed that item analysis is a valid tool to identify quality items which regularly incorporated can help to develop a very useful, valid and a reliable question bank.

Download Full-text

ANAESTHESIOLOGY AS A FUTURE SPECIALTY

Pakistan Armed Forces Medical Journal ◽

10.51253/pafmj.v71i4.3464 ◽

2021 ◽

Vol 71 (4) ◽

pp. 1152-56

Author(s):

Khalid Mahmood ◽

Asad Shamim ◽

Muhammad Umair Khan ◽

Tasneem Alam ◽

Usman Khalid ◽

...

Keyword(s):

Medical Students ◽

Study Design ◽

Multiple Choice ◽

Cross Sectional Study ◽

Response Sheet ◽

Sectional Study ◽

Multiple Choice Questions ◽

Medical Sciences ◽

Cross Sectional

Objective: To ascertain the various aspects directing the undergraduates at Quetta Institute of medical sciences towards anesthesiology as future profession/specialization. Study Design: Cross sectional study. Place and Duration of Study: Quetta Institute of Medical Sciences, Quetta Pakistan, from Mar to Apr 2019. Methodology: Study was conducted among final year medical students with the help of a printed questionnaire consisting of 15 Multiple Choice Questions. The questionnaire provided the required database to explore various factors that influence undergraduates to select their future specialization based on demography and specialty preferences. Results: A total of 65 undergraduates completed the response sheet. While 45 (68.8%) participants were females and 20 (31.2%) were males, 62 (95.4%) were single (unmarried or divorced) and had no children 63 (96.9%). Medicine proved to be the most favourate specialty with 20 (31.4%) student opting for it whereas anesthesiology was chosen by 4 (6.1%) students. Conclusion: Anesthesiology still remains a less popular choice among the medical students of Pakistan particularly Quetta Institute of Medical Sciences due to multifaceted factors. Inferior prestige of the specialty was the most significant factor in deciding against anaesthesiology.

Download Full-text

Effect of training on formulation of multiple choice questions: a cross-sectional study amongst faculty in the department of biochemistry of a Medical Institution in India

International Journal of Research in Medical Sciences ◽

10.18203/2320-6012.ijrms20162601 ◽

2016 ◽

pp. 3694-3701

Author(s):

Patke Vinay ◽

Kuyare Sunil ◽

Iyer Praveen ◽

Bhosale Yuvaraj

Keyword(s):

Multiple Choice ◽

Cross Sectional Study ◽

Medical Institution ◽

Sectional Study ◽

Multiple Choice Questions ◽

Cross Sectional

Download Full-text

Item Analysis: The impact of distractor efficiency on the discrimination power of multiple choice items

10.21203/rs.2.15899/v1 ◽

2019 ◽

Author(s):

Assad Ali Rezigalla ◽

Elwathiq Khalid Ibrahim ◽

Amar Babiker ElHussein

Keyword(s):

Item Analysis ◽

Multiple Choice ◽

Cross Sectional Study ◽

Validity And Reliability ◽

Multiple Choice Questions ◽

Discrimination Power ◽

Cross Sectional ◽

Positive Correlation ◽

Difficulty Index ◽

The Impact

Abstract Background Distractor efficiency of multiple choice item responses is a component of item analysis used by the examiners to to evaluate the credibility and functionality of the distractors.Objective To evaluate the impact of functionality (efficiency) of the distractors on difficulty and discrimination indices.Methods A cross-sectional study in which standard item analysis of an 80-item test consisted of A type MCQs was performed. Correlation and significance of variance among Difficulty index (DIF), discrimination index (DI), and distractor Efficiency (DE) were measured.Results There is a significant moderate positive correlation between difficulty index and distractor efficiency, which means there is a tendency for high difficulty index go with high distractor efficiency (and vice versa). A weak positive correlation between distractor efficiency and discrimination index.Conclusions Non-functional distractor can reduce discrimination power of multiple choice questions. More training and effort for construction of plausible options of MCQ items is essential for the validity and reliability of the tests.

Download Full-text

Item Analysis of Multiple Choice Questions at the Department of Paediatrics, Arabian Gulf University, Manama, Bahrain

Sultan Qaboos University Medical Journal [SQUMJ] ◽

10.18295/squmj.2018.18.01.011 ◽

2018 ◽

Vol 18 (1) ◽

pp. 68 ◽

Cited By ~ 5

Author(s):

Deena Kheyami ◽

Ahmed Jaradat ◽

Tareq Al-Shibani ◽

Fuad A. Ali

Keyword(s):

Item Difficulty ◽

Item Analysis ◽

Arabian Gulf ◽

Multiple Choice ◽

Cross Sectional Study ◽

Optimal Number ◽

Multiple Choice Questions ◽

Cross Sectional ◽

The Mean ◽

Difficulty Index

Objectives: The current study aimed to carry out a post-validation item analysis of multiple choice questions (MCQs) in medical examinations in order to evaluate correlations between item difficulty, item discrimination and distraction effectiveness so as to determine whether questions should be included, modified or discarded. In addition, the optimal number of options per MCQ was analysed. Methods: This cross-sectional study was performed in the Department of Paediatrics, Arabian Gulf University, Manama, Bahrain. A total of 800 MCQs and 4,000 distractors were analysed between November 2013 and June 2016. Results: The mean difficulty index ranged from 36.70–73.14%. The mean discrimination index ranged from 0.20–0.34. The mean distractor efficiency ranged from 66.50–90.00%. Of the items, 48.4%, 35.3%, 11.4%, 3.9% and 1.1% had zero, one, two, three and four nonfunctional distractors (NFDs), respectively. Using three or four rather than five options in each MCQ resulted in 95% or 83.6% of items having zero NFDs, respectively. The distractor efficiency was 91.87%, 85.83% and 64.13% for difficult, acceptable and easy items, respectively (P <0.005). Distractor efficiency was 83.33%, 83.24% and 77.56% for items with excellent, acceptable and poor discrimination, respectively (P <0.005). The average Kuder-Richardson formula 20 reliability coefficient was 0.76. Conclusion: A considerable number of the MCQ items were within acceptable ranges. However, some items needed to be discarded or revised. Using three or four rather than five options in MCQs is recommended to reduce the number of NFDs and improve the overall quality of the examination.

Download Full-text

FP1-6 Factors influencing clinician’s participation in neurosurgical research – a multicentre cross-sectional study

Journal of Neurology Neurosurgery & Psychiatry ◽

10.1136/jnnp-2019-abn.72 ◽

2019 ◽

Vol 90 (3) ◽

pp. e23.1-e23

Author(s):

A Ansaripour ◽

C Burford ◽

J Hanrahan ◽

A Korkor ◽

K Ashkan ◽

...

Keyword(s):

Clinical Practice ◽

Clinical Training ◽

Research Output ◽

Cross Sectional Study ◽

Perceived Barriers ◽

Sectional Study ◽

Multiple Choice Questions ◽

Cross Sectional ◽

Item Questionnaire ◽

Conducting Research

ObjectivesResearch remains a foundation in advancing the field of neurosurgery. We explore attitudes and perceived barriers to conducting research in neurosurgery globally.DesignA 29-item questionnaire, consisting of multiple-choice questions, Likert scales and short answers.SubjectsClinicians at various stages of the Neurosurgical career.MethodsThe questionnaire was distributed through the Society of British Neurological Surgeons (SBNS) and European Association of Neurosurgical Societies (EANS).ResultsA total of 324 responses from 29 countries consisted of Clinical Fellows (n=26), Junior Trainees (n=48), Senior Trainees (n=46), Sub-specialty Fellows (n=18), Consultants (n=128) and Professors of Neurosurgery (n=58). Whilst 83% of participants believe research is a crucial aspect of a neurosurgeons’ career, only a third (33%) believed that neurosurgery as a speciality fosters a culture that promotes research. The top three perceived barriers to conducting research were lack of time (78%), insufficient access to funding (58%) and lack of mentorship (49%). Despite these, more than 87% of participants are interested in formal academic roles with 58% willing to interrupt clinical training to pursue research opportunities. The region of clinical practice had no correlation with respondents’ research output or their perceptions towards research barriers.ConclusionsThis study identified important barriers to research, elucidating which, allows the neurosurgical community to improve integration of research into clinical practice.

Download Full-text

Orthodontic Treatment Knowledge among General Dentists and Non-orthodontic Specialists

Orthodontic Journal of Nepal ◽

10.3126/ojn.v9i1.25689 ◽

2019 ◽

Vol 9 (1) ◽

pp. 40-44

Author(s):

Asal Acharya ◽

Praveen Mishra ◽

Rabindra Man Shrestha ◽

Pooja Shah

Keyword(s):

Orthodontic Treatment ◽

Cross Sectional Study ◽

Sectional Study ◽

Multiple Choice Questions ◽

Cross Sectional ◽

Significant Difference ◽

Treatment Knowledge ◽

Treatment Concepts ◽

The Mean ◽

General Dentists

Introduction: General dentists and specialists other than orthodontist may encounter patient requiring orthodontic treatment. For proper counseling and referral, it is important that general dentists and non-orthodontic specialists have adequate level of orthodontic knowledge. Objective: To assess the knowledge of orthodontic treatment among general dentists and non-orthodontic specialists and to compare the knowledge between the two groups. Materials & Method: A descriptive cross sectional study using questionnaire was performed among 185 actively practicing general dentists and non-orthodontic specialists of Nepal. The questionnaire comprised of three parts. The first part included demographic details, second part contained 5 multiple choice questions regarding orthodontic counseling and third part integrated 18 questions for evaluating knowledge of orthodontic treatment. Each correct answer was given score 1 and every incorrect answer was scored zero in the third part of the questionnaire. Result: Among total participants, 60.5% think first orthodontic evaluation of a child should be carried out within 7 to 8 years of age and 44.3% think orthodontic treatment can even be started after 40 years of age. Around 66% of the participants think that orthodontic treatment cannot be performed in periodontally compromised cases. No significant difference was found between the mean scores of knowledge among general dentists and non-orthodontic specialists (p=0.891), or among dentists with different years of experience (p=0.644). Conclusion: There is a need for more education of orthodontic treatment concepts to the dentists who do not belong to orthodontic field for proper counseling and referral.

Download Full-text

Hubungan Pengetahuan, Dukungan Suami dan Petugas Kesehatan dengan Penggunaan Alat Kontrasespsi Bawah Kulit (AKBK) pada Pasangan Usia Subur di Lingkungan II Kelurahan Nelayan Indah Kecamatan Medan Labuhan

Jurnal Bidan Komunitas ◽

10.33085/jbk.v1i2.3935 ◽

2018 ◽

Vol 1 (2) ◽

pp. 58

Author(s):

Ida Lestari Tampubolon ◽

Jitasari Sibero Tarigan

Keyword(s):

Random Sampling ◽

Multiple Choice ◽

Cross Sectional Study ◽

Sectional Study ◽

Cross Sectional

Berdasarkan Survei Demografi dan Kesehatan Indonesia (SDKI) tercatat jumlah peserta KB suntik (27,8%), peserta Pil (13,2%), peserta IUD (6,2%), peserta Impant (4,3%), peserta MOW (3,7%), peserta Kondom (0,9%), peserta Mop (0,4%). Kontrasepsi Alat Kontrasepsi Bawah Kulit (AKBK) merupakan alat kontrasepsi yang dipasang dibawah kulit. Tujuan penelitian ini untuk mengetahui hubungan pengetahuan pasangan usia subur tentang alat kontrasepsi bawah kulit dengan penggunaan alat kontrasepsi bawah kulit (AKBK) di Lingkungan II Kelurahan Nelayan Indah Kecamatan Medan Labuhan tahun 2017. Jenis penelitian yang digunakan dalam penelitian ini adalah survei analitik dengan pendekatan cross sectional study. Penelitian ini dilakukan di Lingkungan II Kelurahan Nelayan Indah Kecamatan Medan Labuhan . Sampel diambil dengan random sampling sebanyak 65 responden. Instrumen yang digunakan adalah kuisioner yang terdiri dari 20 pertanyaan dengan multiple choice. Hasil penelitian diperoleh bahwa Ada hubungan yang signifikan pengetahuan pasangan usia subur dengan penggunaan alat kontrasepsi bawah kulit (AKBK) di Lingkungan II Kelurahan Nelayan Indah Kecamatan Medan Labuhan Tahun 2017. Hal ini ditunjukkan dengan nilai sig p = 0,002 maka p = 0,002 < 0,05. Kesimpulannya ada hubungan yang signifikan antara Pegetahuan Pasangan Usia Subur dengan Penggunaan Alat Kontrasepsi Bawah Kulit. Diharapkan bagi pasangan usia subur yang berpengetahuan kurang untuk bertanya kepada petugas kesehatan dan mencari tahu tentang macam-macam alat kontrasepsi terutama alat kontrasepsi bawah kulit (AKBK) serta efek samping maupun kerugiannya agar dapat meningkatkan pengetahuan tentang alat kontrasepsi.Kata Kunci : Pengetahuan, Pasangan Usia Subur, AKBK

Download Full-text

Student perception regarding using of MCQ’s (multiple choice questions) as a classroom assessment technique.

The Professional Medical Journal ◽

10.29309/tpmj/2019.27.01.3204 ◽

2020 ◽

Vol 27 (01) ◽

pp. 57-61

Author(s):

Saeed Ahmed ◽

Nabeel Qamar ◽

Naveed Mansoori ◽

Sajila Bano

Keyword(s):

Classroom Assessment ◽

Student Perception ◽

Clinical Skill ◽

Multiple Choice ◽

Cross Sectional Study ◽

Multiple Choice Questions ◽

Cross Sectional ◽

Assessment Technique ◽

Positive Effects ◽

Assessment Techniques

Objectives: To find out the students perception on using multiple choice questions as a classroom assessment technique. Study Design: Cross sectional Study. Setting: University of Hail, Saudi Arabia. Period: 6 months from January 2018 to June 2018. Material & Methods: At the end of each scheduled class, students are provided with four MCQ's on the same topic which was delivered in the lecture and 3 minutes were given to solve the MCQ’s. Data was collected from 4th and 6th year MBBS students. A self-structured questionnaire regarding class assessment techniques was also administered, after completion of Surgery and Clinical Skill module. Results: Out of 80 MBBS students, 50% were selected from 4th year and 6th year respectively. Response of most of the students were positive 59 (73.8%) in classroom assessment techniques effects on student discipline. Majority of the student’s 70 (87.5%) respond positive effects on student’s interest to subject and 64 (80%) reported positive effects on student’s assessment. Suggestion about participating classroom assessment technique were found to be positive in 61 (76.2%). Data was analysed by using SPSS version 20. Conclusion: Student’s perception on using multiple choice questions as a classroom assessment technique was found to be more positive.

Download Full-text