scholarly journals Using Multiple Choice Questions Written at Various Bloom's Taxonomy Levels to Evaluate Student Performance across a Therapeutics Sequence

2011 ◽  
Vol 2 (2) ◽  
Author(s):  
Amy M. Tiemeier ◽  
Zachary A. Stacy ◽  
John M. Burke
Keyword(s):  
Student Performance ◽  
Multiple Choice ◽  
Bloom's Taxonomy ◽  
Pharmacy Students ◽  
Original Research ◽  
Multiple Choice Questions ◽  
Bloom’S Taxonomy ◽  
Significant Difference ◽  
Cognitive Levels ◽  
Specific Number

Objective: To evaluate the results of a prospectively developed plan for using multiple choice questions (MCQs) developed at defined Bloom's levels to assess student performance across a Therapeutics sequence. Methods: Faculty were prospectively instructed to prepare a specific number of MCQs for exams in a Therapeutics sequence. Questions were distributed into one of three cognitive levels based on a modified Bloom's taxonomy, including recall, application, and analysis. Student performance on MCQs was compared between and within each Bloom's level throughout the Therapeutics sequence. In addition, correlations between MCQ performance and case performance were assessed. Results:A total of 168 pharmacy students were prospectively followed in a Therapeutics sequence over two years. The overall average MCQ score on 10 exams was 68.8%. A significant difference in student performance was observed between recall, application, and analysis domain averages (73.1%, 70.2% and 60.1%; p Conclusions: As students progress through the curriculum, faculty may need to find ways to promote recall knowledge for more advanced topics while continuing to develop their ability to apply and analyze information. Exams with well-designed MCQs that prospectively target various cognitive levels can facilitate assessment of student performance.   Type: Original Research

What faculty write versus what students see? Perspectives on multiple-choice questions using Bloom’s taxonomy

2021 ◽  
pp. 1-12
Author(s):  
Seetha U. Monrad ◽  
Nikki L. Bibler Zaidi ◽  
Karri L. Grob ◽  
Joshua B. Kurtz ◽  
Andrew W. Tai ◽  
...  
Keyword(s):  
Multiple Choice ◽  
Bloom's Taxonomy ◽  
Multiple Choice Questions ◽  
Bloom’S Taxonomy

scholarly journals Examining Bloom’s Taxonomy in Multiple Choice Questions: Students’ Approach to Questions

2021 ◽  
Author(s):  
J. K. Stringer ◽  
Sally A. Santen ◽  
Eun Lee ◽  
Meagan Rawls ◽  
Jean Bailey ◽  
...  
Keyword(s):  
Lower Order ◽  
Multiple Choice ◽  
Bloom's Taxonomy ◽  
Thinking Skills ◽  
Higher Order ◽  
Multiple Choice Questions ◽  
Analytic Thinking ◽  
Bloom’S Taxonomy ◽  
Degree Of Confidence ◽  
Clinical Reasoning Skills

Abstract Background Analytic thinking skills are important to the development of physicians. Therefore, educators and licensing boards utilize multiple-choice questions (MCQs) to assess these knowledge and skills. MCQs are written under two assumptions: that they can be written as higher or lower order according to Bloom’s taxonomy, and students will perceive questions to be the same taxonomical level as intended. This study seeks to understand the students’ approach to questions by analyzing differences in students’ perception of the Bloom’s level of MCQs in relation to their knowledge and confidence. Methods A total of 137 students responded to practice endocrine MCQs. Participants indicated the answer to the question, their interpretation of it as higher or lower order, and the degree of confidence in their response to the question. Results Although there was no significant association between students’ average performance on the content and their question classification (higher or lower), individual students who were less confident in their answer were more than five times as likely (OR = 5.49) to identify a question as higher order than their more confident peers. Students who responded incorrectly to the MCQ were 4 times as likely to identify a question as higher order than their peers who responded correctly. Conclusions The results suggest that higher performing, more confident students rely on identifying patterns (even if the question was intended to be higher order). In contrast, less confident students engage in higher-order, analytic thinking even if the question is intended to be lower order. Better understanding of the processes through which students interpret MCQs will help us to better understand the development of clinical reasoning skills.

A comparison of student performance on discipline-specific versus integrated exams in a medical school course

2013 ◽  
Vol 37 (4) ◽  
pp. 370-376 ◽  
Author(s):  
Andrew R. Thompson ◽  
Mark W. Braun ◽  
Valerie D. O'Loughlin
Keyword(s):  
Medical School ◽  
Student Performance ◽  
Bloom's Taxonomy ◽  
Integrated Instruction ◽  
Bloom’S Taxonomy ◽  
Significant Difference ◽  
Usmle Step 1 ◽  
Usmle Step ◽  
Exam Scores ◽  
The Impact

Curricular reform is a widespread trend among medical schools. Assessing the impact that pedagogical changes have on students is a vital step in review process. This study examined how a shift from discipline-focused instruction and assessment to integrated instruction and assessment affected student performance in a second-year medical school pathology course. We investigated this by comparing pathology exam scores between students exposed to traditional discipline-specific instruction and exams (DSE) versus integrated instruction and exams (IE). Exam content was controlled, and individual questions were evaluated using a modified version of Bloom's taxonomy. Additionally, we compared United States Medical Licensing Examination (USMLE) step 1 scores between DSE and IE groups. Our findings indicate that DSE students performed better than IE students on complete pathology exams. However, when exam content was controlled, exam scores were equivalent between groups. We also discovered that the integrated exams were composed of a significantly greater proportion of questions classified on the higher levels of Bloom's taxonomy and that IE students performed better on these questions overall. USMLE step 1 exam scores were similar between groups. The finding of a significant difference in content complexity between discipline-specific and integrated exams adds to recent literature indicating that there are a number of potential biases related to curricular comparison studies that must be considered. Future investigation involving larger sample sizes and multiple disciplines should be performed to explore this matter further.

Beyond Information Recall

2019 ◽  
Vol 5 ◽  
pp. 89-122
Author(s):  
J. Robert Loftis ◽  
Keyword(s):  
Decision Making ◽  
Cognitive Skills ◽  
Multiple Choice ◽  
Bloom's Taxonomy ◽  
Multiple Choice Questions ◽  
Information Recall ◽  
Bloom’S Taxonomy ◽  
Basic Facts

Multiple-choice questions have an undeserved reputation for only being able to test student recall of basic facts. In fact, well-crafted mechanically gradable questions can measure very sophisticated cognitive skills, including those engaged at the highest level of Benjamin Bloom’s taxonomy of outcomes. In this article, I argue that multiple-choice questions should be a part of the diversified assessment portfolio for most philosophy courses. I present three arguments broadly related to fairness. First, multiple-choice questions allow one to consolidate subjective decision making in a way that makes it easier to manage. Second, multiple-choice questions contribute to the diversity of an evaluation portfolio by balancing out problems with writing-based assessments. Third, by increasing the diversity of evaluations, multiple-choice questions increase the inclusiveness of the course. In the course of this argument, I provide examples of multiple-choice questions that measure sophisticated learning and advice for how to write good multiple-choice questions.

scholarly journals Writing multiple-choice questions to access the higher levels of Bloom’s taxonomy

2021 ◽  
Vol 16 ◽  
Author(s):  
Chris Adams
Keyword(s):  
Multiple Choice ◽  
Bloom's Taxonomy ◽  
Multiple Choice Questions ◽  
Online System ◽  
Socially Constructed ◽  
Bloom’S Taxonomy ◽  
The Subject

I report the implementation of an activity in which students are asked to write multiple-choice questions (MCQs) on the subject of ‘orbitals’ in order to consolidate their learning on the subject. This was facilitated using the online system PeerWise, which allows students to upload MCQs that they have written and to then answer those authored by their peers. The process of writing questions accesses the upper levels of Bloom’s taxonomy, and the discussions incorporated within the activity allow for socially constructed learning as part of the pedagogy of constructive evaluation.

Influence of type of assessment and stress on the learning outcome

2015 ◽  
Vol 8 (2) ◽  
pp. 125-144 ◽  
Author(s):  
Godson Ayertei Tetteh ◽  
Frederick Asafo-Adjei Sarpong
Keyword(s):  
Multiple Choice ◽  
Bloom's Taxonomy ◽  
Learning Outcome ◽  
Sufficient Evidence ◽  
Multiple Choice Questions ◽  
Content Type ◽  
Assessment Scores ◽  
Final Assessment ◽  
Bloom’S Taxonomy ◽  
Practical Implications

Purpose – The purpose of this paper is to explore the influence of constructivism on assessment approach, where the type of question (true or false, multiple-choice, calculation or essay) is used productively. Although the student’s approach to learning and the teacher’s approach to teaching are concepts that have been widely researched, few studies have explored how the type of assessment (true or false, multiple-choice, calculation or essay questions) and stress would manifest themselves or influence the students’ learning outcome to fulfill Bloom’s taxonomy. Multiple-choice questions have been used for efficient assessment; however, this method has been criticized for encouraging surface learning. And also some students complain of excelling in essay questions and failing in multiple-choice questions. A concern has arisen that changes may be necessary in the type of assessment that is perceived to fulfill Bloom’s taxonomy. Design/methodology/approach – Students’ learning outcomes were measured using true or false, multiple-choice, calculations or essay questions to fulfill Bloom’s taxonomy and the students’ reaction to the test questionnaire. To assess the influence of the type of assessment and the stress level factors of interest, MANOVA was used to identify whether any differences exist and to assess the extent to which these differences are significantly different, both individually and collectively. Second, to assess if the feedback information given to respondents after the mid-semester assessment was effective, the one-way ANOVA procedure was used to test the equality of means and the differences in means of the mid-semester assessment scores and the final assessment scores. Findings – Results revealed that the type of questions (true or false, multiple-choice, calculations or essay) will not significantly affect the learning outcome for each subgroup. The ANOVA results, comparing the mid-semester and final assessments, indicated that there is sufficient evidence means are not equal. Thus, the feedback given to respondents after the mid-semester assessment had a positive impact on the final assessment to actively improve student learning. Research limitations/implications – This study is restricted to students in a particular university in Ghana, and may not necessarily be applicable universally. Practical implications – The practical implications of this research is that assessments for learning, and the importance of assessment impact not only on students, but also on teachers and the literature. Originality/value – This study contributes to the literature by examining how the combination of the type of assessment (true or false, multiple-choice, calculation or essay) and stress contributes to the learning outcome.

The Effectiveness of Usage of Online Multiple Choice Questions on Student Performance in Introductory Accounting

2017 ◽  
Vol 32 (4) ◽  
pp. 1-17 ◽  
Author(s):  
Dianne Massoudi ◽  
SzeKee Koh ◽  
Phillip J. Hancock ◽  
Lucia Fung
Keyword(s):  
Online Learning ◽  
Student Performance ◽  
International Student ◽  
Multiple Choice ◽  
Financial Accounting ◽  
Accounting Students ◽  
Multiple Choice Questions ◽  
Learning Resource ◽  
Examination Performance ◽  
Introductory Accounting

ABSTRACT In this paper we investigate the effectiveness of an online learning resource for introductory financial accounting students using a suite of online multiple choice questions (MCQ) for summative and formative purposes. We found that the availability and use of an online resource resulted in improved examination performance for those students who actively used the online learning resource. Further, we found a positive relationship between formative MCQ and unit content related to challenging financial accounting concepts. However, better examination performance was also linked to other factors, such as prior academic performance, tutorial participation, and demographics, including gender and attending university as an international student. JEL Classifications: I20; M41.

scholarly journals ANALISIS SOAL-SOAL OLIMPIADE SAINS NASIONAL (OSN) SMA/MA BIDANG KIMIA TAHUN 2012 DAN 2013 BERDASARKAN DIMENSI PROSES KOGNITIF DAN PENGETAHUAN

2014 ◽  
Vol 9 (2) ◽  
Author(s):  
Tita Sunggarani ◽  
Euis Nursa’adah ◽  
Yunita Yunita
Keyword(s):  
Conceptual Understanding ◽  
Cognitive Process ◽  
Bloom's Taxonomy ◽  
Challenging Problem ◽  
Cognitive Level ◽  
Revised Bloom's Taxonomy ◽  
Bloom’S Taxonomy ◽  
Cognitive Levels ◽  
National Competition ◽  
Process Dimension

Abstrak: Ilmu kimia sebagai ilmu yang berdasarkan pada  penelitian (induktif), yang seharusnya mampu menyajikan soal yang menantang dan tersebar dalam enam level kognitif, hanya saja kondisi sebenarnya soal-soal kimia masih dibuat tradisional dengan berada pada level kognitif rendah. Soal olimpiade sebagai ajang kompetisi nasional siswa-siswa berprestasi di Indonesia pun belum diketahui level kognitif yang terkandung di dalamnya. Maka tujuan penelitian ini yakni, mendeskripsikan komposisi penyebaran soal terhadap tabel Taksonomi Bloom revisi, mendeskripsikan perbandingan soal OSN dan IChO (International Chemistry Olympiad) pada materi yang sama, dan  memetakan soal-soal tersebut terhadap standar kompetensi dan kompetensi dasar SMA/MA. Hasil analisis menunjukkan bahwa pada tahun 2012 tersebar pada prosedural-mengaplikasikan dan konseptual-memahami. Pada tahun 2013 tersebar pada dimensi prosedural-mengaplikasikan dan faktual-memahami. Berdasarkan konten materi dalam satu soal IChO  menuntut siswa dapat menemukan keterkaitan suatu materi dengan materi lainnya guna menyelesaikan soal tersebut sedangkan OSN tidak, tetapi keduanya  memiliki dimensi pengetahuan dan dimensi proses kognitif yang tidak terlalu berbeda yakni pada lingkup prosedural-mengaplikasikan dan prosedural-menganalisis. Hasil pemetaan terhadap SK-KD SMA/MA menunjukkan sebesar setengah dari jumlah ksesluruhan soal dapat dipetakan. Adanya analisis ini diharapkan menjadi masukan bagi guru untuk memberikan penguatan konsep kimia pada pembelajaran, agar siswa mampu mengerjakan berbagai macam soal, salah satunya soal OSN. Penelitian ini masih terbatas pada tahun 2012 dan 2013, sehingga dapat dikembangkan analisis untuk tahun-tahun lainnya. Kata-kata Kunci : Analisis, Taksonomi Bloom revisi, Dimensi Pengetahuan, Dimensi Proses Kognitif Abstract: Chemistry as a science that is based on research (inductive), which is supposed to be able to present a challenging problem and scattered in six cognitive levels, it's just that the actual conditions of chemical problems are still made traditionally with low cognitive level. Olympics as a matter of national competition top students in Indonesia is not yet known cognitive level contained therein. So the purpose of this study, describing the composition of matter of the spread of the revised Bloom's Taxonomy tables, describing the comparison about OSN and IChO (International Chemistry Olympiad) on the same material, and to map these problems to the standards of competence and basic competences SMA/MA. The analysis showed that in 2012 spread over-apply procedural and conceptual understanding. In 2013 spread to the dimension-apply procedural and factual-understand. Based on the content of the material in a matter of IChO requires students to be able to find a material relationship with the other materials in order to resolve these problems while OSN does not, but both have dimensions of knowledge and cognitive process dimensions are not too different from that in the scope of procedural-procedural-applying and analyzing. The results of the mapping of the SK-KD SMA / MA shows only half the number of ksesluruhan matter can be mapped. The existence of this analysis are expected to be the input for the teacher to provide reinforcement in learning chemistry concepts, so that students are able to do a variety of problems, one of which is a matter of OSN. This study was limited in 2012 and 2013, so that the analysis can be developed for other years. Key Words: Analysis, revised Bloom's Taxonomy, Knowledge Dimension, The Cognitive Process Dimension

Sign in / Sign up

Export Citation Format

Share Document