Use of Multiple Choice Questions as an Assessment Tool in Dynamics

2011 ◽  
Author(s):  
Amitabha Ghosh
Keyword(s):  
Fluid Mechanics ◽  
Student Performance ◽  
Core Curriculum ◽  
Assessment Tool ◽  
Multiple Choice ◽  
Pedagogical Issues ◽  
Multiple Choice Questions ◽  
Deformable Media ◽  
Engineering Sciences ◽  
Mechanics Concepts

Dynamics is a pivotal class in a student’s life-long learning profile since it builds upon the logical extensions of Statics and Strength of Materials classes, and provides a framework on which Fluid Mechanics concepts may be developed for deformable media. This paper establishes the contextual reference of Dynamics in this framework. An earlier paper by the author discussed details of how the design of proper multiple choice questions is critical for assessment in Statics and Fluid Mechanics. This paper provides a progress report of such evaluations in Dynamics. In addition, this paper explores the pedagogical issues related to building a student’s learning profile. While comparing test results obtained in trailer sections of Dynamics with those obtained in sections taught by faculty teams, some structural differences were discovered. This reporting completes the feedback loop used by faculty in our Engineering Sciences Core Curriculum for improving student performance over time. The process may further be developed by using some similarities and differences in the performance data.

Formative Assessment Using Multiple Choice Questions in Statics and Dynamics

2016 ◽  
Author(s):  
Amitabha Ghosh
Keyword(s):  
Fluid Mechanics ◽  
Learning Outcomes ◽  
Student Performance ◽  
Core Curriculum ◽  
Assessment Process ◽  
Educational Goals ◽  
Multiple Choice Questions ◽  
Rochester Institute Of Technology ◽  
Engineering Sciences ◽  
Institute Of Technology

A two-loop learning outcomes assessment process was followed to evaluate the core curriculum in Mechanical Engineering at Rochester Institute of Technology. This initiative, originally called the Engineering Sciences Core Curriculum, provided systematic course learning outcomes and assessment data of examination performance in Statics, Mechanics, Dynamics, Thermodynamics, Fluid Mechanics and Heat Transfer. This paper reports longitudinal data and important observations in the Statics-Dynamics sequence to determine efficacy and obstacles in student performance. An earlier paper showed that students’ mastery of Dynamics is affected largely by weak retention of fundamentals of Statics and mathematics. New observations recorded in this report suggest the need for better instructional strategies to teach certain focal areas in Statics. Subsequesntly offered Dynamics and Fluid Mechanics classes further need reinforcement of some of these fundamental topics in Statics. This report completes a 9 year long broader feedback loop designed to achieve the educational goals in the Statics-Dynamics sequence.

Foundations of Statics: An Assessment Study and Feedback Implementation

2016 ◽  
Author(s):  
Amitabha Ghosh
Keyword(s):  
Test Performance ◽  
Core Curriculum ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Testing Procedures ◽  
Human Aspects ◽  
Rochester Institute Of Technology ◽  
Engineering Sciences ◽  
Statics And Dynamics ◽  
Institute Of Technology

This paper highlights some important obstacles in student test performance resulting from different forms of testing procedures in Statics and Dynamics. A group approach dictates the core pedagogy in these classes, which are components of Engineering Sciences Core Curriculum (ESCC) at Rochester Institute of Technology (RIT). Our observations indicate that the difficulties start before engineering sciences due to incomplete understanding of mathematics and physics. While the human aspects of this assessment may not be revealed on tests, results of long hours of counseling sessions of students with faculty and academic advisors have now been imbedded in designing of our program. But in spite of our streamlined processes of improved delivery and testing, many good students demonstrate superior test scores on essay type questions but poor understanding of concepts as revealed from the analysis of Multiple Choice (MC) responses. This lack of performance has been tracked to a narrow focus and a lack of retention of prior concepts in their active memory. The paper discusses these topics using a select set of multiple choice questions administered on Statics and Dynamics examinations and offers remedial actions including proposal of a new course.

The Effectiveness of Usage of Online Multiple Choice Questions on Student Performance in Introductory Accounting

2017 ◽  
Vol 32 (4) ◽  
pp. 1-17 ◽  
Author(s):  
Dianne Massoudi ◽  
SzeKee Koh ◽  
Phillip J. Hancock ◽  
Lucia Fung
Keyword(s):  
Online Learning ◽  
Student Performance ◽  
International Student ◽  
Multiple Choice ◽  
Financial Accounting ◽  
Accounting Students ◽  
Multiple Choice Questions ◽  
Learning Resource ◽  
Examination Performance ◽  
Introductory Accounting

ABSTRACT In this paper we investigate the effectiveness of an online learning resource for introductory financial accounting students using a suite of online multiple choice questions (MCQ) for summative and formative purposes. We found that the availability and use of an online resource resulted in improved examination performance for those students who actively used the online learning resource. Further, we found a positive relationship between formative MCQ and unit content related to challenging financial accounting concepts. However, better examination performance was also linked to other factors, such as prior academic performance, tutorial participation, and demographics, including gender and attending university as an international student. JEL Classifications: I20; M41.

scholarly journals Teste de Progresso na Escola Médica: uma Revisão Sistemática acerca da Literatura

2020 ◽  
Vol 44 (1) ◽  
Author(s):  
Ademir Garcia Reberti ◽  
Nayme Hechem Monfredini ◽  
Olavo Franco Ferreira Filho ◽  
Dalton Francisco de Andrade ◽  
Carlos Eduardo Andrade Pinheiro ◽  
...  
Keyword(s):  
Student Performance ◽  
Test Performance ◽  
Cognitive Skills ◽  
Assessment Tool ◽  
Objective Assessment ◽  
Active Role ◽  
Medical Schools ◽  
Multiple Choice Questions ◽  
Progress Test ◽  
Advanced Search

Abstract: Progress Test is an objective assessment, consisting of 60 to 150 multiple-choice questions, designed to promote an assessment of the cognitive skills expected at the end of undergraduate school. This test is applied to all students on the same day, so that it is possible to compare the results between grades and analyze the development of knowledge performance throughout the course. This study aimed to carry out a systematic and literary review about Progress Test in medical schools in Brazil and around the world, understanding the benefits of its implementation for the development of learning for the student, the teacher and the institution. The study was carried out from July 2018 to April 2019, which addressed articles published from January 2002 to March 2019. The keywords used were: “Progress Test in Medical Schools” and “Item Response Theory in Medicine” in the PubMed, Scielo, and Lilacs platforms. There was no language limitation in article selection, but the research was carried out in English. A total of 192,026 articles were identified, and after applying advanced search filters, 11 articles were included in the study. The Progress Test (PTMed) has been applied in medical schools, either alone or in groups of partner schools, since the late 1990s. The test results build the students’ performance curves, which allow us to identify weaknesses and strengths of the students in the several areas of knowledge related to the course. The Progress Test is not an exclusive instrument for assessing student performance, but it is also important as an assessment tool for academic management use and thus, it is crucial that institutions take an active role in the preparation and analysis of this assessment data. Assessments designed to test clinical competence in medical students need to be valid and reliable. For the evaluative method to be valid it is necessary that the subject be extensively reviewed and studied, aiming at improvements and adjustments in test performance.

scholarly journals MSK30: a validated tool to assess clinical musculoskeletal knowledge

2019 ◽  
Vol 5 (1) ◽  
pp. e000495
Author(s):  
Danielle L Cummings ◽  
Matthew Smith ◽  
Brian Merrigan ◽  
Jeffrey Leggit
Keyword(s):  
Medical Students ◽  
Large Scale ◽  
Assessment Tool ◽  
Multiple Choice ◽  
School Curriculum ◽  
Average Score ◽  
Multiple Choice Questions ◽  
Modified Delphi ◽  
Multiple Choice Exam ◽  
Individual Education

BackgroundMusculoskeletal (MSK) complaints comprise a large proportion of outpatient visits. However, multiple studies show that medical school curriculum often fails to adequately prepare graduates to diagnose and manage common MSK problems. Current standardised exams inadequately assess trainees’ MSK knowledge and other MSK-specific exams such as Freedman and Bernstein’s (1998) exam have limitations in implementation. We propose a new 30-question multiple choice exam for graduating medical students and primary care residents. Results highlight individual deficiencies and identify areas for curriculum improvement.Methods/ResultsWe developed a bank of multiple choice questions based on 10 critical topics in MSK medicine. The questions were validated with subject-matter experts (SMEs) using a modified Delphi method to obtain consensus on the importance of each question. Based on the SME input, we compiled 30 questions in the assessment. Results of the large-scale pilot test (167 post-clerkship medical students) were an average score of 74 % (range 53% – 90 %, SD 7.8%). In addition, the tool contains detailed explanations and references were created for each question to allow an individual or group to review and enhance learning.SummaryThe proposed MSK30 exam evaluates clinically important topics and offers an assessment tool for clinical MSK knowledge of medical students and residents. It fills a gap in current curriculum and improves on previous MSK-specific assessments through better clinical relevance and consistent grading. Educators can use the results of the exam to guide curriculum development and individual education.

Analysis of a Feedback Assessment Loop in Engineering Sciences Core Curriculum

2013 ◽  
Author(s):  
Amitabha Ghosh
Keyword(s):  
Learning Outcomes ◽  
Student Performance ◽  
Core Curriculum ◽  
Assessment Process ◽  
Learning Outcomes Assessment ◽  
Rochester Institute Of Technology ◽  
Engineering Sciences ◽  
Engineering Department ◽  
Institute Of Technology ◽  
Behavioral Influences

A formal two-loop learning outcomes assessment process has been evaluated in the mechanical engineering department at Rochester Institute of Technology. This initiative, originally called the Engineering Sciences Core Curriculum (ESCC), provided systematic course learning outcomes and assessment data of student performance in Statics, Mechanics, Dynamics, Thermodynamics, Fluid Mechanics and Heat Transfer. This paper reports detailed analyses with some important observations in the Statics-Dynamics sequence to determine obstacles in student performance. New data shows that students’ mastery of Dynamics is affected largely by incorrect interpretations and weak retention of fundamentals in Statics. Further evidence of students’ behavioral influences are discussed requiring a future focus in this area. This report completes the 5 year feedback loop designed to achieve the ESCC goals on the Statics-Dynamics sequence.

scholarly journals Exploring Undergraduates' Understanding of Photosynthesis Using Diagnostic Question Clusters

2012 ◽  
Vol 11 (1) ◽  
pp. 47-57 ◽  
Author(s):  
Joyce M. Parker ◽  
Charles W. Anderson ◽  
Merle Heidemann ◽  
John Merrill ◽  
Brett Merritt ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Conservation Of Energy ◽  
Basic Understanding ◽  
Scientific Principles ◽  
Hierarchical Nature ◽  
Diagnostic Question ◽  
True False

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed.

scholarly journals Open problem-based instruction impacts understanding of physiological concepts differently in undergraduate students

2015 ◽  
Vol 39 (4) ◽  
pp. 327-334 ◽  
Author(s):  
Brandon M. Franklin ◽  
Lin Xiang ◽  
Jason A. Collett ◽  
Megan K. Rhoads ◽  
Jeffrey L. Osborn
Keyword(s):  
Student Performance ◽  
Undergraduate Students ◽  
Open Problem ◽  
Instructional Methods ◽  
Multiple Choice ◽  
Multiple Choice Questions ◽  
Short Answer ◽  
Upper Level ◽  
Based Instruction ◽  
Multiple Choice Exam

Student populations are diverse such that different types of learners struggle with traditional didactic instruction. Problem-based learning has existed for several decades, but there is still controversy regarding the optimal mode of instruction to ensure success at all levels of students' past achievement. The present study addressed this problem by dividing students into the following three instructional groups for an upper-level course in animal physiology: traditional lecture-style instruction (LI), guided problem-based instruction (GPBI), and open problem-based instruction (OPBI). Student performance was measured by three summative assessments consisting of 50% multiple-choice questions and 50% short-answer questions as well as a final overall course assessment. The present study also examined how students of different academic achievement histories performed under each instructional method. When student achievement levels were not considered, the effects of instructional methods on student outcomes were modest; OPBI students performed moderately better on short-answer exam questions than both LI and GPBI groups. High-achieving students showed no difference in performance for any of the instructional methods on any metric examined. In students with low-achieving academic histories, OPBI students largely outperformed LI students on all metrics (short-answer exam: P < 0.05, d = 1.865; multiple-choice question exam: P < 0.05, d = 1.166; and final score: P < 0.05, d = 1.265). They also outperformed GPBI students on short-answer exam questions ( P < 0.05, d = 1.109) but not multiple-choice exam questions ( P = 0.071, d = 0.716) or final course outcome ( P = 0.328, d = 0.513). These findings strongly suggest that typically low-achieving students perform at a higher level under OPBI as long as the proper support systems (formative assessment and scaffolding) are provided to encourage student success.

scholarly journals Tapping into Bloom Taxonomy’s Higher-Order Cognitive Processes: The Case for Multiple Choice Questions as a Valid Assessment Tool in the ESP Classroom

2021 ◽  
pp. 160-171
Author(s):  
Iryna Lenchuk ◽  
Amer Ahmed
Keyword(s):  
Cognitive Processes ◽  
Cognitive Skills ◽  
Assessment Tool ◽  
Multiple Choice ◽  
Higher Order Thinking ◽  
Thinking Skills ◽  
Higher Order ◽  
Assessment Tools ◽  
Multiple Choice Questions ◽  
Higher Order Thinking Skills

This article describes the results of Action Research conducted in an ESP classroom of Dhofar University located in Oman. Following the call of Oman Vision 2040 to emphasize educational practices that promote the development of higher-order cognitive processes, this study raises the following question: Can an online multiple choice question (MCQ) quiz tap into the higher-order cognitive skills of apply, analyze and evaluate? This question was also critical at the time of the COVID-19 pandemic when Omani universities switched to the online learning mode. The researchers administered an online MCQ quiz to 35 undergraduate students enrolled in an ESP course for Engineering and Sciences. The results showed that MCQ quizzes could be developed to tap into higher-order thinking skills when the stem of the MSQ is developed as a task or a scenario. The study also revealed that students performed better on MCQs that tap into low-level cognitive skills. This result can be attributed to the prevalent practice in Oman to develop assessment tools that tap only into a level of Bloom’s taxonomy, which involves the cognitive process of retrieving memorized information. The significance of the study lies in its pedagogical applications. The study calls for the use of teaching and assessment practices that target the development of higher-order thinking skills, which is aligned with the country’s strategic direction reflected in Oman vision 2040.

Sign in / Sign up

Export Citation Format

Share Document