scholarly journals Meeting the requirements of both classroom-based and systemic assessment of mathematics proficiency: The potential of Rasch measurement theory

Pythagoras ◽  
2012 ◽  
Vol 33 (3) ◽  
Author(s):  
Tim Dunne ◽  
Caroline Long ◽  
Tracy Craig ◽  
Elsie Venter

The challenges inherent in assessing mathematical proficiency depend on a number of factors, amongst which are an explicit view of what constitutes mathematical proficiency, an understanding of how children learn and the purpose and function of teaching. All of these factors impact on the choice of approach to assessment. In this article we distinguish between two broad types of assessment, classroom-based and systemic assessment. We argue that the process of assessment informed by Rasch measurement theory (RMT) can potentially support the demands of both classroom-based and systemic assessment, particularly if a developmental approach to learning is adopted, and an underlying model of developing mathematical proficiency is explicit in the assessment instruments and their supporting material. An example of a mathematics instrument and its analysis which illustrates this approach, is presented. We note that the role of assessment in the 21st century is potentially powerful. This influential role can only be justified if the assessments are of high quality and can be selected to match suitable moments in learning progress and the teaching process. Users of assessment data must have sufficient knowledge and insight to interpret the resulting numbers validly, and have sufficient discernment to make considered educational inferences from the data for teaching and learning responses.

2020 ◽  
Vol 0 (0) ◽  
Author(s):  
Esperanza Gil-Soto ◽  
Juan R. Oreja-Rodriguez ◽  
Francisco J. García-Rodríguez ◽  
Inés Ruiz-Rosa

AbstractThis paper examines the impact of an educational programme developed in Senegal with university students and designed to encourage entrepreneurship by influencing personal attitudes toward enterprise. The instrument to measure the entrepreneurial potential of young people has been applied in different socio-demographic contexts in some previous empirical research. Improvements in students’ perception of attitudinal factors associated with leadership, creativity, achievement and intuition can be inferred from the results of the longitudinal analysis conducted. Moreover, a positive and significant relationship between students’ perceived behavioural control and their attitudes toward starting a business at the end of the entrepreneurial programme is confirmed. Rasch Measurement Theory is applied to analyse the validity of the measurements and findings suggest that the scale used seems to be a reliable and valid tool for measuring entrepreneurial attitude in a university setting. Results confirm that entrepreneurship programmes have the potential to improve the entrepreneurial attitudes of students in a developing country.


2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
H S Finbråten ◽  
A L Kleppang ◽  
A M Steigen

Abstract Background Questionnaires are frequently used in public health research. In order to provide valid and reliable results to generate recommendations for practice and policies, scales with sound psychometric properties are required. Classical test theory such as factor analysis is most frequently used to assess the psychometric properties of scales. However, classical test theory may have limitations in confirming the validity of scales. Only Rasch measurement theory meet the requirements of fundamental measurement, such as additivity, invariance, sufficiency and specific objectivity. The objective is to exemplify how Rasch measurement theory can be used to evaluate the psychometric properties of a scale. Validation of the Hopkins Symptom Checklist-10 is used as an example. Methods This study is based on cross-sectional data from the Youth Data Survey. In total, 6777 adolescents responded to a web-based questionnaire. Data collection was carried out in lower and upper secondary schools in Norway during 2018. The data were analysed using the partial credit parameterization of the unidimensional Rasch model. Results Preliminary results indicated that the scale had acceptable reliability (person separation index: 0.82). However, one pair of items shows response dependence. The targeting could have been better (mean person location: -1.445). All items had ordered thresholds. Three items under-discriminated. Several items displayed differential item functioning with regard to gender and school level. Conclusions Applying Rasch measurement theory measurement problems that would go undetected using classical test theory approaches were observed. Scales used in public health research should be thoroughly validated applying Rasch measurement theory before the data are used to support claims about public health and used to provide recommendations for policy and practice. Key messages Public health practice and policy should be based on information from valid and reliable scales. Rasch measurement theory should be used to evaluate psychometric properties of scales used in public health research.


2018 ◽  
Vol 4 (2) ◽  
pp. 205521731877699 ◽  
Author(s):  
Sophie Cleanthous ◽  
Sara Strzok ◽  
Farrah Pompilus ◽  
Stefan Cano ◽  
Patrick Marquis ◽  
...  

Background ABILHAND, a manual ability patient-reported outcome instrument originally developed for stroke patients, has been used in multiple sclerosis clinical trials; however, psychometric analyses indicated the measure’s limited measurement range and precision in higher-functioning multiple sclerosis patients. Objective The purpose of this study was to identify candidate items to expand the measurement range of the ABILHAND-56, thus improving its ability to detect differences in manual ability in higher-functioning multiple sclerosis patients. Methods A step-wise mixed methods design strategy was used, comprising two waves of patient interviews, a combination of qualitative (concept elicitation and cognitive debriefing) and quantitative (Rasch measurement theory) analytic techniques, and consultation interviews with three clinical neurologists specializing in multiple sclerosis. Results Original ABILHAND was well understood in this context of use. Eighty-two new manual ability concepts were identified. Draft supplementary items were generated and refined with patient and neurologist input. Rasch measurement theory psychometric analysis indicated supplementary items improved targeting to higher-functioning multiple sclerosis patients and measurement precision. The final pool of Early Multiple Sclerosis Manual Ability items comprises 20 items. Conclusion The synthesis of qualitative and quantitative methods used in this study improves the ABILHAND content validity to more effectively identify manual ability changes in early multiple sclerosis and potentially help determine treatment effect in higher-functioning patients in clinical trials.


Sign in / Sign up

Export Citation Format

Share Document