Generalizability theory reliability of written expression curriculum-based measurement in universal screening.

Existing approaches to measuring writing performance are insufficient in terms of both technical adequacy as well as feasibility for use as a screening measure. This study examined the validity and diagnostic accuracy of several approaches to automated essay scoring as well as written expression curriculum-based measurement (WE-CBM) to determine whether an automated approach improves technical adequacy. A sample of 140 fourth grade students generated writing samples that were then scored using traditional and automated approaches and examined with the statewide measure of writing performance. Results indicated that the validity and diagnostic accuracy for the best performing WE-CBM metric, correct minus incorrect word sequences (CIWS) and the automated approaches to scoring were comparable with automated approaches offering potentially improved feasibility for use in screening. Averaging scores across three time points was necessary, however, in order to achieve improved validity and adequate levels of diagnostic accuracy across the scoring approaches. Limitations, implications, and directions for future research regarding the use of automated scoring approaches for screening are discussed.

Download Full-text

Confirmatory factor analysis of Mathematics Progress Indicators (IPAM) in first-grade students

European Journal of Investigation in Health, Psychology and Education ◽

10.3390/ejihpe7010003 ◽

2017 ◽

Vol 7 (1) ◽

pp. 31-45

Author(s):

Juan Jiménez ◽

Sara del Cristo de León

Keyword(s):

Universal Screening ◽

Mathematics Learning ◽

First Grade ◽

Latent Structure ◽

Elementary Grades ◽

Curriculum Based Measurement ◽

Factorial Structure ◽

Magnitude Comparison ◽

Proposed Model ◽

Confirmatory Factor

This study analyses the factorial structure of Mathematics Progress Indicators (IPAM), by using Confirmatory Factorial Analysis (CFA) techniques. For this purpose, a longitudinal study was carried out with a sample of 176 first-grade students from the Canary Islands, IPAM was administered to the study sample three times throughout the scholar year. The IPAM is a Curriculum-Based Measurement (CBM) instrument composed of three alternative or parallel measures (A, B and C) that try to measure the same latent structure (i.e., number sense). The IPAM measures were administered three times per year (i.e., fall, winter, spring). Its main objective is the universal screening and evaluation of students' mathematics learning progress in the elementary grades through the evaluation of fluency for different tasks (i.e., magnitude comparison, one-digit operations, two-digit operations, missing number, and position value). Fluency is measured by counting the number of correct answers given by the student at a given time. The results of the CFA confirm a good fit of the proposed model for the different moments of measurement.

Download Full-text

Curriculum-based measurement of oral reading (R-CBM): A diagnostic test accuracy meta-analysis of evidence supporting use in universal screening

Journal of School Psychology ◽

10.1016/j.jsp.2014.06.002 ◽

2014 ◽

Vol 52 (4) ◽

pp. 377-405 ◽

Cited By ~ 48

Author(s):

Stephen P. Kilgus ◽

Scott A. Methe ◽

Daniel M. Maggin ◽

Jessica L. Tomasula

Keyword(s):

Diagnostic Test ◽

Oral Reading ◽

Universal Screening ◽

Meta Analysis ◽

Diagnostic Test Accuracy ◽

Test Accuracy ◽

Curriculum Based Measurement

Download Full-text

Assessing Teacher Usability of Written Expression Curriculum-Based Measurement

Assessment for Effective Intervention ◽

10.1177/1534508418781007 ◽

2018 ◽

Vol 45 (1) ◽

pp. 51-64 ◽

Cited By ~ 1

Author(s):

Anita M. Payan ◽

Milena Keller-Margulis ◽

Andrea B. Burridge ◽

Samuel D. McQuillin ◽

Kristen S. Hassett

Keyword(s):

Test Data ◽

Poor Performance ◽

Written Expression ◽

Curriculum Based Measurement ◽

Writing Proficiency ◽

Reading Curriculum ◽

Students At Risk ◽

National Test ◽

Performance Research ◽

Practical Implications

National test data indicate that some students do not perform well in writing, suggesting a need to identify students at risk for poor performance. Research supports Written Expression Curriculum-Based Measurement (WE-CBM) as an indicator of writing proficiency, but it is less commonly used in practice. This study examined the usability of WE-CBM compared with Reading Curriculum-Based Measurement (R-CBM). Participants included 162 teachers who were given examples of WE-CBM and R-CBM and then completed a usability measure for both curriculum-based measurement (CBM) types. Teachers not only rated WE-CBM as usable but also rated R-CBM significantly higher in usability, with no significant differences in acceptability. Practical implications that may inform modifications to WE-CBM are discussed.

Download Full-text