Commentary on “Validation Methods for Aggregate-Level Test Scale Linking: A Case Study Mapping School District Test Score Distributions to a Common Scale”

2020 ◽  
pp. 107699862094917
Author(s):  
Mark L. Davison

This paper begins by setting the linking methods of Reardon, Kalogrides, and Ho in the broader literature on linking. Trends in the validity data suggest that there may be a conditional bias in the estimates of district means, but the data in the article are not conclusive on this point. Further, the data used in their case study might support the validity of the methods only over a limited range of the ability continuum. Applications of the method are then discussed. Contrary to the title, the application of the linking results is not limited to aggregate-level data. Because the potential application is so broad, further research is needed on issues such as the possibility of conditional bias and the validity of estimates over the full range of possible values. Validity is not a dichotomous concept where validity exists or it does not. The evidence reported by Reardon et al. provides substantial, but incomplete, support for the validity of the linked measures in this case study.

2020 ◽  
pp. 107699862095666
Author(s):  
Alina A. von Davier

In this commentary, I share my perspective on the goals of assessments in general, on linking assessments that were developed according to different specifications and for different purposes, and I propose several considerations for the authors and the readers. This brief commentary is structured around three perspectives (1) the context of this research, (2) the methodology proposed here, and (3) the consequences for applied research.


2019 ◽  
pp. 107699861987408 ◽  
Author(s):  
Sean F. Reardon ◽  
Demetra Kalogrides ◽  
Andrew D. Ho

Linking score scales across different tests is considered speculative and fraught, even at the aggregate level. We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that aggregate linkages can be validated both directly and indirectly under certain conditions such as when the scores for at least some target units (districts) are available on a common test (e.g., the National Assessment of Educational Progress). We introduce precision-adjusted random effects models to estimate linking error, for populations and for subpopulations, for averages and for progress over time. These models allow us to distinguish linking error from sampling variability and illustrate how linking error plays a larger role in aggregates with smaller sample sizes. Assuming that target districts generalize to the full population of districts, we can show that standard errors for district means are generally less than .2 standard deviation units, leading to reliabilities above .7 for roughly 90% of districts. We also show how sources of imprecision and linking error contribute to both within- and between-state district comparisons within versus between states. This approach is applicable whenever the essential counterfactual question—“what would means/variance/progress for the aggregate units be, had students taken the other test?”—can be answered directly for at least some of the units.


2020 ◽  
pp. 107699862094826
Author(s):  
Daniel Bolt

The studies presented by Reardon, Kalogrides, and Ho provide preliminary support for a National Assessment of Educational Progress–based aggregate linking of state assessments when used for research purposes. In this commentary, I suggest future efforts to explore possible sources of district-level bias, evaluation of predictive accuracy at the state level, and a better understanding of the performance of the linking when applied to the inevitable nonrepresentative district samples that will be encountered in research studies.


2021 ◽  
Author(s):  
◽  
Helen Pentecost

<p>After three years of schooling, some primary students are behind the expected levels for spelling achievement. This qualitative case study sought an insider view from 12 Year 4 students on the strategies they used to spell words within the context of classroom writing programmes. The students in the study attended three primary schools. Half the students had been identified by their teachers as achieving below the expected level in spelling for their year group and half at the expected level. Data were collected through a series of semi-structured interviews with groups of students and individual interviews with teachers from their schools. Data were also gathered from analysis of the students' writing samples. A comparison was made between the data gathered from the two groups of students, searching for similarities and differences in their strategies and understandings about spelling. Data from the students were also compared to the teachers' views about how students learn to spell. The average-achieving students viewed new words as problems that can be solved through using a combined repertoire of strategies. These included drawing on visual memory, using phoneme-grapheme relationships and morphological strategies to spell challenging words. In contrast, the below average achievers had a more limited range of strategies, tending to use only one strategy at a time and did not readily making links to their prior knowledge. If teachers are aware of these strategies and how successful spellers combine appropriate strategies, they can assist students to improve their spelling by giving specific instruction and feedback on their use.</p>


2021 ◽  
Author(s):  
◽  
Helen Pentecost

<p>After three years of schooling, some primary students are behind the expected levels for spelling achievement. This qualitative case study sought an insider view from 12 Year 4 students on the strategies they used to spell words within the context of classroom writing programmes. The students in the study attended three primary schools. Half the students had been identified by their teachers as achieving below the expected level in spelling for their year group and half at the expected level. Data were collected through a series of semi-structured interviews with groups of students and individual interviews with teachers from their schools. Data were also gathered from analysis of the students' writing samples. A comparison was made between the data gathered from the two groups of students, searching for similarities and differences in their strategies and understandings about spelling. Data from the students were also compared to the teachers' views about how students learn to spell. The average-achieving students viewed new words as problems that can be solved through using a combined repertoire of strategies. These included drawing on visual memory, using phoneme-grapheme relationships and morphological strategies to spell challenging words. In contrast, the below average achievers had a more limited range of strategies, tending to use only one strategy at a time and did not readily making links to their prior knowledge. If teachers are aware of these strategies and how successful spellers combine appropriate strategies, they can assist students to improve their spelling by giving specific instruction and feedback on their use.</p>


2016 ◽  
Vol 1 (15) ◽  
pp. 79-83
Author(s):  
Ed Bice ◽  
Kristine E. Galek

Dysphagia is common in patients with dementia. Dysphagia occurs as a result of changes in the sensory and motor function of the swallow (Easterling, 2007). It is known that the central nervous system can undergo experience-dependent plasticity, even in those individuals with dementia (Park & Bischof, 2013). The purpose of this study was to explore whether or not the use of neuroplastic principles would improve the swallow motor plan and produce positive outcomes of a patient in severe cognitive decline. The disordered swallow motor plan was manipulated by focusing on a neuroplastic principles of frequency (repetition), velocity of movement (speed of presentation), reversibility (Use it or Lose it), specificity and adaptation, intensity (bolus size), and salience (Crary & Carnaby-Mann, 2008). After five therapeutic sessions, the patient progressed from holding solids in her mouth with decreased swallow initiation to independently consuming a regular diet with full range of liquids with no oral retention and no verbal cues.


2021 ◽  
Vol 13 (3) ◽  
pp. 1193
Author(s):  
Anna Podara ◽  
Dimitrios Giomelakis ◽  
Constantinos Nicolaou ◽  
Maria Matsiola ◽  
Rigas Kotsakis

This paper casts light on cultural heritage storytelling in the context of interactive documentary, a hybrid media genre that employs a full range of multimedia tools to document reality, provide sustainability of the production and successful engagement of the audience. The main research hypotheses are enclosed in the statements: (a) the interactive documentary is considered a valuable tool for the sustainability of cultural heritage and (b) digital approaches to documentary storytelling can provide a sustainable form of viewing during the years. Using the Greek interactive documentary (i-doc) NEW LIFE (2013) as a case study, the users’ engagement is evaluated by analyzing items from a seven-year database of web metrics. Specifically, we explore the adopted ways of the interactive documentary users to engage with the storytelling, the depth to which they were involved along with the most popular sections/traffic sources and finally, the differences between the first launch period and latest years were investigated. We concluded that interactivity affordances of this genre enhance the social dimension of cultural, while the key factors for sustainability are mainly (a) constant promotion with transmedia approach; (b) data-driven evaluation and reform; and (c) a good story that gathers relevant niches, with specific interest to the story.


Energies ◽  
2021 ◽  
Vol 14 (14) ◽  
pp. 4349
Author(s):  
Niklas Wulff ◽  
Fabia Miorelli ◽  
Hans Christian Gils ◽  
Patrick Jochem

As electric vehicle fleets grow, rising electric loads necessitate energy systems models to incorporate their respective demand and potential flexibility. Recently, a small number of tools for electric vehicle demand and flexibility modeling have been released under open source licenses. These usually sample discrete trips based on aggregate mobility statistics. However, the full range of variables of travel surveys cannot be accessed in this way and sub-national mobility patterns cannot be modeled. Therefore, a tool is proposed to estimate future electric vehicle fleet charging flexibility while being able to directly access detailed survey results. The framework is applied in a case study involving two recent German national travel surveys (from the years 2008 and 2017) to exemplify the implications of different mobility patterns of motorized individual vehicles on load shifting potential of electric vehicle fleets. The results show that different mobility patterns, have a significant impact on the resulting load flexibilites. Most obviously, an increased daily mileage results in higher electricty demand. A reduced number of trips per day, on the other hand, leads to correspondingly higher grid connectivity of the vehicle fleet. VencoPy is an open source, well-documented and maintained tool, capable of assessing electric vehicle fleet scenarios based on national travel surveys. To scrutinize the tool, a validation of the simulated charging by empirically observed electric vehicle fleet charging is advised.


Sign in / Sign up

Export Citation Format

Share Document