Constructing and Evaluating a Validation Argument for a Next-Generation Alternate Assessment

2020 ◽  
Author(s):  
Amy K. Clark ◽  
Meagan Karvonen

Alternate assessments based on alternate achievement standards (AA-AAS) have historically lacked broad validity evidence and an overall evaluation of the extent to which evidence supports intended uses of results. An expanding body of validation literature, the funding of two AA-AAS consortia, and advances in computer-based assessment have supported improvements in AA-AAS validation. This paper describes the validation approach used with the Dynamic Learning Maps® alternate assessment system, including development of the theory of action, claims, and interpretive argument; examples of evidence collected; and evaluation of the evidence in light of the maturity of the assessment system. We focus especially on claims and sources of evidence unique to AA-AAS and especially the Dynamic Learning Maps system design. We synthesize the evidence to evaluate the degree to which it supports the intended uses of assessment results for the targeted population. Considerations are presented for subsequent data collection efforts.

2021 ◽  
Vol 6 ◽  
Author(s):  
Sue Bechard ◽  
Meagan Karvonen ◽  
Karen Erickson

In education, taxonomies that define cognitive processes describe what a learner does with the content. Cognitive process dimensions (CPDs) are used for a number of purposes, such as in the development of standards, assessments, and subsequent alignment studies. Educators consider CPDs when developing instructional activities and materials. CPDs may provide one way to track students’ progress toward acquiring increasingly complex knowledge. There are a number of terms used to characterize CPDs, such as depth-of-knowledge, cognitive demand, cognitive complexity, complexity framework, and cognitive taxonomy or hierarchy. The Dynamic Learning Maps (DLM™) Alternate Assessment System is built on a map-based model, grounded in the literature, where academic domains are organized by cognitive complexity as appropriate for the diversity of students with significant cognitive disabilities (SCD). Of these students, approximately 9% either demonstrate no intentional communication system or have not yet attained symbolic communication abilities. This group of students without symbolic communication engages with and responds to stimuli in diverse ways based on context and familiarity. Most commonly used cognitive taxonomies begin with initial levels, such as recall, that assume students are using symbolic communication when they process academic content. Taxonomies that have tried to extend downward to address the abilities of students without symbolic communication often include only a single dimension (i.e., attend). The DLM alternate assessments are based on learning map models that depict cognitive processes exhibited at the foundational levels of pre-academic learning, non-symbolic communication, and growth toward higher levels of complexity. DLM examined existing cognitive taxonomies and expanded the range to include additional cognitive processes that demonstrate changes from the least complex cognitive processes through early symbolic processes. This paper describes the theoretical foundations and processes used to develop the DLM Cognitive Processing Dimension (CPD) Taxonomy to characterize cognitive processes appropriate for map-based alternate assessments. We further explain how the expanded DLM CPD Taxonomy is used in the development of the maps, extended standards (i.e., Essential Elements), alternate assessments, alignment studies, and professional development materials. Opportunities and challenges associated with the use of the DLM CPD Taxonomy in these applications are highlighted.


2010 ◽  
Vol 76 (4) ◽  
pp. 457-474 ◽  
Author(s):  
Ryan J. Kettler ◽  
Stephen N. Elliott ◽  
Peter A. Beddow ◽  
Elizabeth Compton ◽  
Dawn McGrath ◽  
...  

This study featured validity evidence for scores from states' alternate assessments of alternate academic achievement standards (AA-AASs). It evaluated students from 6 states who were eligible for an AA-AAS concurrently with measures of academic competence and adaptive behavior. The investigators also assessed students with disabilities who were not eligible for an AA-AAS by using the same measures, as well as by using general achievement tests. The main findings included that AA-AAS reading and math scores may reflect a unitary construct, that AA-AAS scores are highly related to adaptive behavior but also relate to academic competence and achievement, and that all these scores represent unique but overlapping constructs. These results have implications for AA-AAS developers and teachers working with students with significant cognitive disabilities.


1998 ◽  
Author(s):  
J. L. Mitchell ◽  
Winston Bennett ◽  
J. J. Weissmuller ◽  
R. L. Gosc ◽  
Patricia Waldroop ◽  
...  

2010 ◽  
Vol 40-41 ◽  
pp. 968-973
Author(s):  
Li Ma ◽  
Li Hua Li

This paper analyzes the sources of high-tech spin-offs’ operational risks, establishes a multifactor hierarchical index system and applies Analytical Hierarchy Process and fuzzy mathematical methods to build a fuzzy overall evaluation model. This research can provide a useful tool to help high-tech spin-offs scientifically assess their operational risk degree in order to formulate corresponding countermeasures to evade the risks, and realize sustainable growth.


1997 ◽  
Vol 89 (4) ◽  
pp. 599-620 ◽  
Author(s):  
Cheryl A. Cisero ◽  
James M. Royer ◽  
Horace G. Marchant ◽  
Stanley J. Jackson

Sign in / Sign up

Export Citation Format

Share Document