Investigating the Effects of Test Accommodations with Process Data for English Learners in a Mathematics Assessment

2021 ◽  
pp. 1-19
Author(s):  
Mikyung Kim Wolf ◽  
Hanwook Yoo ◽  
Danielle Guzman-Orth ◽  
Jamal Abedi
2020 ◽  
Author(s):  
Joseph Rios ◽  
Samuel Ihlenfeldt ◽  
Carlos Chávez

The objectives of this two-part study were to: (a) investigate English learner (EL) accommodation practices on state accountability assessments of reading/English language arts and mathematics in grades 3-8, and (b) conduct a meta-analysis of EL accommodation effectiveness on improving test performance. Across all distinct testing programs, we found that at least one EL test accommodation was provided for both test content areas. The most popular accommodations provided were supplying students with word-to-word dual language dictionaries, reading aloud test directions and items in English, and allowing flexible time/scheduling. However, we found minimal evidence that testing programs provide practitioners with recommendations on how to assign relevant accommodations to EL test takers’ English proficiency level. To evaluate whether accommodations used in practice are supported with evidence of their effectiveness, a meta-analysis was conducted. On average, across 26 studies and 95 effect sizes (N = 11,069), accommodations improved test performance by 0.16 standard deviations. Both test content and sampling design were found to moderate accommodation effectiveness; however, none of the accommodations investigated were found to have intervention effects that were statistically different from zero. Overall, these results suggest that currently employed EL test accommodations lack evidence of their effectiveness.


2016 ◽  
Vol 22 (1) ◽  
pp. 35-53 ◽  
Author(s):  
Katrina Crotts Roohr ◽  
Stephen G. Sireci

Author(s):  
Virginia L. Dubasik ◽  
Dubravka Svetina Valdivia

Purpose The purpose of this study was to ascertain the extent to which school-based speech-language pathologists' (SLPs) assessment practices with individual English learners (ELs) align with federal legislation and professional practice guidelines. Specifically, we were interested in examining SLPs' use of multiple tools during individual EL assessments, as well as relationships between practices and number of types of training experiences. Method School-based SLPs in a Midwestern state were recruited in person or via e-mail to complete an online survey pertaining to assessment. Of the 562 respondents who completed the survey, 222 (39.5%) indicated past or present experience with ELs, and thus, their data were included in the analyses. The questionnaire solicited information about respondent's demographics, caseload composition, perceived knowledge and skills and training experiences pertaining to working with ELs (e.g., graduate school, self-teaching, professional conferences), and assessment practices used in schools. Results The majority of respondents reported using multiple tools rather than a single tool with each EL they assess. Case history and observation were tools used often or always by the largest number of participants. SLPs who used multiple tools reported using both direct (e.g., standardized tests, dynamic assessment) and indirect tools (e.g., case history, interviews). Analyses revealed low to moderate positive associations between tools, as well as the use of speech-language samples and number of types of training experiences. Conclusions School-based SLPs in the current study reported using EL assessment practices that comply with federal legislation and professional practice guidelines for EL assessment. These results enhance our understanding of school-based SLPs' assessment practices with ELs and may be indicative of a positive shift toward evidence-based practice.


2014 ◽  
Vol 17 (1) ◽  
pp. 4-16
Author(s):  
Jade H. Coston ◽  
Corine Myers-Jennings

To better prepare the professionals and scholars of tomorrow in the field of communication sciences and disorders (CSD), a research project in which undergraduate students collected and analyzed language samples of child-parent dyads is presented. Student researchers gained broad and discipline-specific inquiry skills related to the ethical conduct of research, the literature review process, data collection using language assessment techniques, language sample analysis, and research dissemination. Undergraduate students majoring in CSD developed clinical research knowledge, skills, and dispositions necessary for future graduate level study and professional employment. In addition to the benefits of student growth and development, language samples collected through this project are helping to answer research questions regarding communicative turn-taking opportunities within the everyday routines of young children, the effects of turn-taking interactions on language development, and the construct validity of language sampling analysis techniques.


2008 ◽  
Vol 67 (2) ◽  
pp. 71-83 ◽  
Author(s):  
Yolanda A. Métrailler ◽  
Ester Reijnen ◽  
Cornelia Kneser ◽  
Klaus Opwis

This study compared individuals with pairs in a scientific problem-solving task. Participants interacted with a virtual psychological laboratory called Virtue to reason about a visual search theory. To this end, they created hypotheses, designed experiments, and analyzed and interpreted the results of their experiments in order to discover which of five possible factors affected the visual search process. Before and after their interaction with Virtue, participants took a test measuring theoretical and methodological knowledge. In addition, process data reflecting participants’ experimental activities and verbal data were collected. The results showed a significant but equal increase in knowledge for both groups. We found differences between individuals and pairs in the evaluation of hypotheses in the process data, and in descriptive and explanatory statements in the verbal data. Interacting with Virtue helped all students improve their domain-specific and domain-general psychological knowledge.


Author(s):  
Phil Daro ◽  
Frances Stancavage ◽  
Moreica Ortega ◽  
Lizanne DeStefano ◽  
Robert Linn

2003 ◽  
Author(s):  
Amy Merickel ◽  
Robert Linquanti ◽  
Thomas B. Parrish ◽  
Maria Pérez ◽  
Marian Eaton ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document