Multilevel modeling to examine sources of variability in second language test scores

Author(s):  
Yo In'nami ◽  
Khaled Barkaoui
2006 ◽  
Vol 32 (4) ◽  
Author(s):  
Cheryl D Foxcroft ◽  
Susan Aston

In response to the growing demand for a test of cognitive ability for South African adults, the Human Sciences Research Council (HSRC) adapted the Wechsler Adult Intelligence Scales, third edition (WAIS-III) for Englishspeaking South Africans. The standardisation sample included both first and second language English speakers who were either educated largely in English or Afrikaans. The purpose of this article is to critically examine the adaptation process undertaken by the HSRC when standardising the WAIS-III for English-speaking South Africans by deliberating whether sufficient attention was paid to establishing if the measure was equivalent for various groups of English first and second language test-takers. In performing this critical examination, international test adaptation guidelines and standards, psychometric conventions, and national and international research findings were contemplated. The general conclusion reached was that the equivalence of the WAIS-III across diverse language groups has not been unequivocally established and there are indications that some bias may exist for English second language test-takers, especially if they are black or Afrikaans-speaking. Based on these conclusions, recommendations are made regarding the way forward.


2021 ◽  
Vol 12 ◽  
Author(s):  
Konstantinos Makanikas ◽  
Georgia Andreou ◽  
Panagiotis Simos ◽  
Efstathia Chartomatsidou

Objective: The primary objective of the present cross-sectional study is to evaluate the semantic language abilities of patients with Obstructive Sleep Apnea Syndrome (OSAS) compared to normative data. Secondary objectives are to examine the effects of OSAS comorbidities on language test performance.Method: 118 adult patients suffering from OSAS were assessed using standardized tests (Boston Naming Test, the Peabody Picture Vocabulary Test and the Verbal Fluency Test).Results: Compared to normative standards, the OSAS group (age and education adjusted mean) scored significantly lower on all tests (p < 0.01). The OSAS group also included a significantly higher percentage of persons scoring below the 5th percentile of the normative distribution on the four tests (p < 0.01). The Apnea/Hypopnea Index, O2 Desaturation index, SaO2 <85% (min) and SaO2 <75% (min) were significantly associated with language test scores (p < 0.05). Moreover, higher Apnea–Hypopnea Index score and night-time oxygen desaturation were associated with reduced phonemic and semantic fluency performance only among patients with a history of hypertension and hypercholesterolemia (p < 0.05). The moderating effect of diabetes and cardiovascular disease on the association between OSAS severity indices and test scores did not reach significance (p > 0.6).Conclusions: Results suggest that the severity of semantic language impairments in patients with OSAS is associated with the severity of the disease and intensified by common medical comorbidities (hypertension and hypercholesterolemia).


2001 ◽  
Vol 17 (4) ◽  
pp. 442-456 ◽  
Author(s):  
Dan Douglas

Arguing from the premise that a language test is a special case of a second language acquisition (SLA) elicitation device, I suggest that SLA and language testing share much common ground in terms of research methods, which have similar properties in that they are both used to make systematic observations of language performances from which inferences can be made about the state of a learner’s interlanguage ability underlying the performance. However, I also argue that whereas the concept of demonstrating validity and reliability has been integrated into how language testing research is conducted, SLA researchers have generally failed to recognize the need to demonstrate these qualities. I compare examples of SLA and language testing research articles in terms of their treatment of validity and reliability and argue: • that it is important for SLA researchers to provide evidence that the methods they employ to elicit data are appropriate for the purposes intended; • that the procedures provide stable and consistent data; and, consequently • that the interpretations they make of the results are justified.


Sign in / Sign up

Export Citation Format

Share Document