Discussion of Validation Issues in Signed and Spoken Assessments for Adult L2 Learners

2021 ◽  
pp. 295-298
Author(s):  
Carol A. Chapelle ◽  
Peter C. Hauser ◽  
Hye-won Lee ◽  
Christian Rathmann ◽  
Krister Schönström

The use of argument-based validity as a framework for discussion of validity issues in spoken and signed second language (L2) assessment reveals many areas of commonality. Common areas include the role of systematic test development practices in the validity argument, the complexity of rating issues, the need to define and assess a construct of functional communication of meaning, and the centrality of test use in the validity argument. Examining these areas of commonality in this chapter reveals the fundamental similarities in the basic validity issues faced in spoken and signed language assessment. This chapter is a joint discussion of key items related to validation issues related to signed and spoken language assessment that were discussed in Chapters 8.1 and 8.2.

In Language Assessment Across Modalities: Paired-Papers on Signed and Spoken Language Assessment, volume editors Tobias Haug, Wolfgang Mann, and Ute Knoch bring together—for the first time—researchers, clinicians, and practitioners from two different fields: signed language and spoken language. The volume examines theoretical and practical issues related to 12 topics ranging from test development and language assessment of bi-/multilingual learners to construct issues of second-language assessment (including the Common European Framework of Reference [CEFR]) and language assessment literacy in second-language assessment contexts. Each topic is addressed separately for spoken and signed language by experts from the relevant field. This is followed by a joint discussion in which the chapter authors highlight key issues in each field and their possible implications for the other field. What makes this volume unique is that it is the first of its kind to bring experts from signed and spoken language assessment to the same table. The dialogues that result from this collaboration not only help to establish a shared appreciation and understanding of challenges experienced in the new field of signed language assessment but also breathes new life into and provides a new perspective on some of the issues that have occupied the field of spoken language assessment for decades. It is hoped that this will open the door to new and exciting cross-disciplinary collaborations.


2021 ◽  
pp. 329-332
Author(s):  
Tobias Haug ◽  
Ute Knoch ◽  
Wolfgang Mann

This chapter is a joint discussion of key items related to scoring issues related to signed and spoken language assessment that were discussed in Chapters 9.1 and 9.2. One aspect of signed language assessment that has the potential to stimulate new research in spoken second language (L2) assessment is the scoring of nonverbal speaker behaviors. This aspect is rarely represented in the scoring criteria of spoken assessments and in many cases not even available to raters during the scoring process. The authors argue, therefore, for a broadening of the construct of spoken language assessment to also include elements of nonverbal communication in the scoring descriptors. Additionally, the importance of rater training for signed language assessments, application of Rasch analysis to investigate possible reasons of disagreement between raters, and the need to conduct research on rasting scales are discussed.


2021 ◽  
pp. 431-436
Author(s):  
Sarah Ebling ◽  
Phuong Nguyen ◽  
Volker Hegelheimer ◽  
Necati Cihan Camgöz ◽  
Richard Bowden

This chapter discusses the implications of second language (L2) spoken assessment technologies and signed language assessment technologies. Specifically, the authors discuss how signed language recognition technology can be applied for the assessment of interactional competence in L2 spoken language assessment. The chapter outlines assessment management systems and the improvement of signed language recognition and animation technologies as important steps to support L2 signed language assessment. The authors also propose directions for future technological developments in both spoken language and signed language assessment. This chapter is a joint discussion of key items related to the use of new technologies in signed and spoken language assessment that were discussed in Chapters 12.1 and 12.2.


2021 ◽  
pp. 273-284
Author(s):  
Carol A. Chapelle ◽  
Hye-won Lee

Assessments of second language speaking are used for a range of purposes, from assigning grades in language courses to certifying qualifications for employment and assessing readiness for university study. The types of validation efforts undertaken across language assessment contexts are equally wide-ranging. This chapter introduces the validation practices used to evaluate the degree to which interpretations and uses of test scores are justified in particular contexts. The types of validation practices are tied to the types of inferences that are made when tests of spoken language are used as well as the need to present empirical evidence and theoretical rationales to support the inferences.


2021 ◽  
pp. 145-152
Author(s):  
Amy Kissel Frisbie ◽  
Aaron Shield ◽  
Deborah Mood ◽  
Nicole Salamy ◽  
Jonathan Henner

This chapter is a joint discussion of key items presented in Chapters 4.1 and 4.2 related to the assessment of deaf and hearing children on the autism spectrum . From these chapters it becomes apparent that a number of aspects associated with signed language assessment are relevant to spoken language assessment. For example, there are several precautions to bear in mind about language assessments obtained via an interpreter. Some of these precautions apply solely to D/HH children, while others are applicable to assessments with hearing children in multilingual contexts. Equally, there are some aspects of spoken language assessment that can be applied to signed language assessment. These include the importance of assessing pragmatic language skills, assessing multiple areas of language development, differentiating between ASD and other developmental disorders, and completing the language evaluation within a developmental framework. The authors conclude with suggestions for both spoken and signed language assessment.


2000 ◽  
Vol 16 (4) ◽  
pp. 325-353 ◽  
Author(s):  
Mahide Demirci

This study investigates the effects of pragmatic principles on the acquisition of the binding of English reflexives by adult Turkish second language (L2) learners. The study compares pragmatically biased and pragmatically neutral sentences to determine whether pragmatic bias towards a non-local antecedent overrides the parameter setting of English and causes learners to choose as possible antecedents NPs outside the binding domain. Both group and individual results indicate that pragmatically biased sentences compel the subjects to consider pragmatic information to the extent that it can affect their choice of local antecedent. Acquisition theories should account for the role that pragmatic information might play in the assignment of possible antecedents for reflexives.This study incorporates Huang's (1994) ‘pragmatic theory of anaphora’ in which the interpretation of a reflexive is subject to the I-principle, a pragmatic strategy which finds an antecedent for the reflexive that gives the most informative, stereotypical interpretation in keeping with our knowledge about the world.


2013 ◽  
Vol 35 (6) ◽  
pp. 1055-1086 ◽  
Author(s):  
LUCIA POZZAN ◽  
ERIN QUIRK

ABSTRACTThe present study investigates the role of the syntactic properties of the first and the target language on second language (L2) learners’ production of English main and embedded clause questions. The role of the first language (L1) was investigated by comparing the production of L2 learners whose L1s (Chinese and Spanish) differ from English and each other in terms of word order in main and embedded clause questions. The role of the target language was investigated by comparing L2 learners’ production of yes/no and adjunct and argument wh-questions. The results indicate that the L1 is not a predictor of L2 learners’ production patterns for either main or embedded clause questions. The linguistic properties of the target language, on the contrary, predict learners’ accuracy and inversion profiles. In line with data from the English L1 acquisition literature, L2 learners produced higher inversion rates in main clause yes/no than in wh-questions, and particularly low inversion rates with why-questions. In line with data from nonstandard varieties of English and preliminary evidence from L1 acquisition, L2 learners produced higher nonstandard inversion rates in embedded clause wh-questions than in yes/no questions. Taken together, these results highlight that L2 production is affected and constrained by the same factors at play in L1 acquisition and dialectal variation.


Author(s):  
Robert Ariew ◽  
Gulcan Erçetin ◽  
Susan Cooledge

This chapter introduces second language reading in hypertext/hypermedia environments. It discusses the development of a template to annotate reading texts with multiple types of media such as text, sound, graphics, and video so as to aid reading comprehension for L2 readers. The chapter also reports on a series of studies conducted using the template in a variety of L2 learning environments in order to explore L2 learners’ reading behavior and the effects of multimedia annotations on L2 reading and vocabulary learning. The chapter synthesizes the results according to multimedia learning theories and discusses the role of proficiency level and prior knowledge in relation to L2 learners’ reading comprehension in hypertext environments.


2015 ◽  
Vol 38 (3) ◽  
pp. 485-521 ◽  
Author(s):  
Katja Jäschke ◽  
Ingo Plag

This study investigates the role of probabilistic grammatical constraints on the dative alternation in English as a second language (ESL). It presents the results of an experiment in which the different factors that are influential in first language (L1) English are tested with advanced learners of English whose L1 is German. Second language (L2) learners are influenced by the same determinants as L1 speakers but to a lesser degree. Together with the results of previous studies, the present results suggest that, initially, the learners do not make use of probabilistic constraints in spite of the constraints being influential in the L1 and only gradually acquire a sensitivity toward the constraints that govern the choice between the two dative constructions.


Sign in / Sign up

Export Citation Format

Share Document