Discussion on Scoring Issues in Second Signed or Spoken Language Assessment

2021 ◽  
pp. 329-332
Author(s):  
Tobias Haug ◽  
Ute Knoch ◽  
Wolfgang Mann

This chapter is a joint discussion of key items related to scoring issues related to signed and spoken language assessment that were discussed in Chapters 9.1 and 9.2. One aspect of signed language assessment that has the potential to stimulate new research in spoken second language (L2) assessment is the scoring of nonverbal speaker behaviors. This aspect is rarely represented in the scoring criteria of spoken assessments and in many cases not even available to raters during the scoring process. The authors argue, therefore, for a broadening of the construct of spoken language assessment to also include elements of nonverbal communication in the scoring descriptors. Additionally, the importance of rater training for signed language assessments, application of Rasch analysis to investigate possible reasons of disagreement between raters, and the need to conduct research on rasting scales are discussed.

In Language Assessment Across Modalities: Paired-Papers on Signed and Spoken Language Assessment, volume editors Tobias Haug, Wolfgang Mann, and Ute Knoch bring together—for the first time—researchers, clinicians, and practitioners from two different fields: signed language and spoken language. The volume examines theoretical and practical issues related to 12 topics ranging from test development and language assessment of bi-/multilingual learners to construct issues of second-language assessment (including the Common European Framework of Reference [CEFR]) and language assessment literacy in second-language assessment contexts. Each topic is addressed separately for spoken and signed language by experts from the relevant field. This is followed by a joint discussion in which the chapter authors highlight key issues in each field and their possible implications for the other field. What makes this volume unique is that it is the first of its kind to bring experts from signed and spoken language assessment to the same table. The dialogues that result from this collaboration not only help to establish a shared appreciation and understanding of challenges experienced in the new field of signed language assessment but also breathes new life into and provides a new perspective on some of the issues that have occupied the field of spoken language assessment for decades. It is hoped that this will open the door to new and exciting cross-disciplinary collaborations.


2021 ◽  
pp. 145-152
Author(s):  
Amy Kissel Frisbie ◽  
Aaron Shield ◽  
Deborah Mood ◽  
Nicole Salamy ◽  
Jonathan Henner

This chapter is a joint discussion of key items presented in Chapters 4.1 and 4.2 related to the assessment of deaf and hearing children on the autism spectrum . From these chapters it becomes apparent that a number of aspects associated with signed language assessment are relevant to spoken language assessment. For example, there are several precautions to bear in mind about language assessments obtained via an interpreter. Some of these precautions apply solely to D/HH children, while others are applicable to assessments with hearing children in multilingual contexts. Equally, there are some aspects of spoken language assessment that can be applied to signed language assessment. These include the importance of assessing pragmatic language skills, assessing multiple areas of language development, differentiating between ASD and other developmental disorders, and completing the language evaluation within a developmental framework. The authors conclude with suggestions for both spoken and signed language assessment.


2021 ◽  
pp. 431-436
Author(s):  
Sarah Ebling ◽  
Phuong Nguyen ◽  
Volker Hegelheimer ◽  
Necati Cihan Camgöz ◽  
Richard Bowden

This chapter discusses the implications of second language (L2) spoken assessment technologies and signed language assessment technologies. Specifically, the authors discuss how signed language recognition technology can be applied for the assessment of interactional competence in L2 spoken language assessment. The chapter outlines assessment management systems and the improvement of signed language recognition and animation technologies as important steps to support L2 signed language assessment. The authors also propose directions for future technological developments in both spoken language and signed language assessment. This chapter is a joint discussion of key items related to the use of new technologies in signed and spoken language assessment that were discussed in Chapters 12.1 and 12.2.


2021 ◽  
pp. 295-298
Author(s):  
Carol A. Chapelle ◽  
Peter C. Hauser ◽  
Hye-won Lee ◽  
Christian Rathmann ◽  
Krister Schönström

The use of argument-based validity as a framework for discussion of validity issues in spoken and signed second language (L2) assessment reveals many areas of commonality. Common areas include the role of systematic test development practices in the validity argument, the complexity of rating issues, the need to define and assess a construct of functional communication of meaning, and the centrality of test use in the validity argument. Examining these areas of commonality in this chapter reveals the fundamental similarities in the basic validity issues faced in spoken and signed language assessment. This chapter is a joint discussion of key items related to validation issues related to signed and spoken language assessment that were discussed in Chapters 8.1 and 8.2.


2021 ◽  
pp. 261-270
Author(s):  
Susy Macqueen ◽  
Tobias Haug

Thinking about what is assessed—the construct—in any language assessment raises questions about the nature of language use, the nature of developmental trajectories, and whose language patterns determine what is ‘standard’. The assessment of signed languages draws attention to assessment practices and understandings that are entrenched, for better or worse, in the assessment of spoken languages. Spoken language assessments of standardized varieties tend to value the written sentence as an ideal unit, a legacy of standardization. Signed language assessments, on the other hand, may be emerging alongside processes of standardization. Capturing semiotic complexity in the construct remains a significant challenge for both signed and spoken language assessments, despite the development of corpora which exemplify it. This chapter discusses these theoretical, ideological, and practical challenges for assessing signed and spoken language abilities. It brings together key ideas from chapters Chapters 7.1 and 7.2 and offers future directions in the development of theory and practice in signed and spoken language assessments.


2021 ◽  
pp. 113-116
Author(s):  
Wolfgang Mann ◽  
Joanna Hoskin ◽  
Natalie Hasson ◽  
Hilary Dumbrill

This chapter is a joint discussion of key items related to the use of dynamic assessment (DA) in spoken and signed language assessment contexts that were discussed in Chapters 3.1 and 3.2. One aspect of spoken language assessment with great potential to inform new research in signed language is the number and detail of available approaches that test different parts of the language system. Whereas DA with signing children has been used exclusively for assessing vocabulary, approaches in spoken languages have also targeted morphology, phonology, sentence structure, and narrative discourse. In comparison, an area where the available research from signed language could help inform the use of DA for spoken language is the involvement of children and families in co-producing goals to guide assessment and intervention. The authors also raise a couple of aspects that are of equal relevance for both fields and which provide opportunities for increased interdisciplinary collaboration.


2021 ◽  
pp. 273-284
Author(s):  
Carol A. Chapelle ◽  
Hye-won Lee

Assessments of second language speaking are used for a range of purposes, from assigning grades in language courses to certifying qualifications for employment and assessing readiness for university study. The types of validation efforts undertaken across language assessment contexts are equally wide-ranging. This chapter introduces the validation practices used to evaluate the degree to which interpretations and uses of test scores are justified in particular contexts. The types of validation practices are tied to the types of inferences that are made when tests of spoken language are used as well as the need to present empirical evidence and theoretical rationales to support the inferences.


2021 ◽  
pp. 437-446
Author(s):  
Wolfgang Mann ◽  
Tobias Haug ◽  
Ute Knoch

The preceding chapters on signed language assessment and spoken language assessment have demonstrated that the two fields may have different roots and contexts of application, mostly due to the difference in modality, but there are also similarities that may be lesser known. In this chapter, the authors demonstrate how both differences and similarities between the field of signed and spoken languages can create exciting opportunities to rethink old, traditional perspectives and engage in new approaches and collaborations between experts who share the same overall goal: that is, to develop language assessments that are methodologically sound and can be applied to their respective contexts.


2021 ◽  
pp. 63-74
Author(s):  
Charlotte Enns ◽  
Patrick Boudreault

This chapter provides a critical examination of the different uses of test scores; their interpretation by test administrators, educators, professionals, and researchers; and the implications these scores may have for test-takers. Before discussing the issues of test scores, an overview of the complexities involved in defining the L1 of deaf signers will be shared. Understanding the potential pitfalls of signed language assessment with a diverse background of L1 users is emphasized. Four sections address critical issues on scoring and interpreting assessments: purpose, consistency, norming and scoring, and interpreting the results beyond the score. Conducting valid and reliable language assessment is critical to establishing a baseline for intervention, education or research, monitoring an individual’s language competency and growth, justifying the need for additional language support, and providing accurate reporting to parents and administrators.


2011 ◽  
Vol 21 (1) ◽  
pp. 4-19 ◽  
Author(s):  
Michael Douglas

Although the most prominent language in the United States is English, the U.S. is not a monolingual country. According to the U.S. Census in 2000, there were over 40 languages other than English spoken by 55 million people, with 34 million speaking Spanish or Spanish Creole. Given projections based on population studies and the prevalence of hearing loss in the Hispanic-American population, the number of persons who speak English as a second language will grow substantially over the next several decades. Hence, hearing health care professionals must be equipped to provide services for children who have hearing loss and speak English as a second language. The following article describes special considerations speech-language pathologists, audiologists, and educators should take into account when providing intervention designed to develop spoken language for children who have hearing loss and for whom the home language is not English.


Sign in / Sign up

Export Citation Format

Share Document