Score Use and Interpretation of First Signed Language Assessments

2021 ◽  
pp. 63-74
Author(s):  
Charlotte Enns ◽  
Patrick Boudreault
Keyword(s):  
Test Scores ◽  
Language Assessment ◽  
Critical Examination ◽  
Shared Understanding ◽  
Language Support ◽  
Signed Language ◽  
Critical Issues ◽  
Language Competency ◽  
Language Assessments ◽  
Accurate Reporting

This chapter provides a critical examination of the different uses of test scores; their interpretation by test administrators, educators, professionals, and researchers; and the implications these scores may have for test-takers. Before discussing the issues of test scores, an overview of the complexities involved in defining the L1 of deaf signers will be shared. Understanding the potential pitfalls of signed language assessment with a diverse background of L1 users is emphasized. Four sections address critical issues on scoring and interpreting assessments: purpose, consistency, norming and scoring, and interpreting the results beyond the score. Conducting valid and reliable language assessment is critical to establishing a baseline for intervention, education or research, monitoring an individual’s language competency and growth, justifying the need for additional language support, and providing accurate reporting to parents and administrators.

Discussion of Issues Related to Assessment of Signed or Spoken Language Development in Children with Autism Spectrum Disorder

2021 ◽  
pp. 145-152
Author(s):  
Amy Kissel Frisbie ◽  
Aaron Shield ◽  
Deborah Mood ◽  
Nicole Salamy ◽  
Jonathan Henner
Keyword(s):  
Language Development ◽  
Developmental Disorders ◽  
Language Assessment ◽  
Spoken Language ◽  
Autism Spectrum ◽  
Pragmatic Language ◽  
Signed Language ◽  
Pragmatic Language Skills ◽  
Language Assessments ◽  
Hearing Children

This chapter is a joint discussion of key items presented in Chapters 4.1 and 4.2 related to the assessment of deaf and hearing children on the autism spectrum . From these chapters it becomes apparent that a number of aspects associated with signed language assessment are relevant to spoken language assessment. For example, there are several precautions to bear in mind about language assessments obtained via an interpreter. Some of these precautions apply solely to D/HH children, while others are applicable to assessments with hearing children in multilingual contexts. Equally, there are some aspects of spoken language assessment that can be applied to signed language assessment. These include the importance of assessing pragmatic language skills, assessing multiple areas of language development, differentiating between ASD and other developmental disorders, and completing the language evaluation within a developmental framework. The authors conclude with suggestions for both spoken and signed language assessment.

Discussion on Scoring Issues in Second Signed or Spoken Language Assessment

2021 ◽  
pp. 329-332
Author(s):  
Tobias Haug ◽  
Ute Knoch ◽  
Wolfgang Mann
Keyword(s):  
Second Language ◽  
Nonverbal Communication ◽  
Rasch Analysis ◽  
Language Assessment ◽  
Spoken Language ◽  
Rater Training ◽  
Signed Language ◽  
Language Assessments ◽  
New Research

This chapter is a joint discussion of key items related to scoring issues related to signed and spoken language assessment that were discussed in Chapters 9.1 and 9.2. One aspect of signed language assessment that has the potential to stimulate new research in spoken second language (L2) assessment is the scoring of nonverbal speaker behaviors. This aspect is rarely represented in the scoring criteria of spoken assessments and in many cases not even available to raters during the scoring process. The authors argue, therefore, for a broadening of the construct of spoken language assessment to also include elements of nonverbal communication in the scoring descriptors. Additionally, the importance of rater training for signed language assessments, application of Rasch analysis to investigate possible reasons of disagreement between raters, and the need to conduct research on rasting scales are discussed.

Discussion of Issues Related to Assessment Constructs in Spoken and Signed Languages

2021 ◽  
pp. 261-270
Author(s):  
Susy Macqueen ◽  
Tobias Haug
Keyword(s):  
Developmental Trajectories ◽  
Language Assessment ◽  
Spoken Language ◽  
Theory And Practice ◽  
Assessment Practices ◽  
Language Abilities ◽  
Significant Challenge ◽  
Signed Languages ◽  
Signed Language ◽  
Language Assessments

Thinking about what is assessed—the construct—in any language assessment raises questions about the nature of language use, the nature of developmental trajectories, and whose language patterns determine what is ‘standard’. The assessment of signed languages draws attention to assessment practices and understandings that are entrenched, for better or worse, in the assessment of spoken languages. Spoken language assessments of standardized varieties tend to value the written sentence as an ideal unit, a legacy of standardization. Signed language assessments, on the other hand, may be emerging alongside processes of standardization. Capturing semiotic complexity in the construct remains a significant challenge for both signed and spoken language assessments, despite the development of corpora which exemplify it. This chapter discusses these theoretical, ideological, and practical challenges for assessing signed and spoken language abilities. It brings together key ideas from chapters Chapters 7.1 and 7.2 and offers future directions in the development of theory and practice in signed and spoken language assessments.

Validation of Spoken Language Assessments for Adult L2 Learners

2021 ◽  
pp. 273-284
Author(s):  
Carol A. Chapelle ◽  
Hye-won Lee
Keyword(s):  
Second Language ◽  
Empirical Evidence ◽  
Test Scores ◽  
Language Assessment ◽  
Spoken Language ◽  
L2 Learners ◽  
Language Courses ◽  
Language Assessments

Assessments of second language speaking are used for a range of purposes, from assigning grades in language courses to certifying qualifications for employment and assessing readiness for university study. The types of validation efforts undertaken across language assessment contexts are equally wide-ranging. This chapter introduces the validation practices used to evaluate the degree to which interpretations and uses of test scores are justified in particular contexts. The types of validation practices are tied to the types of inferences that are made when tests of spoken language are used as well as the need to present empirical evidence and theoretical rationales to support the inferences.

Epilogue

2021 ◽  
pp. 437-446
Author(s):  
Wolfgang Mann ◽  
Tobias Haug ◽  
Ute Knoch
Keyword(s):  
Language Assessment ◽  
Spoken Language ◽  
New Approaches ◽  
Signed Language ◽  
Language Assessments ◽  
The Difference

The preceding chapters on signed language assessment and spoken language assessment have demonstrated that the two fields may have different roots and contexts of application, mostly due to the difference in modality, but there are also similarities that may be lesser known. In this chapter, the authors demonstrate how both differences and similarities between the field of signed and spoken languages can create exciting opportunities to rethink old, traditional perspectives and engage in new approaches and collaborations between experts who share the same overall goal: that is, to develop language assessments that are methodologically sound and can be applied to their respective contexts.

Language Assessment Literacy in Second Signed Language Assessment Contexts

2021 ◽  
pp. 383-393
Author(s):  
Eveline Boers-Visker ◽  
Annemiek Hammer
Keyword(s):  
Sign Language ◽  
Language Proficiency ◽  
First Language ◽  
Language Assessment ◽  
Special Focus ◽  
Language Programs ◽  
Language Tests ◽  
Signed Language ◽  
The Matrix ◽  
Language Assessments

There are growing numbers of students who enroll sign language programs. Most of them are hearing students whose first language is in the aural-oral modality. Learning signed language challenges them to communicate via the visual-manual modality; a process that is known to be demanding (Kemp, 1998). Therefore, in instruction it is essential to monitor this process by means of effective and efficient assessment (Miller et al., 2008). Rather remarkably, there are only a few tests developed to assess students’ proficiency in sign language. This implies that most instructors, who are involved in sign language teaching, have to develop tests and assessments themselves. Complicating factor, however, is that most instructors are not specifically trained on this topic, i.e. their knowledge and skills to evaluate or design language tests is limited. In this chapter, we will bring issues to view that are involved with the design of sign language assessments. Sign language proficiency can be broken down into two components: the visual receptive and manual expressive component. The assessment of these components will be discussed in the context of validity, reliability, authenticity, impact and practicality. We aim to provide a comprehensive matrix of issues in test design, with special focus on the pitfalls one may encounter in using or developing sign language tests for production as well as receptive skills. The matrix is a first attempt to provide a knowledge base on sign language assessment that might be helpful for instructors to become more literate on the subject matter.

The Handbook of Language Assessment Across Modalities

2021 ◽  
Keyword(s):  
Second Language ◽  
Language Assessment ◽  
Spoken Language ◽  
Assessment Literacy ◽  
Signed Language ◽  
Key Issues ◽  
Relevant Field ◽  
The Common ◽  
New Perspective ◽  
First Time

In Language Assessment Across Modalities: Paired-Papers on Signed and Spoken Language Assessment, volume editors Tobias Haug, Wolfgang Mann, and Ute Knoch bring together—for the first time—researchers, clinicians, and practitioners from two different fields: signed language and spoken language. The volume examines theoretical and practical issues related to 12 topics ranging from test development and language assessment of bi-/multilingual learners to construct issues of second-language assessment (including the Common European Framework of Reference [CEFR]) and language assessment literacy in second-language assessment contexts. Each topic is addressed separately for spoken and signed language by experts from the relevant field. This is followed by a joint discussion in which the chapter authors highlight key issues in each field and their possible implications for the other field. What makes this volume unique is that it is the first of its kind to bring experts from signed and spoken language assessment to the same table. The dialogues that result from this collaboration not only help to establish a shared appreciation and understanding of challenges experienced in the new field of signed language assessment but also breathes new life into and provides a new perspective on some of the issues that have occupied the field of spoken language assessment for decades. It is hoped that this will open the door to new and exciting cross-disciplinary collaborations.

Discussion of Issues Related to Score Use and Interpretation of First Spoken and Signed Language Assessments

2021 ◽  
pp. 75-84
Author(s):  
Patrick Boudreault ◽  
Bernard Camilleri ◽  
Charlotte Enns
Keyword(s):  
Normative Data ◽  
Native Speakers ◽  
First Language ◽  
Standardized Assessments ◽  
Deaf Children ◽  
Target Populations ◽  
Signed Language ◽  
Heterogenous Group ◽  
Language Assessments ◽  
The Difference

A standardized assessment of spoken languages will collect data from native, monolingual speakers, thus establishing the range of receptive and/or expressive abilities of children across different ages. Similarly, normative data for standardized assessments of signed language are established by collecting data from native signing deaf children. Where the difference arises is the way in which the normative data relate to the target populations and the individuals within those populations who are being assessed. While standardized assessments of spoken language are normed on and predominantly intended for use with native speakers of that language, standardized assessments of signed language are intrinsically designed for use with a heterogenous group of children, of whom only a minority have the opportunity of learning signed language as their native language. In this chapter, key items related to score use and interpretation in first language (L1) assessment that were presented in Chapters 2.1 and 2.2 will be jointly discussed by the authors.

Scoring Second Signed Language Assessment

2021 ◽  
pp. 315-328
Author(s):  
Tobias Haug ◽  
Eveline Boers-Visker ◽  
Wolfgang Mann ◽  
Geoffrey Poor ◽  
Beppie Van den Bogaerde
Keyword(s):  
Language Production ◽  
Interrater Reliability ◽  
Language Assessment ◽  
Rating System ◽  
Assessment Instruments ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Signed Language ◽  
Assessment Research

There exists a scarcity in signed language assessment research, especially on scoring issues and interrater reliability. This chapter describes two related assessment instruments, the SLPI and the NFA, which offer scoring criteria. Raters are provided with scales for evaluating the different components of the language production of the candidate. Through its use, the rating system has been proved successful; there is, however, hardly any data on interrater reliability. In this chapter, the authors describe reliability issues with attention to raters’ training and score resolution techniques and discuss how to identify and increase rater reliability. The dearth of knowledge on signed language assessment, and in particular its validity and reliability, indicates an urgent need for more research in this area.

Dynamic Assessment of Learners of a Signed Language

2021 ◽  
pp. 101-112
Author(s):  
Wolfgang Mann ◽  
Joanna Hoskin ◽  
Hilary Dumbrill
Keyword(s):  
Dynamic Assessment ◽  
School Setting ◽  
Language Assessment ◽  
The Other ◽  
Deaf Children ◽  
Future Directions ◽  
Signed Language ◽  
Dynamic Language ◽  
Anecdotal Information

In this chapter, the authors discuss the use of dynamic language assessment with signing deaf children. This is a fairly new area, and, in spite of the growing interest on behalf of researchers and practitioners, there is very limited research. Given the lack of available studies, the authors use anecdotal information that draws on observations made by two of the authors from their own work with signing deaf children, one in a hospital and the other in a school setting. Some of the questions that will guide the discussions are: What makes dynamic assessment useful for signing deaf children? And, how do we determine that dynamic assessment is appropriate for a particular child, and how do we evaluate whether it works? The authors finish with a look at possible future directions and present recommendations on how to make dynamic assessment (more) meaningful for use with signing deaf children.

Sign in / Sign up

Export Citation Format

Share Document