Predictability of IELTS in a high-stakes context: a mixed methods study of Chinese students’ perspectives on test preparation

High-stakes language tests are used around the world as a gatekeeping tool under the internationalization of higher education. However, the predictable aspect of the high-stakes language tests is seldom discussed, especially from students’ perspectives. This study aims to address this gap by aiming to better understand how certain factors and conditions contribute to the predictability issue of IELTS from students’ perspectives within a high-stakes context. This study used a mixed method approach to investigate the views and experiences of students within a Sino-UK joint college. The data collection was in two concurrent strands: online survey and group interviews. Findings suggested that IELTS can impact students negatively by narrowing their English learning scope, driving them into self-isolated way of study, doing repeated test-taking and buying predicted answers. Implications related to language test preparation are discussed in light of the findings.

Saudi EFL Learners’ FLA: Levels, Causes, Gender, and Impact on Academic Performance

As a common psycholinguistic barrier that hinders EFL learning, Foreign Language Anxiety (FLA) has become an important study area in EFL learning and teaching. This study investigated the level and causes of FLA among 69 first-year EFL learners at Bisha University in Saudi Arabia. The influence of gender on the level of FLA was also examined. Moreover, the study examined the impact of FLA on the participants' language achievement. The researchers utilized a modified version of the Foreign Language Classroom Anxiety Scale (FLCAS). The Statistical Package for the Social Sciences (SPSS) and Microsoft Excel were used to analyse the data. The results showed that most learners typically had a moderate level of FLA caused by communication apprehension and fears related to negative feedback and language tests. The results also revealed that gender does not affect the level of FLA. In addition, the results indicated that high levels of FLA among learners had a significant impact on their performance. Based on these findings, this study provided recommendations for teachers to mitigate the causes of FLA.

Design of Signed Language Tests for Deaf L1 Children

Recent changes in the earlier diagnosis of deafness and improved amplification options have meant that deaf children increasingly have better opportunities to develop spoken language. Nevertheless, a significant proportion of children continue to use signed language as a first language (L1), including deaf and hearing children in deaf signing families and deaf children in hearing families where families use signed language in the home. For both groups, mastery of sign language as an L1 is important because it paves the way to communication and also because it provides the basis for development of spoken language, in either its oral or written form, as a second language (L2). It is crucial that signed language development proceeds in an age-appropriate manner, and assessments of signed language are therefore important to ensure that this is the case. However, the development of effective tests of signed language acquisition is not without challenges. This chapter presents these challenges and other issues and gives examples of how available tests seek to overcome them.

Construct in Assessments of Signed Language

Descriptions of test constructs in second signed language assessment, such as vocabulary knowledge, are rare and far from receiving the attention by the field of signed language test research that they deserves. Detailing the construct in second signed language assessment poses a challenge for obvious reasons: only very few published studies on signed language tests for adult learners are available, and none of them focuses on construct-related issues. Equally, there is a shortage of operationally used test instruments accessible for review. In this chapter, published studies on second signed language assessment will be reviewed, focusing specifically on construct representation; tests that are used for hiring and promotion are discussed and an example of how to define the construct for a signed language test is discussed.

Design of Spoken Language Tests for Hearing L1 Children

The identification of language problems and subsequent evaluation of interventions depend in part on the availability of useful and psychometrically robust assessments to determine the nature and severity of a child’s problems and monitor progress. This chapter addresses issues involved in the development of spoken language tests for L1 children and the ways in which they have been addressed, with reference to specific examples. Spoken language here refers to oral language, both receptive (comprehension) and expressive (production). The authors draw on a range of existing tests to illustrate the decisions that need to be made when assessing children’s language; they then discuss issues that arise in the development of new tests, drawing on examples of tests that the authors have themselves developed.

Discussion of Issues Related to Spoken and Signed Language Test Design for L1 Children

This chapter is a joint discussion of key items related to the development of spoken language tests (Chapter 1.1) and signed language tests (Chapter 1.2) for L1 children and the ways in which they have been addressed. We highlight the common issues and challenges in spoken and signed language assessment as well as the differences, e.g., availability of tests. In so doing, we consider how experience with spoken language assessment—for example, the development of methods for assessing language abilities that are independent of language experience—may inform test development in signed language. We also consider how awareness of issues in signed language assessment may increase awareness of similar issues that are easily overlooked in spoken language assessment—for example, the range of communication contexts and partners that children regularly encounter—and stimulate critical reflection on the use of language tests in general. One specific recommendation the chapter has for developers of signed language tests in the future is to consider areas that are unique to signed communication and critical to signing children’s language development.

Validation of Signed Language Assessments for Adult L2 Learners

This chapter focuses on the validity of tests of second language (L2) signed language learners. Test validity depends on how test developers take the language as well as the modality into consideration and how the test captures natural variation in local signed languages, which impacts the use of tests and interpretation of results. In this chapter, the argument-based approach to validation is used to evaluate claims that test developers make about the uses of tests. A sample of signed language tests for L2 learners is reviewed and discussed. Caution in the extrapolation and making decisions based on test results are discussed. The chapter ends with suggestions about how to evaluate the validity of future L2 signed language tests.

Language Assessment Literacy in Second Signed Language Assessment Contexts

There are growing numbers of students who enroll sign language programs. Most of them are hearing students whose first language is in the aural-oral modality. Learning signed language challenges them to communicate via the visual-manual modality; a process that is known to be demanding (Kemp, 1998). Therefore, in instruction it is essential to monitor this process by means of effective and efficient assessment (Miller et al., 2008). Rather remarkably, there are only a few tests developed to assess students’ proficiency in sign language. This implies that most instructors, who are involved in sign language teaching, have to develop tests and assessments themselves. Complicating factor, however, is that most instructors are not specifically trained on this topic, i.e. their knowledge and skills to evaluate or design language tests is limited. In this chapter, we will bring issues to view that are involved with the design of sign language assessments. Sign language proficiency can be broken down into two components: the visual receptive and manual expressive component. The assessment of these components will be discussed in the context of validity, reliability, authenticity, impact and practicality. We aim to provide a comprehensive matrix of issues in test design, with special focus on the pitfalls one may encounter in using or developing sign language tests for production as well as receptive skills. The matrix is a first attempt to provide a knowledge base on sign language assessment that might be helpful for instructors to become more literate on the subject matter.