Critical language assessment literacy of EFL teachers: Scale construction and validation

Critical language assessment (CLA) has been addressed in numerous studies. However, the majority of the studies have overlooked the need for a practical framework to measure the CLA dimension of teachers’ language assessment literacy (LAL). This gap prompted us to develop and validate a critical language assessment literacy (CLAL) scale to further underscore the role of CLA principles and their practice as an essential part of teachers’ LAL. In the first phase, a pool of items was generated through a comprehensive review of the related studies. In the quantitative phase, the developed scale was administered to 255 English as a foreign language teachers selected through convenience and snowball sampling. The data were analyzed through exploratory factor analysis for construct validity and Cronbach’s alpha for estimating internal consistency. The results showed that the items loaded on five factors: (a) teachers’ knowledge of assessment objectives, scopes, and types; (b) assessment use consequences; (c) fairness; (d) assessment policies; and (e) national policy and ideology. It was found that the scale had a high level of internal consistency and construct validity, which suggests that this scale has the potential to be useful in assessing language teachers’ CLAL and to raise language teachers’ awareness of CLAL constructs.

Applying Assessment Principles during Emergency Remote Teaching: Challenges and Considerations

One of the main challenges higher educational institutions encounter amid the recent COVID-19 crisis is transferring assessment approaches from the traditional face-to-face form to the online Emergency Remote Teaching approach. A set of language assessment principles, practicality, reliability, validity, authenticity, and washback, which can be applied to any academic subject, are critical within the design of any task that aims to assess learning. This review paper discusses how assessment approaches need to be modified in a time of crisis. It determines the position assessment should adopt within emergency remote teaching methods and analyzes the fundamental characteristics of five principles of assessment and how they can be accomplished with emergency remote teaching approaches. Furthermore, this paper evaluates the vulnerability and viability of the five assessment principles, examines the application of online assessment on a holistic level, and puts forward a set of recommendations to ensure the assessment principles are achieved within emergency remote learning contexts. The paper concludes with the notion that the construct of time, which is inherent within the principle of practicality, is the most significant when developing online assessments as it is this characteristic that is the most at risk. In addition, we suggest that the assessments that are implemented during emergency remote learning involve open-ended, as opposed to close-ended, questions and highlight the importance of educators demonstrating flexibility and understanding toward their students.

PENGEMBANGAN BUKU CERITA BERGAMBAR SEBAGAI MEDIA PEMBELAJARAN

DEVELOPMENT OF PICTURE STORY BOOKS AS LEARNING MEDIA Windi [email protected] UniversityABSTRACTThe background of this research is that the level of the education unit which is considered the basis for the cultivation of knowledge is at the elemntary school. Education pursued in basic education will be the foundation for the next education process. This study aims to develop a picture book of “Batu Belah Batu Betangkup” and to find out the feasbility of the picture story book. This picture book product is made using the cup studio paint application. The research method used is the 4D model consisting of four stages, namely difine, design, development, and dessiminate. Data collection was carried out using a questionnaire, the research instrument used had gone through a validation process with a validator. The type of data generated is quantitative data which is analyzed using the assessment criteria guidelines to determine the quantity of the product. Validation results from experts state that the pictorial story book product “Batu Belah Batu Betangkup” developed by the researher is very suitable for use. Expert assessment of product design with an average percentage pf 88,91% with a very feasible category, assessment of linguists with an average percentage of 95,8% with a very decent category, and field users based on the product with an average percentage of 95,83% and language assessment with an average percentage of 95,5% in the very feasible category and the student response product frial obtained 91,5% with the very good category.

Equitable and Inclusive (Classroom-Based) Foreign Language Assessment Using Universal Design for Learning

In increasingly diverse learner groups, it must be ensured that foreign language learners can reach their full potential, so diverse learner needs have to be catered to in teaching and in assessment contexts. Providing accessibility of learning, teaching, and assessment is a matter of equity and has increasingly been embraced as a principle of foreign language assessment. However, accessibility of language assessment has often been seen as a retrospective accommodation rather than a flexible planning of language assessment from the start. The purpose of the chapter is to discuss the potential of Universal Design for Learning (UDL) for (planning) classroom-based language assessment (CBLA) procedures in order to foster equitable and inclusive language assessment. After clarifying relevant terms, the notion of accessibility will be applied to foreign language assessment. UDL as a flexible framework for individualized language learning will be presented and illustrated for a foreign language context before its potential for classroom-based learning assessment (CBLA) is discussed and exemplified.

An Assets-Oriented, Formative Oral Language Assessment for Multilingual Students

This chapter introduces an assets-oriented oral language formative assessment tool for use with multilingual students. The assessment tool, called the Oral Language Record (OLR), was developed to help teachers listen to, record, and analyze authentic student talk in a variety of settings. It provides valuable information about the vocabulary and language structures that students use, helps determine current instructional needs, provides a frame for capturing student talk, and documents growth over time. The OLR contains a continuum based on observable behaviors and an analysis tool that helps teachers determine next steps in instruction based on their observations. Used in conjunction with a student's writing sample and observation of the child's reading, the OLR provides a holistic view of a multilingual student's language and literacy acquisition, enabling the teacher to focus on the child's linguistic strengths to plan future instruction.

On The Convenience of Teaching Languages Based on the Foreign Language Assessment System and the CEFR System

Through this article, we have discussed how and when and where the CEFR system, the most convenient and knowledge-based language learning system in the world today, was created and improved. Keywords: The Common European Framework, comprehensive way, knowledge and skills, professionals working, taxonomic nature.

The Handbook of Language Assessment Across Modalities

In Language Assessment Across Modalities: Paired-Papers on Signed and Spoken Language Assessment, volume editors Tobias Haug, Wolfgang Mann, and Ute Knoch bring together—for the first time—researchers, clinicians, and practitioners from two different fields: signed language and spoken language. The volume examines theoretical and practical issues related to 12 topics ranging from test development and language assessment of bi-/multilingual learners to construct issues of second-language assessment (including the Common European Framework of Reference [CEFR]) and language assessment literacy in second-language assessment contexts. Each topic is addressed separately for spoken and signed language by experts from the relevant field. This is followed by a joint discussion in which the chapter authors highlight key issues in each field and their possible implications for the other field. What makes this volume unique is that it is the first of its kind to bring experts from signed and spoken language assessment to the same table. The dialogues that result from this collaboration not only help to establish a shared appreciation and understanding of challenges experienced in the new field of signed language assessment but also breathes new life into and provides a new perspective on some of the issues that have occupied the field of spoken language assessment for decades. It is hoped that this will open the door to new and exciting cross-disciplinary collaborations.

Discussion of Issues Related to Assessment of Signed or Spoken Language Development in Children with Autism Spectrum Disorder

This chapter is a joint discussion of key items presented in Chapters 4.1 and 4.2 related to the assessment of deaf and hearing children on the autism spectrum . From these chapters it becomes apparent that a number of aspects associated with signed language assessment are relevant to spoken language assessment. For example, there are several precautions to bear in mind about language assessments obtained via an interpreter. Some of these precautions apply solely to D/HH children, while others are applicable to assessments with hearing children in multilingual contexts. Equally, there are some aspects of spoken language assessment that can be applied to signed language assessment. These include the importance of assessing pragmatic language skills, assessing multiple areas of language development, differentiating between ASD and other developmental disorders, and completing the language evaluation within a developmental framework. The authors conclude with suggestions for both spoken and signed language assessment.

Discussion on Scoring Issues in Second Signed or Spoken Language Assessment

This chapter is a joint discussion of key items related to scoring issues related to signed and spoken language assessment that were discussed in Chapters 9.1 and 9.2. One aspect of signed language assessment that has the potential to stimulate new research in spoken second language (L2) assessment is the scoring of nonverbal speaker behaviors. This aspect is rarely represented in the scoring criteria of spoken assessments and in many cases not even available to raters during the scoring process. The authors argue, therefore, for a broadening of the construct of spoken language assessment to also include elements of nonverbal communication in the scoring descriptors. Additionally, the importance of rater training for signed language assessments, application of Rasch analysis to investigate possible reasons of disagreement between raters, and the need to conduct research on rasting scales are discussed.

Scoring Second Signed Language Assessment

There exists a scarcity in signed language assessment research, especially on scoring issues and interrater reliability. This chapter describes two related assessment instruments, the SLPI and the NFA, which offer scoring criteria. Raters are provided with scales for evaluating the different components of the language production of the candidate. Through its use, the rating system has been proved successful; there is, however, hardly any data on interrater reliability. In this chapter, the authors describe reliability issues with attention to raters’ training and score resolution techniques and discuss how to identify and increase rater reliability. The dearth of knowledge on signed language assessment, and in particular its validity and reliability, indicates an urgent need for more research in this area.