Critical language assessment literacy of EFL teachers: Scale construction and validation

Critical language assessment (CLA) has been addressed in numerous studies. However, the majority of the studies have overlooked the need for a practical framework to measure the CLA dimension of teachers’ language assessment literacy (LAL). This gap prompted us to develop and validate a critical language assessment literacy (CLAL) scale to further underscore the role of CLA principles and their practice as an essential part of teachers’ LAL. In the first phase, a pool of items was generated through a comprehensive review of the related studies. In the quantitative phase, the developed scale was administered to 255 English as a foreign language teachers selected through convenience and snowball sampling. The data were analyzed through exploratory factor analysis for construct validity and Cronbach’s alpha for estimating internal consistency. The results showed that the items loaded on five factors: (a) teachers’ knowledge of assessment objectives, scopes, and types; (b) assessment use consequences; (c) fairness; (d) assessment policies; and (e) national policy and ideology. It was found that the scale had a high level of internal consistency and construct validity, which suggests that this scale has the potential to be useful in assessing language teachers’ CLAL and to raise language teachers’ awareness of CLAL constructs.

Digital Assessment Literacy in Online Courses (Formative/Summative)

Assessment is a valuable process that assists teachers to identify teaching practices that are effective for all students since not every student learns or retains information in the same way. In the open, distance, and e-learning (ODeL) environment, specific assessment strategies can be employed to make a judgment and make the best decisions about the student's achievement. Due to the nature of the ODeL learning environment, assessments should be digital for powerful insights without the paperwork. This chapter employed digital assessment literacy to provide a particular perspective of assessment strategies in the ODeL.

The Handbook of Language Assessment Across Modalities

In Language Assessment Across Modalities: Paired-Papers on Signed and Spoken Language Assessment, volume editors Tobias Haug, Wolfgang Mann, and Ute Knoch bring together—for the first time—researchers, clinicians, and practitioners from two different fields: signed language and spoken language. The volume examines theoretical and practical issues related to 12 topics ranging from test development and language assessment of bi-/multilingual learners to construct issues of second-language assessment (including the Common European Framework of Reference [CEFR]) and language assessment literacy in second-language assessment contexts. Each topic is addressed separately for spoken and signed language by experts from the relevant field. This is followed by a joint discussion in which the chapter authors highlight key issues in each field and their possible implications for the other field. What makes this volume unique is that it is the first of its kind to bring experts from signed and spoken language assessment to the same table. The dialogues that result from this collaboration not only help to establish a shared appreciation and understanding of challenges experienced in the new field of signed language assessment but also breathes new life into and provides a new perspective on some of the issues that have occupied the field of spoken language assessment for decades. It is hoped that this will open the door to new and exciting cross-disciplinary collaborations.

Discussion of Issues Related to Language Assessment Literacy in Second Signed and Spoken Languages

This chapter is a joint discussion of key items related to language assessment literacy related to signed and spoken language assessment that were discussed in Chapters 11.1 and 11.2, and the implications that these issues might have on the other field. It is clear that language assessment literacy (LAL) in the context of signed languages—(S)LAL by the authors—is still in a very nascent form. Although in the field of spoken language assessment there is a tendency to discuss LAL as being a “new” development and recent scholarship suggests that issues and constructs remain undertheorized, there is a considerable body of literature on LAL oriented toward spoken language (as surveyed in the Chapter 11.1), to the extent that LAL is now a core area of research and scholarship in the field. This is in sharp contrast with the paucity addressing LAL in the context of signed languages. This chapter is the result of a collaborative process during which the two sets of authors read each other’s chapters and responded to a set of guided questions. The result is the synthesis of this dialogic process.

Language Assessment Literacy in Second Spoken Language Assessment Contexts

This chapter provides an overview of language assessment literacy (LAL) as it relates to spoken language assessment. The chapter begins by charting developments in how LAL has been defined and conceptualized in language assessment research. Then, specific knowledge and skills related to the assessment of spoken language are discussed, organized according to the nine dimensions of LAL identified in Kremmel and Harding’s survey-based study. Critical issues are raised throughout with respect to the unique challenges involved in assessing spoken language in a fair, equitable, and inclusive manner. The authors conclude by pointing to future directions for LAL and highlight the increasingly important role of technology in language assessment practices.

Multiple Stakeholder Interaction to Enhance Preservice Teachers’ Language Assessment Literacy

Conducted in a U.S. English-to-Speakers-of-Other-Languages (ESOL) preservice teacher education program, this case study aimed to explore a dynamic process of preservice teachers’ development of language assessment literacy (LAL). By inviting multiple stakeholders, namely preservice teachers, an inservice teacher and her ESOL students, and their course instructor, this study closely examined the interaction among the stakeholders during a semester-long language assessment development project as a process to develop LAL. The project, which was composed of planning, development, implementation, and reflection stages, was innovative in that it: (a) involved the multiple stakeholders; (b) focused on their dynamic interactions and multi-directional influences on all the participants’ enhancement of LAL; and (c) was conducted in an online format. By employing thematic analyses on interactions among the stakeholders, this study described and analyzed how preservice teachers contextualize their assessment while negotiating the needs of the inservice teachers and their students with assistance from the course instructor. The paper identified practical benefits and challenges of professional training where multiple stakeholders are involved. It also highlighted the non-linear dynamic process of preservice teachers’ development of LAL.

Chancen des inklusionsorientierten Sachunterrichts für didaktisch-diagnostisches Handeln. Konzeptionelle und methodologisch-methodische Grundlagen eines forschungsbasierten Entwicklungsansatzes für die Lehrer*innenbildung

In der Herausforderung Unterricht inklusionsbezogen weiterzuentwickeln, manifestiert sich unter anderem die Forderung nach der Qualifizierung von (angehenden) Lehrkräften bzgl. der Anwendung und Umsetzung einer alltagsintegrierten Diagnostik mit dem Ziel, Kinder individualisiert und gleichzeitig mit Bezug auf einen gemeinsamen Lerngegenstand zu unterrichten. Dabei ist ein didaktisch-diagnostisches Handeln aller Lehrkräfte gefordert, welches im Kontext einer professionellen und inklusionsorientierten Gestaltung sowie einer angemessenen Begleitung und Förderung von Lern- und Entwicklungsprozessen steht. In der Konzeption entsprechender Aus- und Weiterbildungsformate setzt das geplante Projekt DiPoSa (Didaktisch-diagnostische Potentiale des inklusionsorientierten Sachunterrichts) an. Ziel ist es durch einen Design-Based-Research-Ansatz (DBR) Videovignetten zu erstellen und zu evaluieren, mittels derer entsprechende Kompetenzen von (angehenden) Lehrkräften im Sachunterricht weiterentwickelt werden können. Dabei bietet insbesondere der Sachunterricht als vielperspektivisches Integrationsfach der Grundschule einen passenden Rahmen, kindliche Lernpotentiale als Ausgangspunkt für didaktisch-diagnostisches Handeln nutzbar zu machen. Denn in aktuellen inklusionsorientierten Ansätzen des Sachunterrichts sind sowohl reformpädagogisch orientierte als auch offene Konzepte und Modelle des adaptiven Unterrichts zu finden, die sich an den unterschiedlichen Programmatiken der Umsetzung von individueller Förderung orientieren. Im folgenden Beitrag werden die dem geplanten Projekt zugrundeliegenden theoretischen und empirischen Zugänge erläutert und die forschungsmethodische Umsetzung durch einen DBR-Ansatz als methodologische Basis für eine Theorie-Praxis-verzahnende Forschungsperspektive auf diagnostisches Handeln sowie die Förderung diagnostischer Handlungskompetenzen durch Videovignetten im Kontext der Aus- und Weiterbildung von (Sachunterrichts-)Lehrkräften diskutiert. Abstract The challenge to further promote practices of inclusive teaching, requires the development of assessment literacy. Combined with the aim to teach all children in a collaborative learning environment, qualification of teachers (in training) in the application and implementation of formative assessment as an integrated daily routine is needed. Therefore, the project DiPoSa focuses on the development of appropriate training and qualification formats. The project heads to create and evaluate video vignettes using a design-based-research approach (DBR), which can then be used to further develop assessment literacy of teachers in social studies and science in primary education. As a multi-perspective integrative subject in elementary school social studies and science in primary education offers a suitable framework for practices of formative assessment taking children's learning potentials as a serious concern. Foundations can be seen in current inclusive approaches to social studies and science in primary education, where reform pedagogically orientation and open concepts can as well be found as models of adaptive teaching. Although there are different theoretical and programmatic implementations, both perspectives share an orientation towards individual support of children. With this in mind the following article tries to lay down the theoretical and empirical approaches of the planed project DiPoSa and discusses methodological foundations of the project. The discussion focuses on how assessment practices as well as assessment literacy can be promoted through a DBR research-design using video vignettes in the context of teacher education and qualification and rooting in a deepened science-practice partnership.Zusammenfassung englisch

Development of Vietnamese Pre-service EFL Teachers' Assessment Literacy

<p>The importance of teachers’ assessment literacy has been increasingly emphasised in the literature. However, very little research has paid attention to pre-service EFL teachers’ assessment literacy and how they develop this area during teacher training programmes. Moreover, there is a paucity of research on Vietnamese pre-service EFL teachers’ assessment literacy. This study was conducted in three phases to address these gaps: (1) Phase 1 provided a description of current assessment training at four Vietnamese teacher training universities, (2) Phase 2 attempted to map out pre-service EFL teachers’ confidence levels in assessment literacy, and (3) Phase 3 mainly focused on the development of four pre-service EFL teachers’ assessment literacy during their nine-week practicum at Bach Dang University (pseudonym). Phase 1 relied on individual semi-structured interviews with four Vietnamese teacher-trainers to describe the current status of assessment training for pre-service EFL teachers at four key teacher training universities in terms of: (1) teacher-trainers’ background, (2) course content, (3) method of instruction, (4) support for assessment training, and (5) constraints of assessment training. The teacher-trainers noted their lack of professional development in testing and assessment. The method of instruction varied for different teacher training universities. The results showed a greater emphasis on training in summative rather than formative assessment. Also, teacher-trainers identified two main constraints in the current training programmes including: (i) the lack of systematic innovation in language testing and assessment and (ii) the lack of labour, facilities and time for language testing and assessment training. In Phase 2, a questionnaire of pre-service EFL teachers’ confidence levels in assessment literacy was developed and validated. It was then administered to 365 pre-service EFL teachers. The results indicated pre-service EFL teachers’ high confidence levels in assessment literacy. Moreover, gender and career choice did not influence their confidence levels in assessment literacy while teaching experience and training in language testing and assessment did. However, those who had had more training scored lower confidence levels in assessment literacy. Phase 3 was conducted in two parts to focus on assessment literacy development of four pre-service EFL teachers. Part 1 had two stages. Stage 1 administered the same questionnaire as in Phase 2 to thirty-one pre-service EFL teachers to investigate their confidence levels in assessment literacy over three time periods: before their language testing and assessment course, before their practicum, and after their practicum. The findings showed a significant statistical increase in their assessment literacy confidence levels. In Stage 2, eighteen pre-service EFL teachers in Stage 1 participated in two semi-structured focus group interviews to check if their confidence levels reflected their assessment literacy. The results indicated a need for data triangulation to claim their assessment literacy based on confidence levels. Part 2 employed different research instruments including interviews, observation, stimulated recalls, and questionnaires to examine assessment literacy development of four pre-service EFL teachers over a nine-week practicum. The data indicated three main themes in pre-service EFL teachers’ development in assessment literacy: (1) pre-service EFL teachers’ development in: (i) giving feedback, (ii) designing test items, (iii) administering tests, (iv) observing students’ learning, (v) giving instructions, and (vi) improving their content knowledge, (2) pre-service EFL teachers’ individual differences in their assessment literacy development, and (3) incident-based learning of assessment literacy. Overall, this study offered insights into the dynamic, situated and developmental nature of pre-service EFL teachers’ assessment literacy, which has useful implications for theory, research methodology and assessment training for pre-service EFL teachers. Moreover, the findings are very practical for different levels of administration, and for my role as a teacher-trainer in Vietnam.</p>