Using Inter-Rater Discourse to Trace the Origins of Disagreement: Towards Collective Reflective Practice in L2 Assessment

RELC Journal ◽  
2021 ◽  
pp. 003368822097737
Author(s):  
Joshua Matthews

This article explores how the analysis of inter-rater discourse can be used to support collective reflective practice in second language (L2) assessment. To demonstrate, a focused case of the discourse between two experienced language teachers as they negotiate assessment decisions on L2 written texts is presented. Of particular interest was the discourse surrounding the raters’ most divergent assessment decisions, which in this case were those relating to Task Achievement. Thematic analysis indicated that rater discourse predominantly focused on explicit objective factors, primarily the L2 texts and the rating scale; however, rater discourse also focused on more subjective, rater-centred factors. The discourse surrounding these rater-centred factors was often central to the identification and resolution of rating disagreements. The paper argues that the subjective dimension of language assessment needs to be more directly and systematically reflected upon in language teaching contexts and that analysis of rater discourse, especially discourse focused on points of disagreement between raters, provides a valuable mechanism to facilitate this.

2019 ◽  
Vol 36 (3) ◽  
pp. 31-54
Author(s):  
Sofia Cementina

Innovations in digital technologies have the potential to alter how people think, learn, communicate, and collaborate with others. Whereas changes in technology and its affordances have transformed social contexts and learning environments, instructors’ beliefs about digital technologies and pedagogy can affect technology integration behaviours and language teaching practices. This study used a two-phase approach to gain insights into teachers’ digital mindsets and their personal and professional use of technology. In total, 50 teachers were surveyed regarding their technological beliefs and practices, and, among them, three second language teachers were selected and interviewed. Results illustrate that participants recognized and embraced the affordances of digital technologies in their own lives, yet they failed to see their significance in language teaching and learning. Their attitudes and intentions associated with technology uses were compartmentalized; while teachers’ everyday practices were more digital and socially mediated, they struggled to adopt more technology-based teaching practices. Participants identified the lack of training in technology integration in language teaching hindered their use of digital resources, but findings indicate that the teachers’ reluctance to explore emerging technologies and their own technological beliefs and experiences influenced their mindset and teaching practices. Implications and recommendations for second language instruction are discussed. Les innovations de la technologie numérique ont le potentiel de modifier nos manières de penser, d’apprendre, de communiquer et de collaborer. Or, même si l’évolution technologique et ses affordances, ou potentialités, ont transformé les contextes sociaux et les milieux d’apprentissage, les croyances des professeurs concernant les technologies et la pédagogie numériques peuvent néanmoins influer sur les comportements relatifs à l’intégration des technologies aux pratiques liées à l’enseignement des langues. La présente étude est le compte rendu d’une approche en deux étapes adoptée afin de permettre de mieux comprendre la mentalité des professeurs face au numérique ainsi que leurs utilisations personnelles et professionnelles de la technologie. En tout, 50 professeurs ont fait l’objet d’un sondage concernant leurs croyances et leurs pratiques technologiques, y compris trois professeurs de langue seconde qui ont été sélectionnés pour une entrevue. Les résultats démontrent que même s’ils reconnaissent et recourent aux affordances des technologies numériques dans leur vie personnelle, les participantes et participants n’en reconnaissent point l’importance pour l’enseignement et l’apprentissage des langues. Leurs attitudes et intentions en lien avec les utilisations de la technologie étaient compartimentées : même si leurs pratiques quotidiennes étaient plus numériques et paissaient davantage par les médias sociaux, les professeurs avaient du mal à adopter des pratiques pédagogiques davantage fondées sur la technologie. Les participantes et participants ont précisé que le manque de formations dans le domaine de l’intégration de la technologie dans l’enseignement des langues les empêchait d’utiliser les ressources numériques, mais les constatations de l’enquête indiquent toutefois que leur répugnance à explorer les nouvelles technologies ainsi que leurs croyances et expériences technologiques personnelles avaient une influence sur leur mentalité et leurs pratiques pédagogiques. L’étude renferme une discussion des implications de cet état de fait et offre des recommandations pour l’enseignement d’une langue seconde.


2019 ◽  
Vol 4 (3) ◽  
pp. 3
Author(s):  
Diego Patricio Ortega-Auquilla ◽  
Cynthia Soledad Hidalgo-Camacho ◽  
Gerardo Estevan Heras-Urgiles

<p style="text-align: justify;">English language teachers are expected to implement lessons directed by the Communicative Language Teaching (CLT) into today’s classrooms. In this regard, it is pivotal to know about the theoretical framework of this key language teaching approach. The framework is partly made up of one of the most crucial Second Language Acquisition (SLA) hypotheses called the Interaction Hypothesis (IH). The IH claims that second language development is better facilitated when learners participate in negotiated interaction. From a CLT perspective, a second language is acquired more effectively through interaction and communication. When language teachers attempt to design and deliver classroom instruction grounded in CLT, it is imperative to be familiar with the essential notions behind the IH and its facilitative role in SLA. Therefore, this paper provides key information on the hypothesis at hand by analyzing its early version and updated version. In addition, Krashen’s comprehensible input and Hatch’s role of interaction and conversation on L2 learning are highlighted, because the IH evolved from these two scholars’ seminal works.  This paper also deals with three key interactional modification techniques - comprehension checks, confirmation checks, and clarification requests – promoted by the IH. With the intent of facilitating language learning, the design and deliver of communicative-oriented lessons should have a central role in the classroom. However, lessons are more likely to be effective when teachers take the theory of the IH into practice by allowing learners to engage in negotiation of meaning through the use of the aforementioned interactional modifications.</p>


2021 ◽  
Vol 3 (1) ◽  
pp. 120-130
Author(s):  
Ildikó Csépes

Language teachers’ assessment knowledge and skills have received considerable attention from language assessment researchers over the past few decades (Davison & Leung, 2009; Hill & McNamara, 2012; Rea-Dickins, 2001; Taylor, 2013). This seems to be linked to the increased professionalism expected of them in classroom-based assessments. However, teachers seem to face a number of challenges, including how large-scale standardized language exams influence their classroom assessment practices. Teachers’ assessment literacy, therefore, needs to be examined in order to explain their assessment decisions. In this paper, we review the concept of (language) assessment literacy, how it has evolved and how it is conceptualized currently. Recent interpretations seem to reflect a multidimensional, dynamic and situated view of (language) assessment literacy. Implications for teacher education are also highlighted by presenting research findings from studies that explored teachers’ and teacher candidates’ assessment literacy in various educational contexts. As a result, we can identify some common patterns in classroom assessment practices as well as context-specific training needs. Finally, we make a recommendation for tackling some of the challenges language teachers are facing in relation to classroom-based assessment in the Hungarian context.


2021 ◽  
Vol 12 (5) ◽  
pp. 688-695
Author(s):  
Majeed Noroozi ◽  
Seyyedmohammad Taheri

Since its advent, the principles of Task-Based Language Teaching have been extended to assessment giving rise to Task-Based Language Assessment. Despite the growing body of research on the efficacy of Task-Based Language Teaching in instruction, the application of the assessment based on the tenets of Task-Based Language Teaching has been mainly neglected in some studies owing to their lack of use of Task-Based Language Assessment to measure the effectiveness of Task-Based Language Teaching (viz., Li, et al., 2016). The present study emphasizes the importance of Task-Based Language Assessment and highlights the feature that distinguishes this type of assessment from other assessments. The study concludes that while the performance-referenced feature of Task-Based Language Assessment is an essential characteristic thereof, it is, in fact, the holistic and direct feature of Task-Based Language Assessment that distinguishes it from other assessments. The more the assessment measure is incorporated in the performance of assessment tasks, the more the assessment tasks are based on the tenets of Task-Based Language Assessment. Therefore, the holistic and contextualized assessment tasks improve the confidence with which language teachers could generalize the results of the assessment tasks to real-life situations.


2019 ◽  
Vol 8 (2S11) ◽  
pp. 2930-2933

The framework of complexity, accuracy and fluency (CAF) has gained currency in the area of applied linguistics research, language teaching and testing in order to analyze the oral language performance of second language speakers ever since Skehan (1996) proposed it. Many studies have tried to relate CAF framework with the various models of speech processing in order to ground it psycholingustically. However, there is a need to offer more clarity regarding the psycholinguistics of speech processing and its specific relationship with the complexity, accuracy and fluency. This paper is an attempt to situate CAF framework on Levelt’s Model of Speech Processing (Levelt 1989) thereby providing it a stronger psycholinguistics foundation. It also aims to provide a more specific explanation about what gets reflected as accuracy, complexity and fluency in speech. The paper concludes by offering more specific questions that second language teachers in particular and applied linguists in general may consider exploring the concept further.


2017 ◽  
Vol 17 (1) ◽  
pp. 6
Author(s):  
Muhammad Ladan Bello ◽  
Hadiza Bello Dange

Recently the use of technology and its integration into the curriculum has gained a great importance. One of this technological devices is mobile phones which is usually banned at school due to the distractions and problems caused by different built-in and installed applications, However, the use of these installed applications such as Telegram on these handheld device especially smart phones in second language teaching is going to assist in effective language teaching and allow students to actively participate in teaching and learning. Keeping all these in mind, the purpose of this presentation is to provide the required information for second language teachers so that they can make use of Telegram efficiently in language classroom.


2020 ◽  
Vol 7 (1) ◽  
pp. 24
Author(s):  
Manyasi N. Beatrice

Language teachers’ knowledge of pronunciation pedagogy affects their classroom practice. The study sought to find out language approaches used to teach pronunciation and to establish how teachers’ mastery of pronunciation facilitate the acquisition of sounds by learners. The findings revealed that teachers of English had challenges when teaching pronunciation hindering mastery of English sounds by learners. Some of their pronunciation was not comprehensible distorting meaning. They used imitation, phonetic transcriptions, minimal pair drills and sentence drills to teach pronunciation. It was established that some of them had pronunciation difficulties affecting the intelligibility or comprehensibility of what they were communicating about. Learners do not have to achieve native like pronunciation but they should surpass the threshold level to ensure that their pronunciation does not distort the meaning of what they communicate. When a teacher who is meant to be a role model and source of input for learners uses incomprehensible pronunciation distorting meaning, it is a significant setback to English Language Teaching (ELT). There is need to reassess policies concerning who should be trained to teach English as a Second Language.


2020 ◽  
pp. 79-89
Author(s):  
Tetiana Koknova ◽  
Serhii Kharchenko ◽  
Nadia Bilyk ◽  
Svitlana Sechka

Ukrainian Universities today encourage the principles of competency-based education in higher education, but the study of literature generally seems to discourage this process in a more theoretical way. The research reported here is a part of a more extensive doctoral study that aims to examine the process of competency-based education of English as Second Language teachers in Ukraine. This paper seeks to answer the following questions: could one apply the principles of competency-based education to create an appropriate educational environment for prospective English as Second Language teachers; would it improve the way to design the programs for their professional training and advance the language teaching process in Ukrainian Universities? This article reports on an investigation associated with the implementation of a pedagogical experiment that proves the effectiveness of the specially modeled educational environment created to design the training programs for prospective English as second language teachers within competency-based education at Taras Shevchenko National University and Donbas State Pedagogical University. This paper contains the comparative analysis of two Philology Master students groups to discover whether the traditional educational environment or competency-based one produces a better educational effect on the language teaching process. This study employs a mixed-method resulting in qualitative and quantitative data. The paper concludes by presenting recommendations for Ukrainian Universities, which major in training prospective English as Second Language teachers. Moreover, future research related to applying this educational model for students in different grades is still a potential area to be studied further.


Sign in / Sign up

Export Citation Format

Share Document