A Qualitative Analysis of Rater Behavior on an L2 Speaking Assessment

2015 ◽  
Vol 12 (3) ◽  
pp. 239-261 ◽  
Author(s):  
Hyun Jung Kim
2018 ◽  
Vol 35 (3) ◽  
pp. 377-401 ◽  
Author(s):  
Daniel M. K. Lam

The ability to interact with others has gained recognition as part of the L2 speaking construct in the assessment literature and in high- and low-stakes speaking assessments. This paper first presents a review of the literature on interactional competence (IC) in L2 learning and assessment. It then discusses a particular feature – producing responses contingent on previous speakers’ contributions – that emerged as a de facto construct feature of IC, oriented to both candidates and examiners within the school-based group speaking assessment in the Hong Kong Diploma of Secondary Education (HKDSE) English Language Examination. Previous studies have, similarly, argued for the importance of responding to or linking one’s own talk to previous speakers’ contributions as a way of demonstrating comprehension of co-participants’ talk. However, what counts as such a response has yet to be explored systematically. This paper presents a conversation analytic study of the candidate discourse in the assessed group interactions, identifying three conversational actions through which student-candidates construct contingent responses to co-participants. The thick description about the nature of contingent responses lays the groundwork for further empirical investigations on the relevance of this IC feature and its proficiency implications.


2020 ◽  
pp. 026553222095150
Author(s):  
Xun Yan ◽  
Ha Ram Kim ◽  
Ji Young Kim

Speech fluency has been extensively researched as a core construct for second language (L2) speaking assessment. Despite the broad consensus on its multifaceted nature, few researchers have empirically explored the dimensionality of this construct. Operationalizations of fluency vary across research and practice, using both holistic and fine-grained features. To address the dimensionality of speech fluency, in this study we examined an array of fluency features of speaking performances on the Aptis test. We conducted both univariate and multivariate statistical analyses to investigate the relationship between individual fluency features and language proficiency, as well as the relationships among fluency, complexity, and accuracy features. We found differences in the holistic and fine-grained fluency features, suggesting that they might reflect different dimensions of speech fluency and be associated with different components of language proficiency. Based on the findings, we labeled these two types of fluency features as macro and micro fluencies. Whereas macro fluency features tend to entail a holistic representation of fluency, micro fluency features tend to be more closely related to the automatic processing of lexico-grammar, constituting a more direct reflection of the cognitive processes in speech production. The findings support the multidimensionality of speech fluency and the need to include both macro and micro fluency features in the scoring, scale development, and validation of L2 speaking assessment.


System ◽  
2016 ◽  
Vol 63 ◽  
pp. 13-27 ◽  
Author(s):  
Heng-Tsung Danny Huang

2016 ◽  
Vol 35 (1) ◽  
pp. 27-49 ◽  
Author(s):  
Heng-Tsung Danny Huang ◽  
Shao-Ting Alan Hung ◽  
Lia Plakans

Integrated speaking test tasks (integrated tasks) provide reading and/or listening input to serve as the basis for test-takers to formulate their oral responses. This study examined the influence of topical knowledge on integrated speaking test performance and compared independent speaking test performance and integrated speaking test performance in terms of how each was related to topical knowledge. The researchers derived four integrated tasks from TOEFL iBT preparation materials, developed four independent speaking test tasks (independent tasks), and validated four topical knowledge tests (TKTs) on a group of 421 EFL learners. For the main study, they invited another 352 students to respond to the TKTs and to perform two independent tasks and two integrated tasks. Half of the test takers took the independent tasks and integrated tasks on one topic combination while the other half took tasks on another topic combination. Data analysis, drawing on a series of path analyses, led to two major findings. First, topical knowledge significantly impacted integrated speaking test performance in both topic combinations. Second, the impact of topical knowledge on the two types of speaking test performances was topic dependent. Implications are proposed in light of these findings.


Sign in / Sign up

Export Citation Format

Share Document