Using MFRM and SEM in the Validation of Analytic Rating Scales of an English Speaking Assessment

Author(s):  
Jinsong Fan ◽  
Trevor Bond
2013 ◽  
Vol 7 ◽  
pp. 234-251
Author(s):  
Zakia Noor Matin

For a comprehensive development of students’ communication skills, reading, writing, listening and speaking are equally important to be emphasized. At the learning process, assessment is the final step where the learners get feedback of what they have been taught and how much they have learned. The study aims to show the current approach of assessing students’ English speaking skill (the most important medium of communication) at the Secondary and Higher Secondary levels, and how far this approach helps students develop language skills. Finally, the study intends to find out the reason of students’ reluctance in improving English speaking skill and evaluate their sufferings at the tertiary level. A survey was conducted among one hundred students of three private universities. Majority of them have come from Bangla medium institutions. The syllabuses (2008), text books and question papers (2006 to 2010) are used as reference for this study. The research was exploratory and three private universities of Dhaka city were selected as study area. Irrespective of the discipline of the study, 100 students were interviewed through a structured questionnaire. The academic practice of the students in secondary and higher secondary levels was portrayed retrospectively and the obstacles they were facing at the tertiary level were analysed according to the objective of the study. This is also a finding which shows a rift between the objective of introducing Communicative Language Teaching (CLT) and the assessment technique followed by National Curriculum and Text Books Board. DOI: http://dx.doi.org/10.3329/sje.v7i0.14476 Stamford Journal of English; Volume 7; Page 234-251


2017 ◽  
Vol 35 (2) ◽  
pp. 239-269 ◽  
Author(s):  
Shinhye Lee ◽  
Paula Winke

We investigated how young language learners process their responses on and perceive a computer-mediated, timed speaking test. Twenty 8-, 9-, and 10-year-old non-native English-speaking children (NNSs) and eight same-aged, native English-speaking children (NSs) completed seven computerized sample TOEFL® Primary™ speaking test tasks. We investigated the children’s attentional foci on different test components (e.g., prompts, pictures, and a countdown timer) by means of their eye movements. We associated the children’s eye-movement indices (visit counts and fixation durations) with spoken performance. The children provided qualitative data (interviews; picture-drawings) on their test experiences as well. Results indicated a clear contrast between NNSs and NSs in terms of speech production (large score differences) as expected. More interestingly, the groups’ eye-movement patterns differed. NNSs tended to fixate longer on and looked more frequently at the countdown timer than their NS peers, who were more likely to look at content features, that is, onscreen pictures meant to help with building up speech. Specifically, the NNSs’ fixations on timers were likely to co-occur with hesitation phenomena (e.g., hemming; pausing; silence). We discuss (a) the potential effects of test-specific features on children’s performance and (b) child-appropriate test accommodations and practices.


2021 ◽  
Vol IX(256) (100) ◽  
pp. 26-30
Author(s):  
D. Stelmakh

The article focuses on the assessment and peer – assessment of the foreign language speaking production skills of the 1st year pre – service teachers. The analysis of the existing evaluative tasks for speaking assessment has been done and best tasks for 2 types of monologues – a monologue – description and a monologue – narration have been collected. Successful assessment requires definite criteria to be chosen. In this paper criteria have been established and explained and 2 rating scales for a monologue – description and a monologue – narration have been developed.


2012 ◽  
Vol 21 (4) ◽  
pp. 353-364 ◽  
Author(s):  
M. Slade ◽  
M. Leamy ◽  
F. Bacon ◽  
M. Janosik ◽  
C. Le Boutillier ◽  
...  

Aims.Mental health policy internationally varies in its support for recovery. The aims of this study were to validate an existing conceptual framework and then characterise by country the distribution, scientific foundations and emphasis in published recovery conceptualisations.Methods.Update and modification of a previously published systematic review and narrative synthesis of recovery conceptualisations published in English.Results.A total of 7431 studies were identified and 429 full papers reviewed, from which 105 conceptualisations in 115 papers were included and quality assessed using established rating scales. Recovery conceptualisations were identified from 11 individual countries, with 95 (91%) published in English-speaking countries, primarily the USA (47%) and the UK (25%). The scientific foundation was primarily qualitative research (53%), non-systematic literature reviews (24%) and position papers (12%). The conceptual framework was validated with the 18 new papers. Across the different countries, there was a relatively similar distribution of codings for each of five key recovery processes.Conclusions.Recovery as currently conceptualised in English-language publications is primarily based on qualitative studies and position papers from English-speaking countries. The conceptual framework was valid, but the development of recovery conceptualisations using a broader range of research designs within other cultures and non-majority populations is a research priority.


2018 ◽  
Vol 34 (2) ◽  
Author(s):  
Nguyen Ho Hoang Thuy ◽  
Tran Thi Thanh Nga

The study was conducted to explore EFL teachers’ perceptions of in-class English speaking assessment. The constructs of teachers’ perceptions investigated in the current research included their general understanding of speaking assessment, the task types of in-class speaking assessment, and the teachers’ work involved in the assessment implementation. Questionnaire and interview were employed as data collection instruments of the study. Forty-two EFL teachers at different high schools in Quang Tri, Vietnam responded to the questionnaire and then five of them participated in the subsequent interview sessions. The findings revealed that the teachers’ perceptions of in-class English speaking assessment in terms of three investigated aspects were generally appropriate. Nonetheless, the teachers showed their limited knowledge about oral portfolios as a speaking assessment type; they also articulated their need for more instruction on how to implement self-assessment as a type of English speaking assessment.


Sign in / Sign up

Export Citation Format

Share Document