Using standardized achievement and oral proficiency tests for self-assessment purposes: the DLIFLC study

1990 ◽  
Vol 7 (2) ◽  
pp. 202-229 ◽  
Author(s):  
Patrick Blanche
Author(s):  
Erica Sandlund ◽  
Pia Sundqvist

Abstract Presumably most students strive to do well in school and on national tests. However, even in standardized tests, students’ and examiners’ expectations on what it means to ‘do well’ may diverge in ways that are consequential to performance and assessment. In this paper, we examine how students and teachers in an L2 English peer–peer speaking national test (9th grade) display their understandings of appropriate ways of dealing with pre-set discussion tasks. Using conversation analysis and 38 recorded national tests in English in Sweden, we demonstrate, e.g., how teachers’ displayed understandings of how tasks should be appropriately handled steer the interactional trajectory between students in particular directions. The analysis shows that participants spend much time on negotiating understandings of the task-at-hand. We argue that in terms of valid assessment of oral proficiency, task understandings merit more attention, as task negotiations inevitably generate different conditions for different dyads and teachers.


1997 ◽  
Vol 20 (1) ◽  
pp. 21-41 ◽  
Author(s):  
Caterina Cafarella

Abstract In oral proficiency tests there are occurrences of trouble in interaction such as misunderstanding, non hearing or lack of understanding which may cause breakdown in communication. Within the context of the question-answer framework of an oral proficiency test this study investigates the interactive nature of spoken discourse between students and assessors when there is trouble in talk as perceived by the assessors, with a focus on how they accommodate to the students. A sample of twenty oral transcripts and tapes of the 1992 Victorian Certificate of Education (V.C.E.) Italian Common Assessment Task (C.A.T. 2) were randomly selected and examined. By using Conversation Analysis methodology the purpose of the study was to investigate in repair sequences types of assessor accommodation – how the assessors modified their utterances – the kinds of trouble perceived by assessors, what triggered assessor accommodation and whether the accommodations facilitated student response and participation. This study has implications for assessor training since it highlights which strategies are most successful for ensuring student understanding, participation and appropriate responses as well as demonstrating why and in which environments assessors accommodate.


1996 ◽  
Vol 54 ◽  
pp. 145-152
Author(s):  
Peter Paffen

In 1988 CITO started research into the feasibility of valid and reliable oral proficiency tests based on communicative principles. This was to meet the demand for a communicative speech test to be used in school based examinations in secondary education. Using the Test of Spoken English as a guideline, tests for French, German and English were developed. Simultaneous research into the reliability and validity of the tests led to various adaptations of the original model. From 1992 onwards oral proficiency tests for each of the three languages in question have been published at levels VBO/MAVO, HAVO and VWO (approxi-mately: vocational, secondary modern and grammar school). The results of a user inquiry held in 1994 led to a number of further changes to improve the user-friend-liness of the tests. Early in 1996 a new research project concerning the reliability and validity of the tests was started. The results will be published in the autumn of 1996.


2018 ◽  
Vol 40 (6) ◽  
pp. 894-916 ◽  
Author(s):  
Takanori Sato ◽  
Tim McNamara

Abstract Applied linguists have developed complex theories of the ability to communicate in a second language (L2). However, the perspectives on L2 communication ability of speakers who are not trained language professionals have been incorporated neither into theories of communication ability nor in the criteria for assessing performance on general-purpose oral proficiency tests. This potentially weakens the validity of such tests because the ultimate arbiters of L2 speakers’ oral performance are not trained language professionals. This study investigates the perspectives of these linguistic laypersons on L2 communication ability. Twenty-three native and non-native English-speaking linguistic laypersons judged L2 speakers’ oral performances and verbalized the reasons for their judgments. The results showed that the participants focus not only on the linguistic aspects of the speaker’s output but also on features that applied linguists have less paid attention to. Even where speaker’s linguistic errors were acknowledged, message conveyance and comprehensibility of the message contributed to their judgment. The study has implications for language testing and the development of tests reflecting the construct of English as a lingua franca.


1979 ◽  
Vol 7 ◽  
pp. 198-217 ◽  
Author(s):  
Riet Evers

It is only quite recently, among other things as a result of the increasing demands for learner-centered education, that, particularly in the field of foreign language teaching to adults, an interest in the use of self-assessment techniques has begun to emerge. However, for an appropriate use of self-assessment as a means of evaluation of foreign language proficiency, an insight into the validity and reliability characteristics of the learners' judgements is needed. This paper discusses some findings of an experiment in which Dutch adult learners were asked to assess their proficiency in French by filling in two evaluation forms. In one form, the questions included aim at a global assess-ment of the learners' command of the French language both with regard to each of the four skills and to pronunciation, grammar, vocabulary and orthography. The other form used covers only the four skills. The questions included in this form present, for each skill, a number of specific situations of language use. The learner is asked to indicate how well he thinks he can handle the French language in each situation described. In order to determine the reliability of the self-ratings the learners were asked to fill in, after an interval of about two weeks, the latter forra a second time. Criteria for the validity of the learners' judgements were based on their scores on language-proficiency tests. Besides this, data on a number of personal characteristics were obtained. The relationships between all these variables were analyzed. The research findings indicate among other things 1. that self-ratings which are based on a specification of language proficien-cy in terms of language activities are reliable to a fairly high degree; 2. that these self-ratings are better predictors of the test-scores than the ratings obtained by means of a global evaluation form; 3. that self-ratings of listening comprehension are less valid than self-ratings of speaking or reading comprehension.


1977 ◽  
Vol 61 (3) ◽  
pp. 136
Author(s):  
Thomas O. Bell ◽  
Vincent Doyle ◽  
Brian L. Talbott ◽  
Joseph H. Matluck ◽  
Betty J. Mace-Matluck

2005 ◽  
Vol 22 (1) ◽  
pp. 59-92 ◽  
Author(s):  
Valerie Malabonga ◽  
Dorry M. Kenyon ◽  
Helen Carpenter

Author(s):  
Mohamad Yahya Abdullah ◽  
Supyan Hussin ◽  
Kemboja Ismail

In this study, combined method using pre and post oral proficiency tests, observation, and focus group interviews were used to examine the effectiveness of using flipped classroom model on English speaking performance. The study population consists of 27 undergraduate students who were attending the course of Advanced Communication Skills, in the academic year of 2018. A purposeful sampling technique, specifically quasi-experimental procedure was employed in this study. The analysis of quantitative and qualitative data showed that the application of FCM was an effective approach in the EFL speaking classroom. The results of paired-sample t-test indicated that there was a significant difference between pre and post oral proficiency tests t (26) = -14.83, p<0.001. Moreover, it was found that students’ involvement and willingness to participate in the English conversational tasks and their level of commitment and English speaking performance have increased gradually. In light of the findings, the study recommended encouraging teachers to employ modern technologies in their teaching strategies, particularly FCM.


Sign in / Sign up

Export Citation Format

Share Document