scholarly journals Strategies Proposed for Listening Comprehension in PBT TOEFL: Tricks that Do Not Work

Author(s):  
Faisal Mustafa ◽  
Tomi Mandala Putra

Abstract: The Longman Preparation Course for the TOEFL, written by Phillips in 2003, is the most widely used coursebook for TOEFL test preparation. This book provides 17 strategies for Listening Comprehension Part A. Therefore, the current study examines whether the strategies provided in the book are applicable in a real test. The data were obtained from Part A of the TOEFL listening section in nine tests designed by Educational Testing Service (ETS). Each item in the test was tested against the proposed strategies. The results reveal that many items did not successfully match the strategies. Only two proposed strategies had matches of higher than 80%, while others were less than 10%. There are four strategies that did not have a match at all. All in all, very few strategies can be applied to answer the questions correctly without adequate comprehension. With comprehension, test takers can answer the questions without needing to rely on any of the proposed strategies. Therefore, the study concludes that most of the strategies proposed by Phillips (2003) are not successful in real test.Key words: strategies, PBT TOEFL, listening comprehension Abstrak: The Longman Preparation Course for the TOEFL yang ditulis oleh Phillips in 2003 paling banyak digunakan untuk pelatihan persiapan TOEFL. Buku tersebut berisi 17 strategi untuk menjawab soal TOEFP pada Part A. Oleh karena itu, penelitian ini menelaah apakah strategi dalam buku tersebut dapat digunakan untuk mengerjakan tes TOEFL yang sebenarnya. Data untuk penelitian ini diperoleh dari tes TOEFL bagian listening Part A yang diperoleh dari Educational Testing Service (ETS). Setiap soal pada tes tersebut dicocokkan dengan strategi yang terdapat dalam buku Phillips (2003). Hasil penelitian menunjukkan bahwa banyak soal tidak dapat dijawab dengan menggunakan strategi yang dianjurkan. Hanya ada dua strategi yang memiliki kecocokan lebih dari 80%, sedangkan yang lain kurang dari 10%. Ada dua strategi yang tidak cocok dengan satu soal manapun. Secara keseluruhan, sangat sedikit strategi yang dapat digunakan untuk menjawab soal TOEFL listening Part A tanpa pemahaman yang cukup. Dengan pemahaman, peserta tes bisa menjawab soal tanpa harus menggunakan strategi-strategi tersebut. Oleh karena itu, penelitian ini menyimpulkan bahwa kebanyakan strategi yang dikemukakan oleh Phillips (2003) tidak dapat digunakan untuk menjawab soal TOEFL asli.Kata kunci: strategi, PBT TOEFL, listening comprehension.

2010 ◽  
Vol 27 (3) ◽  
pp. 335-353 ◽  
Author(s):  
Sara Cushing Weigle

Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to TOEFL® iBT Independent writing tasks with several non-test indicators of writing ability: student self-assessment, instructor assessment, and independent ratings of non-test writing samples. Automated scores were produced using e-rater ®, developed by Educational Testing Service (ETS). Correlations between both human and e-rater scores and non-test indicators were moderate but consistent, providing criterion-related validity evidence for the use of e-rater along with human scores. The implications of the findings for the validity of automated scores are discussed.


1985 ◽  
Vol 55 (2) ◽  
pp. 195-220 ◽  
Author(s):  
James Crouse

The College Entrance Examination Board and the Educational Testing Service claim that the Scholastic Aptitude Test (SAT) improves colleges' predictions of their applicants' success. James Crouse uses data from the National Longitudinal Study of high school students to calculate the actual improvement in freshman grade point averages, college completion,and total years of schooling resulting from colleges' use of the SAT. He then compares those predictions with predictions based on applicants' high school rank. Crouse argues that the College Board and the Educational Testing Service have yet to demonstrate that the high costs of the SAT are justified by its limited ability to predict student performance.


Sign in / Sign up

Export Citation Format

Share Document