scholarly journals A Review of the Reading Section of the TOEIC

2004 ◽  
Vol 22 (1) ◽  
pp. 16
Author(s):  
Carolina Daza ◽  
Manami Suzuki

In 1979, the Educational Testing Service (ETS) developed the TOEIC (Test of English for International Communication), an English proficiency test for people working in international environments, based on a request from the Japanese Ministry of International Trade and Industry. The Chauncey Group International, a subsidiary of ETS, currently develops and publishes the test. Over two million people per year take the TOEIC (www.toeic.com). According to the TOEIC Report on Test-Takers Worldwide, 1997-98, 63% of the TOEIC results were used in Japan, 29% in Korea, and 8% in other countries. Most reviews of the TOEIC have been descriptions of the test (Gilfert, 1996; Perkins, 1987). The TOEIC comprises the listening and reading section. Buck (2001) reviews only the listening section. For the reading section of the TOEIC we could find only one critical review (Richards, 1992) published over the two decades since the test was developed. Therefore, our purpose in this article is to review critically the reading section based on recent studies of language assessment, particularly for construct validity and content validity, which are considered by language testing researchers (Backman, 1990; Cumming, 1996) as fundamental for validation of language tests.

2021 ◽  
pp. 019459982110328
Author(s):  
Tobias Albrecht ◽  
Christoph Nikendei ◽  
Mark Praetorius

Objective Otologic diseases are common in all age groups and can significantly impair the function of this important sensory organ. To make a correct diagnosis, the correct handling of the otoscope and a correctly performed examination are essential. A virtual reality simulator could make it easier to teach this difficult-to-teach skill. The aim of this study was to assess the face, content, and construct validity of the novel virtual reality otoscopy simulator and the applicability to otologic training. Study Design Face and content validity was assessed with a questionnaire. Construct validity was assessed in a prospectively designed controlled trial. Setting Training for medical students at a tertiary referral center. Method The questionnaire used a 6-point Likert scale. The otoscopy was rated with a modified Objective Structured Assessment of Technical Skills. Time to complete the task and the percentage of the assessed eardrum surface were recorded. Results The realism of the simulator and the applicability to medical training were assessed across several items. The ratings suggested good face and content validity as well as usefulness and functionality of the simulator. The otolaryngologists significantly outperformed the student group in all categories measured (P < .0001), suggesting construct validity of the simulator. Conclusion In this study, we could demonstrate face, content, and construct validity for a novel high-fidelity virtual reality otoscopy simulator. The results encourage the use of the otoscopy simulator as a complementary tool to traditional teaching methods in a curriculum for medical students.


2010 ◽  
Vol 27 (3) ◽  
pp. 335-353 ◽  
Author(s):  
Sara Cushing Weigle

Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to TOEFL® iBT Independent writing tasks with several non-test indicators of writing ability: student self-assessment, instructor assessment, and independent ratings of non-test writing samples. Automated scores were produced using e-rater ®, developed by Educational Testing Service (ETS). Correlations between both human and e-rater scores and non-test indicators were moderate but consistent, providing criterion-related validity evidence for the use of e-rater along with human scores. The implications of the findings for the validity of automated scores are discussed.


2021 ◽  
Vol 15 (12) ◽  
pp. 3505-3508
Author(s):  
Noor Ul Ain Fatima ◽  
Qurat-Ul- Ain ◽  
Fareeha Kausar ◽  
Mian Ali Raza ◽  
Misbah Waris ◽  
...  

Objective: To translate and validate the ABC-Scale in Urdu language to predict risk of fall in older population. Study design: Cross-cultural Translation and validation Place and Duration: Study was conducted in older adult community of Sialkot from March 2020 to December 2020. Methodology: Translation of ABC in Urdu was conducted by using Beaton et al guidelines. Two bilingual translators translated the original version into Urdu language step wise, correction process was followed. Then two backward translations were done by language expert. After all this process, the translated version was reviewed by the professionals and the final version was applied on 15 individuals. Its reliability and validity was tested on 60 older adults. Results: For test re test reliability, intra class correlation coefficient ICC was measured with a value of 0.984 Which shows good test re-test reliability. The internal consistency and reliability of ABC was calculated by Cronbach’s alpha for total score with a value of 0.985. Content validity was good with values of CVI ranging from 0.767 to 0.955. To test the discriminative validity, independent t test was used to show the difference between the healthy and unhealthy adults. Factor analysis of UABC showed total variance 81.277 and cumulative variance was also 81.277. To calculate construct validity of U-ABC Pearson’s correlation coefficient was used and measured as 0.558. Conclusion: It was concluded that Urdu version of UABC is a valid assessment tool for older adults with fear of fall. It has good content validity, construct validity and reliability. Keywords: activities specific balance scale, validation, Urdu translation, reliability, tool translation


2021 ◽  
Vol 2 (01) ◽  
pp. 21-42
Author(s):  
Muhammad Afifullah Nizary ◽  
Ahmad Nur Kholik Nur Kholik

This article attempts to examine how to analyze the validity of the assessment instrument. In fact, not all teachers are able to make the correct instruments. Many teachers only take instruments from other schools to be used as a tool in measuring their students, even though the same instrument is not necessarily a measuring instrument with different objects. This habit needs to be improved. The teacher should be able to make their own instruments, because the teacher knows best about the differences in the abilities of each student. When the teacher uses instruments from other schools, where there are parts that the teacher has not conveyed in class, the students themselves are the losers. In making an assessment instrument the teacher must pay attention to two characteristics. Namely validity and reliability. Validity itself is divided into content validity, construct validity, and eksternal validity. Each validity has its own characteristics. Keywords: evaluation and teacher, the validity of the assessment instrument, the validity of the content


2021 ◽  
pp. 105477382110598
Author(s):  
Ganime Can Gür ◽  
Yasemin Altinbaş

The current study was planned to test the validity and reliability of the Turkish version of the COVID-19 Literacy Scale. The sample of the study was taken from 473 individuals. In this study, language validity, content validity and construct validity were examined to determine the validity of the scale. Its reliability was evaluated by internal consistency, split-half reliability, and test-retest reliability method. It was defined that the scale has a two-factor structure as a result of EFA and its factor loadings are in the appropriate range (0.852–0.324). According to the CFA result, it was determined that the model-data fit was at a good level. The Cronbach values for the whole scale and subscales were .92, .90, and .87, respectively. It was observed that the test-retest value was .95. It was concluded that the Turkish form of the COVID-19 Literacy Scale is a reliable and valid tool.


2018 ◽  
Vol 17 (03) ◽  
pp. 314-321
Author(s):  
José Manuel Hernández-Padilla ◽  
Matías Correa-Casado ◽  
José Granero-Molina ◽  
Alda Elena Cortés-Rodríguez ◽  
Tamara María Matarín-Jiménez ◽  
...  

AbstractObjectiveTo translate, culturally adapt, and psychometrically evaluate the Spanish version of the “Scale for End-of Life Caregiving Appraisal” (SEOLCAS).MethodObservational cross-sectional study. Convenience sample of 201 informal end-of-life caregivers recruited in a southern Spanish hospital. The reliability of the questionnaire was assessed through its internal consistency (Cronbach's α) and temporal stability (Pearson's correlation coefficient [r] between test-retest). The content validity index of the items and the scale was calculated. Criterion validity was explored through performing a linear regression analysis to evaluate the SEOLCAS’ predictive validity. Exploratory factor analysis was used to examine its construct validity.ResultsThe SEOLCAS’ reliability was very high (Cronbach's α = 0.92). Its content validity was excellent (all items’ content validity index = 0.8–1; scale's validity index = 0.88). Evidence of the SEOLCAS’ criterion validity showed that the participants’ scores on the SEOLCAS explained approximately 79.3% of the between-subject variation of their results on the Zarit Burden Interview. Exploratory factor analysis provided evidence of the SEOLCAS’ construct validity. This analysis revealed that two factors (“internal contingencies” and “external contingencies”) explained 53.77% of the total variance found and reflected the stoic Hispanic attitude toward adversity.Significance of resultsThe Spanish version of the SEOLCAS has shown to be an easily applicable, valid, reliable, and culturally appropriate tool to measure the impact of end-of-life care provision on Hispanic informal caregivers. This tool offers healthcare professionals the opportunity to easily explore Hispanic informal end-of-life caregivers’ experiences and discover the type of support they may need (instrumental or emotional) even when there are communicational and organizational constraints.


2014 ◽  
Vol 48 (5) ◽  
pp. 787-793 ◽  
Author(s):  
Ariane Polidoro Dini ◽  
Edinêis de Brito Guirardello

Objective Improve the content validity of the instrument for classification of pediatric patients and evaluate its construct validity. Method A descriptive exploratory study in the measurement of the content validity index, and correlational design for construct validation through exploratory factor analysis. Results The content validity index for indicators was 0.99 and it was 0.97 for graded situations. Three domains were extracted in the construct validation, namely: patient, family and therapeutic procedures, with 74.97% of explained variance. The instrument showed evidences of content and construct validity. Conclusion The validation of the instrument occurred under the approach of family-centered care, and allowed incorporating some essential needs of childhood such as playing, interaction and affection in the content of the instrument.



2019 ◽  
Vol 7 (3) ◽  
pp. 75
Author(s):  
Febriani Hastini Nasution ◽  
Dedes Asriani Siregar

This article was contained about analyzing the validity of students’ teaching module based on conceptual change. Students’ teaching module based on conceptual change was the module which is arranged based on the indicator of conceptual change, they are elicit and confirm current ideas, exposure to conflicting evidence, construct new explanation, apply and evaluate new explanation, and the last is review change in ideas and explanations. This module was validated by three validators. There were four components which was validated, they were about content validity which is consist of the components of module and the appropriateness of module’s contents, construct validity, language validity, and the suitability with the learning used conceptual change. Based on analysis data obtained: The average value of validity of students’ teaching module by three validators was 91.11 was in very valid category. Furthermore, the value of each components were 94.90 in content validity, 90.97 in construct validity, 86.90 in language validity, and 91.67 in the suitability with the learning used conceptual change. Four of the components were in very valid category.


10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.


Sign in / Sign up

Export Citation Format

Share Document