scholarly journals Aligning English Language Testing With Curriculum

2016 ◽  
Vol 18 (2) ◽  
pp. 63 ◽  
Author(s):  
Marcela Palacio ◽  
Sandra Gaviria ◽  
James Dean Brown
Keyword(s):  
English Language ◽  
Classroom Practices ◽  
Item Analysis ◽  
Descriptive Statistics ◽  
Test Design ◽  
Teaching Philosophy ◽  
Validity And Reliability ◽  
Testing Program ◽  
Reliability Estimates

<p>Frustrations with traditional testing led a group of teachers at the English for adults program at Universidad EAFIT (Colombia) to design tests aligned with the institutional teaching philosophy and classroom practices. This article reports on a study of an item-by-item evaluation of a series of English exams for validity and reliability in an effort to guarantee the quality of the process of test design. The study included descriptive statistics, item analysis, correlational analyses, reliability estimates, and validity analyses. The results show that the new tests are an excellent addition to the program and an improvement over traditional tests. Implications are discussed and recommendations given for the development of any institutional testing program.</p>

scholarly journals Utilizing test items analysis to examine the level of difficulty and discriminating power in a teacher-made test

2021 ◽  
Vol 6 (2) ◽  
pp. 256
Author(s):  
Sayit Abdul Karim ◽  
Suryo Sudiro ◽  
Syarifah Sakinah
Keyword(s):  
Reading Comprehension ◽  
Junior High School ◽  
Test Item ◽  
English Language ◽  
Item Analysis ◽  
Quality Level ◽  
Test Items ◽  
Discriminating Power ◽  
Level Of Difficulty

Apart from teaching, English language teachers need to assess their students by giving a test to know the students� achievements. In general, teachers are barely conducting item analysis on their tests. As a result, they have no idea about the quality of their test distributed to the students. The present study attempts to figure out the levels of difficulty (LD) and the discriminating power (DP) of the multiple-choice (MC) test item constructed by an English teacher in the reading comprehension test utilizing test item analysis. This study employs a qualitative approach. For this purpose, a test of 50-MC test items of reading comprehension was obtained from the students� test results. Thirty-five students of grade eight took part in the MC test try-out. They are both male (15) and female (20) students of junior high school 2 Kempo, in West Nusa Tenggara Province. The findings revealed that16 items out of 50 test items were rejected due to the poor and worst quality level of difficulty and discriminating index. Meanwhile, 12 items need to be reviewed due to their mediocre quality, and 11 items are claimed to have good quality items. Besides, 11 items out of 50 test items were considered as the excellent quality as their DP scores reached around 0.44 through 0.78. The implications of the present study will shed light on the quality of teacher-made test items, especially for the MC test.

scholarly journals ANALISIS DESKRIPTIF PADA DIMENSI KUALITAS LAYANAN MOBILE BANKING (M-BANKING) TERHADAP KEPUASAN NASABAH PERBANKAN SYARIAH

2020 ◽  
Vol 7 (6) ◽  
pp. 1118
Author(s):  
Charissa Kezia Rahmawati ◽  
Bayu Arie Fianto
Keyword(s):  
Customer Satisfaction ◽  
Survey Data ◽  
Sampling Method ◽  
Initial Study ◽  
Descriptive Statistics ◽  
Reliability Test ◽  
Mobile Banking ◽  
Quality Service ◽  
Validity And Reliability

This research presents an initial study of customer satisfaction as measured by five mobile banking (m-banking) quality services dimensions using descriptive statistics and mean score. The survey data were obtained from 100 respondents of mobile banking (m-baking) users by using a purposive sampling method. The data is processed using validity and reliability test to check the quality of the data. The results shown in this research are explanatory or extracting information on which factors the customer shows high and low satisfaction.Keywords: Customer Satisfaction, Descriptive Statistic, Mobile Banking, Quality Service Dimension

scholarly journals Development and Validation of the Homeostasis Concept Inventory

2017 ◽  
Vol 16 (2) ◽  
pp. ar35 ◽  
Author(s):  
Jenny L. McFarland ◽  
Rebecca M. Price ◽  
Mary Pat Wenderoth ◽  
Patrícia Martinková ◽  
William Cliff ◽  
...  
Keyword(s):  
Undergraduate Students ◽  
English Language ◽  
Item Analysis ◽  
Concept Inventory ◽  
Validity And Reliability ◽  
Gender Biases ◽  
Item Functioning ◽  
Differential Item Analysis ◽  
Concept Framework ◽  
Better Than

We present the Homeostasis Concept Inventory (HCI), a 20-item multiple-choice instrument that assesses how well undergraduates understand this critical physiological concept. We used an iterative process to develop a set of questions based on elements in the Homeostasis Concept Framework. This process involved faculty experts and undergraduate students from associate’s colleges, primarily undergraduate institutions, regional and research-intensive universities, and professional schools. Statistical results provided strong evidence for the validity and reliability of the HCI. We found that graduate students performed better than undergraduates, biology majors performed better than nonmajors, and students performed better after receiving instruction about homeostasis. We used differential item analysis to assess whether students from different genders, races/ethnicities, and English language status performed differently on individual items of the HCI. We found no evidence of differential item functioning, suggesting that the items do not incorporate cultural or gender biases that would impact students’ performance on the test. Instructors can use the HCI to guide their teaching and student learning of homeostasis, a core concept of physiology.

scholarly journals Impact of distractors in item analysis of multiple choice questions

2019 ◽  
Vol 7 (4) ◽  
pp. 1136
Author(s):  
Ismail Burud ◽  
Kavitha Nagandla ◽  
Puneet Agarwal
Keyword(s):  
Quality Assurance ◽  
Statistical Significance ◽  
Item Analysis ◽  
Validity And Reliability ◽  
Multiple Choice Questions ◽  
Test Items ◽  
Difficulty Index ◽  
The Individual ◽  
Discriminatory Index

Background: Item analysis is a quality assurance of examining the performance of the individual test items that measures the validity and reliability of exams. This study was performed to evaluate the quality of the test items with respect to their performance on difficulty index (DFI), Discriminatory index (DI) and assessment of functional and non-functional distractors (FD and NFD).Methods: This study was performed on the summative examination undertaken by 113 students. The analyses include 120 one best answers (OBAs) and 360 distractors.Results: Out of the 360 distractors, 85 distractors were chosen by less than 5% with the distractor efficiency of 23.6%. About 47 (13%) items had no NFDs while 51 (14%), 30 (8.3%), and 4 (1.1%) items contained 1, 2, and 3 NFDs respectively. Majority of the items showed excellent difficulty index (50.4%, n=42) and fair discrimination (37%, n=33). The questions with excellent difficulty index and discriminatory index showed statistical significance with 1NFD and 2 NFD (p=0.03).Conclusions: The post evaluation of item performance in any exam in one of the quality assurance method of identifying the best performing item for quality question bank. The distractor efficiency gives information on the overall quality of item.

scholarly journals Nurses’ Views on the Use, Quality, and Satisfaction with Electronic Medical Record in the Outpatient Department at a Tertiary Hospital

2021 ◽  
Vol 15 (1) ◽  
pp. 254-261
Author(s):  
Mohammad J. Jaber ◽  
Ahmad M. Al-Bashaireh ◽  
Ola M. Alqudah ◽  
Omar M. Khraisat ◽  
Khaldoun M. Hamdan ◽  
...  
Keyword(s):  
Medical Record ◽  
Electronic Medical Record ◽  
English Language ◽  
Daily Practice ◽  
Tertiary Hospital ◽  
Outpatient Department ◽  
Validity And Reliability ◽  
Cross Sectional ◽  
Positive Correlations

Background: Many nurses perceive that the Electronic Medical Record (EMR) reduces the workload, improves the quality of documentation, and improves safety and patient care. However, other nurses reported that the system and environment of healthcare might impede EMR documentation at the bedside. Objective: The study aimed to describe the nurses' views of the use, quality, and satisfaction with EMR in daily practice in outpatient settings. Furthermore, the relationships among the use, quality, and user’s satisfaction of EMR were assessed in the study. Methods: The proposed study employed a cross-sectional, descriptive correlational design. Inclusion criteria were nurses willing to participate in the study, fluent in the English language, and have been working in the Outpatient Department for more than three months until the time of study implementation. A self-reported questionnaire with strong validity and reliability was used to assess nurses’ views of use, quality and satisfaction of EMR. Results: The response rate was 77.2% (170 out of 220), 91.2% of the participants were females. Results about the use of EMR have shown positive views ranging from 51.2% to 84.7%, with the lowest scores reported when to write nurse care worksheets (Kardex). For the quality of EMR, the results have shown positive views ranging from 70% to 87.6% with the lowest scores reported related to the EMR system problems and crashes, and for the user’s satisfaction, the results have shown positive views ranging from 76.5% to 87.1%. There were significant positive correlations between the three elements use, quality, and user’s satisfaction of EMR. Conclusion: Participants reported positive views in the domain of use, quality, and satisfaction with EMR. Furthermore, positive correlations were reported between the use, quality, and satisfaction domains of EMR.

scholarly journals Reflection of the Test-Item Quality in State SMP and SMA in Bandar Lampung

2019 ◽  
Vol 20 (2) ◽  
pp. 72-87
Author(s):  
Ujang Suparman ◽  
Keyword(s):  
Test Item ◽  
Item Analysis ◽  
Descriptive Statistics ◽  
Test Items ◽  
National Examination ◽  
Discriminating Power ◽  
Item Quality ◽  
Level Of Difficulty

The objectives of this research are to analyze critically the quality of test items used in SMP and SMA (mid semester, final semester, and National Examination Practice) in terms of reliability as a whole, level of difficulty, discriminating power, the quality of answer keys and distractors. The methods used to analyze the test items are item analysis (ITEMAN), two types of descriptive statistics for analyzing test items and another for analyzing the options. The findings of the research are very far from what is believed, that is, the quality of majority of test items as well as key answers and distractors are unsatisfactory. Based the results of the analysis, conclusions are drawn and recommendations are put forward.

scholarly journals O efeito retroativo de um exame de proficiência para professores

2018 ◽  
Vol 29 (72) ◽  
pp. 832
Author(s):  
Rodrigo Nascimento de Queiroz ◽  
Douglas Altamiro Consolo
Keyword(s):  
Foreign Language ◽  
Teaching And Learning ◽  
English Language ◽  
Language Teachers ◽  
Assessment Practices ◽  
Validity And Reliability ◽  
Foreign Language Teachers ◽  
Professional Experiences ◽  
English Language Teachers

<p>O presente artigo aborda questões relativas ao efeito retroativo em torno da experiência durante a aplicação do Exame de Proficiência para Professores de Língua Estrangeira (EPPLE). O debate está ancorado nos seguintes princípios: a) a avaliação no ensino e aprendizagem de línguas; b) a proficiência linguístico-comunicativo-pedagógica (PLCP) de professores de línguas; e c) as experiências materializadas como efeitos retroativos na prática avaliativa. A abordagem qualitativa auxilia na interpretação das narrativas de dois professores de Língua Inglesa (LI). A análise interpretativa dos aspectos discursivos indica que os impactos possibilitam o resgate da consciência reflexiva inter-relacionada com as memórias da formação profissional, assim tornando a experiência concreta e válida para o processo de socialização dos conhecimentos específicos do contexto pedagógico de professores de LI.</p><p>Formação de Professores; Língua Inglesa; Proficiência Linguístico-Comunicativo-Pedagógica; Exame de Proficiência.</p><p> </p><p>El efecto retroactivo de un examen de competencia para profesores</p><p>El presente artículo aborda temas relativos al efecto retroactivo en torno a la experiencia durante la aplicación del Examen de Competencia para Profesores de Lengua Extranjera (EPPLE). El debate se basa en los siguientes principios: a) la evaluación en la enseñanza y aprendizaje de idiomas; b) la competencia lingüístico-comunicativo-pedagógica (PLCP) de profesores de idiomas; y c) las experiências materializadas como efectos retroactivos en la práctica evaluativa. El abordaje cualitativo auxilia en la interpretación de las narrativas de dos profesores de Lengua Inglesa (LI). El análisis interpretativo de los aspectos discursivos indica que los impactos posibilitan el rescate de la consciencia reflexiva interrelacionada con las memorias de la formación profesional, haciendo de esta forma que la experiencia sea concreta y válida para el proceso de socialización de los conocimientos específicos del contexto pedagógico de profesores de LI.</p><p>Formación de Profesores; Lengua Inglesa; Competencia Lingüístico-Comunicativo-Pedagógica; Examen de Competencia.</p><p> </p><p>Washback effect of an application of a proficiency examination for teachers</p><p>This paper deals with some issues related to the analysis of two narratives written by in-service and pre-service English language teachers, following an application of a Proficiency Examination for Foreign Language Teachers [Exame de Proficiência para Professores de Língua Estrangeira – EPPLE] in a public university located in the western Amazon. The discussion is based on the following principles: (i) the implications for assessment in the teaching and learning of foreign languages related to the reconstruction and promotion of socialized practices; (ii) the quality of a linguistic, communicative and pedagogical proficiency of foreign language teachers underlying the elements of validity and reliability of EPPLE; and (iii) the intersection of experiences materialized as washback effects from a process of assessment practices. The analysis of the teachers’ discourses indicates an intersection between teachers’ memories and professional experiences.</p><p>Teacher Training; English Language; Linguistic, Communicative and Pedagogical Proficiency; Proficiency Exam.</p>

scholarly journals Pengaruh Motivasi, Pengetahuan Akuntansi dan Relogiusitas terhadap Kualitas Lulusan Program Studi Akuntansi Syariah

2019 ◽  
Vol 2 (1) ◽  
pp. 65-82
Author(s):  
Azza Nikmatuttisaroh
Keyword(s):  
Random Sampling ◽  
Hypothesis Test ◽  
Sample Selection ◽  
Descriptive Statistics ◽  
Educational Institutions ◽  
Validity And Reliability ◽  
Accounting Courses ◽  
Questionnaire Administration ◽  
Program Data

Along with the development of economy and business, the competitiveness of it isincreasing. Increasing competitiveness requires educational institutions tocontinuously improve the quality of graduates.This study aims to determine the effectof motivation, knowledge of accounting, and religiosity on the quality of graduatesinSTEI SEBI Islamic Accounting courses. The sources of data in this study is theprimary data obtained directly from responses to questionnaires of IslamicAccounting graduates tudy program. Data collection techniques is performed by thesurvey. Data obtained using a questionnaire administration to graduates of IslamicAccounting courses. The sample selection is done by using random sampling method.The data is analysed by the test of descriptive statistics, test of validity and reliability,the assumptions of classical test (test of normality, multicollinearity, andheteroskedastisity), as well as multiple linear hypothesis test. The results of theresearch shows that the partial motivation test is not significantly by the quality ofgraduates, while knowledge of accounting is significantly influence on religiosity at95% confidence level. Simultaneously, motivation, knowledge of accounting, andreligiosity significantly influence the quality of graduates. R Square value in thisstudy is 0.373, which means that 37.3% changes in the level of quality of graduatescan be explained by the variables of motivation, knowledge of accounting, andreligiosity, while the rest is influenced by other variables that are not observed in thisstudy. The results of this study are expected to contribute towards improving thequality of graduates of Islamic Accounting courses as a consideration in determiningthe necessary policies.

scholarly journals A study on radiotelephony English test design

2022 ◽  
Vol 355 ◽  
pp. 03051
Author(s):  
Lixin Dai
Keyword(s):  
Language Learning ◽  
Language Proficiency ◽  
English Language ◽  
Communicative Competence ◽  
Test Theory ◽  
Test Design ◽  
Validity And Reliability ◽  
Theoretical Frameworks ◽  
Air Traffic Controllers ◽  
Career Needs

Radiotelephony English is taught in college for the learners whose future professions are mainly pilots and air traffic controllers. The present study is to analyse the radiotelephony English test design in a university to see the extent of which it evaluates learners’ communicative competence in aviation scope. Theoretical frameworks on communicative competence, modern test theory and ICAO language proficiency requirements for the learners of radiotelephony communication are presented. The study reveals that learners’ communicative competence which includes both radiotelephony and everyday communication skills are important components in radiotelephony test design. The study points out that the application of modern test theory in designing radiotelephony test in college is vital in meeting the validity and reliability of the test and the students’ individual needs in English language learning for future career needs to be reflected in the test design.

Sign in / Sign up

Export Citation Format

Share Document