Reliability and Validity Research on the Reading Part in TEM-8 (2016-2021)

TEM-8 is one of the most important exams for higher education (English major) students in China. By collecting and analyzing relevant reliability and validity data of recent TEM-8 (2016 to 2021), the reliability and validity of the examination (reading part) can be understood. This article discusses the exam’s developing trend and provides suggestions for language teachers as well as exam candidates.

Metode Penelitian di dalam Manuskrip Jurnal Ilmiah Keagamaan

A common problem regarding the method section in the structure of scientific journals is that they are written in general and not typical. A research method must report the procedures the researcher takes to carry out his research. The contents are not the same as the method descriptions in other studies. Therefore, this paper aims to explain the importance of methods in the structure of writing scientific journal articles. In particular, several methods commonly referred to in theological research are presented descriptively and topically. The conclusion obtained is, with the correct understanding of the research method, lecturers or researchers can produce theological research work that can be accounted for its academic validity. Research contribution: This paper provides insights to lecturers and researchers in writing and formulating methods in scientific journal papers and contributing material in writing scientific papers.Permasalahan umum mengenai bagian metode di dalam struktur jurnal ilmiah adalah ditulis secara umum dan tidak khas. Padahal, sebuah metode penelitian harus melaporkan prosedur yang ditempuh peneliti untuk menjalankan penelitiannya. Isinya tidak sama dengan penjelasan metode pada penelitian lain. Oleh karena itu paper ini bertujuan menjelaskan tentang pentingnya metode di dalam struktur penulisan artikel jurnal ilmiah. Secara khusus dipaparkan secara deskriptif dan topikal beberapa metode yang umum dirujuk dalam penelitian teologis. Kesimpulan yang diperoleh adalah, dengan pemahaman yang benar tentang metode penelitian, dosen atau peneliti dapat menghasilkan karya penelitian teologis yang dapat dipertanggungjawabkan validitasnya secara akademik. Kontribusi penelitian: Paper ini memberikan wawasan kepada dosen dan peneliti di dalam menulis dan merumuskan metode dalam paper jurnal ilmiah dan menyumbang materi dalam penulisan karya ilmiah.

A causal theory of error scores.

In Modern Test Theory, response variables are a function of a common latent variable that represents the measured attribute, and error variables that are unique to the response variables. While considerable thought goes into the interpretation of latent variables in these models (e.g., validity research), the interpretation of error variables is typically left implicit (e.g., describing error variables as residuals, i.e., as `whatever is unexplained by the model'). Yet, many psychometric assumptions are essentially assumptions about error and thus being able to reason about psychometric models requires the ability to reason about errors. We propose the causal theory of error as a framework that helps reasoning about errors in terms of the data-generating mechanism. In this framework, the error variable reflects all unique causes of the response variable that together with the latent variable determine the item responses. We show that different assumptions about error scores (1) imply different psychometric models, (2) have different implications for the chance experiment that underlies the notion of randomness in the model, and (3) have different implications for item bias and local homogeneity. In the causal theory of error, these assumptions concern the unique causes of the item response that may be person characteristics that have the sampling of people as their source of variability, or properties of the measurement circumstances that have the sampling of measurement occasions as their source of variability.

Situational optimization function analysis: An ideal performance analysis inspired on Lewin’s Equation

This study presents the situational optimization function analysis (SOFA) and has three aims. First, to develop a Bayesian implementation of SOFA. Second, to compare this implementation with three other maximum likelihood-based models in their accuracy to estimate true scores. The third aim is to show how joint modeling can be used for validity research. A simulation study was used to examine the second aim, while an empirical example was used to illustrate the third aim. The simulation study used three data generating processes, with varying degrees of deviation from linear models and with different sample sizes. Results of the simulation study showed that the Bayesian implementation supersedes the other models. In the empirical example, data collected from 66 participants using an iterated prisoner dilemma and a scale measuring cooperation-competition attitudes were used. Results showed that joint modeling is the best fitting model, also increasing the correlation between the true scores of both measures (deviations from the iterated prisoner dilemma and the scale). Finally, implications, limitations and future studies are discussed.

Analysis of Validation of Instruments to Measure Student’s Critical Thinking Ability and Science Literation

Abstrak: This study aims to produce a valid and reliable instrument to measure the influence of guided inquiry learning models on students' critical thinking skills and scientific literacy through assignment techniques. The instruments of this study are a syllabus, learning implementation plan (RPP), questions of critical thinking and scientific literacy. An analysis of validity is carried out by proving the content and criteria validity. The results of the analysis of validity, reliability, level of difficulty, and differentiation indicate that the instrument has met the criteria that are feasible and valid for measuring students' critical thinking and literacy skills.Keywords: Validity; Research Instruments; Critical Thinking; Science Literacy; Guided Inquiry.

EVALUATION OF THE RELATIONSHIP BETWEEN YOUTH ENTREPRENEURSHIP AND EMIGRATION INTENTIONS: THEORETICAL-METHODOLOGICAL ASPECTS

Purpose – the purpose of this article is to investigate the relationship between youth entrepreneurship and emigration attitudes by presenting a method for evaluating the link between youth participation in entrepreneurship promotion initiatives, entrepreneurship and emigration attitudes, and also to check its validity. Research methodology – the quantitative test method presented in the article consists of 3 key parts that have their own specifics of evaluation and different methodologies. Findings – the results of the study did not show the correlation between the analyzed elements. Research limitations – although a method test made it possible to verify its suitability, a more representative sample of respondents is needed to provide valid results about the correlation of above mentioned 3 elements. Practical implications – based on the methodology evaluated, everyone familiar with the material will be able to initiate surveys and/or scientifically based researches at a different territorial level on youth entrepreneurship and emigration intentions and to evaluate the extent of the youth involvement in entrepreneurship promotion initiatives and its relationship with the entrepreneurial spirit of the individual. Originality/Value – this study contributed to the existing research on entrepreneurship, supplementing it with new insights on the existence of a relation between entrepreneurship promotion, entrepreneurship, and the tendency to emigrate, which, as far as the authors are aware, was researched neither in Lithuania nor globally

A Systematic Review of Validation Practices for the Goal Attainment Scaling Measure

Goal attainment scaling (GAS) is an internationally recognized measure that is widely used in educational, counseling, and clinical settings to identify and evaluate relevant goals for an individual. The GAS is an unusual measure because its content, which consists of goals, is formed by the respondent and/or users in the process of completing the GAS. Using the unified view of validity as a guiding framework, this systematic review examines validation practices and how goals are represented in this measure. This review demonstrates that validation practices tend to focus on aspects that do not support the overall construct validity of the measure, as well as reference to the GAS measure or GAS scores as a property. Several gaps in validity evidence and the various ways goals are conceptualized are described and discussed. The varying ways goals are considered suggest clarity is needed to enhance explanations and score meaning. This review urges researchers to consider ways validity and validation evidence can help verify the many claims that are made about this measure. Future validity research needs to consider application of a theoretical framework and response processes as key aspects of substantiating the construct measured by the GAS.