Multistage Test Reliability Estimated via Classical Test Theory

2016 ◽  
pp. 303-308
2019 ◽  
Author(s):  
Robert Foster

This paper develops a generalized framework which allows for the use of parametric classical test theory inference with non-normal models. Using the theory of natural exponential families and Bayesian theory of their conjugate priors, theoretical properties of test scores under the framework are derived, including a formula for parallel-test reliability in terms of the test length and a parameter of the underlying population distribution of abilities. This framework is shown to satisfy the general properties of classical test theory several common classical test theory results are shown to reduce to parallel-test reliability in this framework. An empirical Bayes method for estimating reliability, both with point estimates and with intervals, is described using maximum likelihood. This method is applied to an example set of data and compared to classical test theory estimators of reliability, and a simulation study is performed to show the coverage of the interval estimates of reliability derived from the framework.


2017 ◽  
Vol 2 (1) ◽  
pp. 34
Author(s):  
Rida Sarwiningsih

<p>This research aims to compare the internal consistency of reliability coefficient on classical test theory. Estimation accuracy of internal consistency reliability coefficient used several methods of the coefficient reliability formulation. The methods are Split-Half Method, Cronbach Alpha formula, and Kuder Richardson formula.  Determination of the test reliability coefficients used also some formula and then their results were compared with the results of their estimation accuracy. This research is a quantitative descriptive. Data were analyzed based on responses of national chemistry examination in Jambi province on academic year 2014/2015. The data of students answer sheets were taken using proportional stratified random sampling technique. There are 200 students’ responses from 162 schools (132 public schools and 30 private schools) in Jambi province. The form of data were dichotomy data and analyzed using Split-Half Method. Their reliabilities were analyzed using Cronbach Alpha formula and Kuder Richardson formula. Reliability criteria used consist of five conditions, they are 0.5; 0.6; 0.7; 0.8 and 0.9. The results of this research indicated that (a) the coefficient of reliability in classical test theory developed by measurement experts (using Split-Half Method, Cronbach Alpha formula and Kuder Richardson formula) have varying estimates of accuracy;  (b) average reliability coefficients have the precision estimation about of 0.78 up to 0.8; (c) the reliability coefficient using Spearman Brown formula was 0.78, with Rulon formula was 0.78, Flanagan formula was 0.77, Cronbach Alpha formula was 0.838, the KR20 formula was 0.838, and KR21 formula was 0.82<em>1.</em></p>


Author(s):  
James Austin

Classical testing theory, including its origins within psychological measurement, the fundamental principles of true scores and measurement error, psychometrics, and statistical assumptions are the focus of this chapter. Random and systematic forms of measurement error are addressed, and the standard error of measurement is defined. Major approaches to defining and estimating test reliability and validity are reviewed, and practical applications of classical test theory to K-12 music education assessment are considered, including large-scale standardized testing as well as measurement levels, item analysis, and techniques for enhancing the reliability and validity of classroom-level assessments. Finally, the transition from classical test theory to modern test theory is explored.


1994 ◽  
Vol 19 (1) ◽  
pp. 73-90 ◽  
Author(s):  
Ronald D. Armstrong ◽  
Douglas H. Jones ◽  
Zhaobo Wang

A network-flow model is formulated for constructing parallel tests based on classical test theory using test reliability for the criterion. The model enables practitioners to specify a test difficulty distribution for the values of the item difficulties as well as test composition requirements. Use of the network-flow algorithm ensures high computational efficiency, allowing wide applications of optimal test construction using microcomputers. The results of an empirical study show that the generated tests have acceptably high test reliability.


Sign in / Sign up

Export Citation Format

Share Document