The Use of Test Scores for Classification Decisions with Threshold Utility

1987 ◽  
Vol 12 (1) ◽  
pp. 62-75 ◽  
Author(s):  
Wim J. van der Linden

The classification problem consists of assigning subjects to one of several available treatments on the basis of their test scores, where the success of each treatment is measured by a different criterion. It is indicated how this problem can be formulated as an (empirical) Bayes decision problem. As an example, the case of classification with a threshold utility function is analyzed, and optimal assignment rules are derived. The results are illustrated empirically with data from a classification problem in which achievement test data are used to assign students to appropriate continuation schools.

2016 ◽  
Vol 32 (3) ◽  
pp. 204-214 ◽  
Author(s):  
Emilie Lacot ◽  
Mohammad H. Afzali ◽  
Stéphane Vautier

Abstract. Test validation based on usual statistical analyses is paradoxical, as, from a falsificationist perspective, they do not test that test data are ordinal measurements, and, from the ethical perspective, they do not justify the use of test scores. This paper (i) proposes some basic definitions, where measurement is a special case of scientific explanation; starting from the examples of memory accuracy and suicidality as scored by two widely used clinical tests/questionnaires. Moreover, it shows (ii) how to elicit the logic of the observable test events underlying the test scores, and (iii) how the measurability of the target theoretical quantities – memory accuracy and suicidality – can and should be tested at the respondent scale as opposed to the scale of aggregates of respondents. (iv) Criterion-related validity is revisited to stress that invoking the explanative power of test data should draw attention on counterexamples instead of statistical summarization. (v) Finally, it is argued that the justification of the use of test scores in specific settings should be part of the test validation task, because, as tests specialists, psychologists are responsible for proposing their tests for social uses.


2008 ◽  
Vol 56 (2) ◽  
pp. 145-161 ◽  
Author(s):  
Daryl W. Kinney

Nontransient 6th- and 8th-grade urban middle school students' achievement test scores were examined before (4th grade) and during (6th or 8th grade) enrollment in a performing ensemble. Ensemble participation (band, choir, none) and subject variables of socioeconomic status (SES) and home environment were considered. Fourth- and 6th-grade achievement tests consisted of Reading, Math, Citizenship and Science; 8th grade included Reading, Math, Social Studies, Science, and Language Arts. Analyses indicated significant differences yet small effect sizes for main effects of SES and ensemble participation. Higher SES students scored significantly higher on all subtests except 4th-, 6th-, and 8th-grade reading. Sixth-grade band students scored significantly higher than choir students and nonparticipants on every subtest of 6th- and 4th-grade achievement tests. Eighth-grade band students scored significantly higher than nonparticipants on 4th-grade Reading and Math and every subtest of the 8th-grade achievement test except Social Studies. Similar results for both cohorts suggest that band may attract higher achieving students from the outset and that test score differences remain stable over time.


2008 ◽  
Vol 107 (2) ◽  
pp. 497-506
Author(s):  
P. S. B. Sarma

The purpose of the study was to replicate findings of an earlier study of fourth grade boys manifesting mixed handedness with a sample. Among 32 mixed-handed boys in Grades 6 to 8, the right-handed writer, left-handed thrower group obtained low spelling scores (Normal Curve Equivalent Scores) on the California Achievement Test significantly more frequently than the left-handed writer, right-handed thrower group. These findings are consistent with data for Grade 4 boys in the earlier study. Findings strengthen the hypotheses that mixed handedness is not a unitary neuropsychological entity and that boys who write with the right hand and throw with the left hand might be at risk for certain academic deficits.


1993 ◽  
Vol 25 (1) ◽  
pp. 69-95 ◽  
Author(s):  
Samuel D. Miller ◽  
Treana Adkins ◽  
Mary Louise Hooper

This study evaluated the literacy assignments elementary teachers use in their reading and language arts instruction, the reasons why they use a particular assignment, and how students react to different assignments. The project was initiated by teachers (three third-grade and three fourth-grade) and their principal because they believed students failed to see how various reading and language arts skills were related to one another, had difficulties applying such skills whenever they had to read or write lengthy prose, and did not want to complete assignments unless they received extrinsic rewards. Furthermore, teachers said teaching was no longer as satisfying as it had been in previous years. To evaluate their concerns we examined whether their literacy assignments included those characteristics that foster student learning and motivation and we interviewed the teachers and principal about why they believed teaching was no longer as satisfying as it had once been. Interviews indicated that teachers and the principal believed accountability pressures to increase standardized achievement test scores strongly influenced their school's reading and language arts instruction. Teachers said they attempted to raise students' scores by emphasizing the standardized achievement test skills. To maximize skill coverage, teachers said they avoided literacy assignments that required the reading of lengthy texts, sophisticated writing, and lengthy discussions. Evaluations of their literacy assignments confirmed their statements; students seldom completed classwork which required sophisticated writing or reading. Student interviews showed that they were bored with these assignments or did them because they expected extrinsic rewards. Whenever they completed a more complex literacy assignment (i.e., those that required the writing of single or multiple sentences or paragraphs), students said they were challenged and enjoyed learning for learning's sake. Discussion focuses on the implications of these findings for school improvement studies and students' learning and motivation.


1984 ◽  
Vol 55 (1) ◽  
pp. 297-298 ◽  
Author(s):  
Jack A. Naglieri

The predictive validity of the Peabody Picture Vocabulary Test—Revised was examined for a sample of 33 Navajo children in Grades 1 to 6. Test scores correlated .65 and significantly with scores obtained 10½ mo. later on the Peabody Individual Achievement Test Total score. Implications for interpretation are discussed.


Sign in / Sign up

Export Citation Format

Share Document