Corrections for Criterion Reliability in Validity Generalization: A False Prophet in a Land of Suspended Judgment

2014 ◽  
Vol 7 (4) ◽  
pp. 478-500 ◽  
Author(s):  
James M. LeBreton ◽  
Kelly T. Scherer ◽  
Lawrence R. James
Keyword(s):  
Validity Generalization ◽  
Suspended Judgment ◽  
False Prophet

Corrections for Criterion Reliability in Validity Generalization: A False Prophet in a Land of Suspended Judgment

2014 ◽  
Vol 7 (4) ◽  
pp. 478-500 ◽  
Author(s):  
James M. LeBreton ◽  
Kelly T. Scherer ◽  
Lawrence R. James
Keyword(s):  
Job Performance ◽  
Predictor Variable ◽  
Direct Result ◽  
Scientific Integrity ◽  
Multiple Correlation ◽  
Validity Generalization ◽  
Suspended Judgment ◽  
Meta Analyses ◽  
False Prophet ◽  
Single Predictor

AbstractThe results of meta-analytic (MA) and validity generalization (VG) studies continue to be impressive. In contrast to earlier findings that capped the variance accounted for in job performance at roughly 16%, many recent studies suggest that a single predictor variable can account for between 16 and 36% of the variance in some aspect of job performance. This article argues that this “enhancement” in variance accounted for is often attributable not to improvements in science but to a dumbing down of the standards for the values of statistics used in correction equations. With rare exceptions, applied researchers have suspended judgment about what is and is not an acceptable threshold for criterion reliability in their quest for higher validities. We demonstrate a statistical dysfunction that is a direct result of using low criterion reliabilities in corrections for attenuation. Corrections typically applied to a single predictor in a VG study are instead applied to multiple predictors. A multiple correlation analysis is then conducted on corrected validity coefficients. It is shown that the corrections often used in single predictor studies yield a squared multiple correlation that appears suspect. Basically, the multiple predictor study exposes the tenuous statistical foundation of using abjectly low criterion reliabilities in single predictor VG studies. Recommendations for restoring scientific integrity to the meta-analyses that permeate industrial–organizational (I–O) psychology are offered.

“To the ravens”: Curses from the Oracle of Abonouteichos

2021 ◽  
Vol 60 (3-4) ◽  
pp. 417-427
Keyword(s):  
Financial Support ◽  
Second Century ◽  
Religious Conflict ◽  
Lucian Of Samosata ◽  
Market Theory ◽  
Roman World ◽  
Theory Of Religion ◽  
Roman Antiquity ◽  
False Prophet

Abstract This discussion examines the religious conflict between the cult and oracle of Glykon and its Epicurean opponents recorded in the second century CE satire, Alexander the False Prophet, by Lucian of Samosata. Following the market theory of religion approach, these groups can be understood to have been engaged in an intense and escalating struggle over followers, financial support, status, and, ultimately, for survival. For the oracle and Glykon's prophet, Alexander of Abonouteichos, this effort included the use of magical curses, which were deployed against their adversaries. As such, these circumstances represent an as-yet unrecognized agonistic context for cursing to take place in the Graeco-Roman world. Alexander's use of cursing also highlights previously overlooked aspects of his own connections to the practice of magic in Graeco-Roman antiquity.

Friedman on suspended judgment

Synthese ◽  
2018 ◽  
Vol 197 (11) ◽  
pp. 5009-5026
Author(s):  
Michal Masny
Keyword(s):  
Suspended Judgment

The Student Risk Screening Scale: A Reliability and Validity Generalization Meta-Analysis

2017 ◽  
Vol 26 (3) ◽  
pp. 143-155 ◽  
Author(s):  
Stephen P. Kilgus ◽  
Katie Eklund ◽  
Daniel M. Maggin ◽  
Crystal N. Taylor ◽  
Amanda N. Allen
Keyword(s):  
Internal Consistency ◽  
Externalizing Behavior ◽  
Meta Analysis ◽  
Reliability And Validity ◽  
Future Research ◽  
Risk Screening ◽  
Validity Generalization ◽  
Meta Analyses ◽  
Student Risk ◽  
Screening Scale

The purpose of this study was to conduct reliability and validity generalization meta-analyses of evidence regarding the Student Risk Screening Scale (SRSS), a universal screener for externalizing behavior problems. A systematic review of the literature resulted in the identification of 17 studies inclusive of evidence regarding SRSS score (a) internal consistency reliability (i.e., alpha coefficients), and/or (b) criterion-related validity (e.g., correlations between the SRSS and various outcomes). Multilevel meta-analyses indicated that across studies, SRSS scores were associated with adequate internal consistency (α = .83). Analyses further suggested the SRSS was a valid indicator of both social and behavioral outcomes ( r = .52) and academic outcomes ( r = .42). Follow-up analyses suggested that in accordance with theory-driven expectations, the SRSS was a stronger indicator of externalizing problems and broad behavior outcomes relative to alternative outcomes (e.g., internalizing problems). Limitations and directions for future research are discussed, including recommendations for the collection of additional SRSS diagnostic accuracy evidence.

Sign in / Sign up

Export Citation Format

Share Document