IRT-Based Differential Item Functioning Analysis of the Youth Level of Service/Case Management Inventory Across Indigenous and Non-Indigenous Youth

2020 ◽  
pp. 009385482096887
Author(s):  
Shiming Huang ◽  
Michele Peterson-Badali ◽  
Eunice Eunhee Jang ◽  
Tracey A. Skilling
Keyword(s):  
Case Management ◽  
Differential Item Functioning ◽  
Predictive Accuracy ◽  
Assessment Instrument ◽  
Level Of Service ◽  
Indigenous Youth ◽  
Risk Levels ◽  
Risk Assessment Instrument ◽  
Item Functioning ◽  
General Recidivism

Even though risk assessments are routinely conducted in the criminal justice system to inform sentencing and case management, their cross-cultural applicability remains contested. This study investigated the generalizability of the Youth Level of Service/Case Management Inventory (YLS/CMI), a widely implemented youth forensic risk assessment instrument, using an Item Response Theory framework, in a sample of Indigenous ( n = 205) and non-Indigenous ( n = 193) youth. Differential item functioning analyses demonstrated similar discrimination across groups. However, despite similar latent risk levels, non-Indigenous youth were more likely to have items from the Education domain endorsed, while Indigenous youth were more likely to have items from the Substance Abuse domain endorsed. Predictive accuracy analyses indicated that total YLS/CMI scores significantly predicted general recidivism (without administration of justice convictions) for non-Indigenous youth, but not for Indigenous youth. There is an urgent need for more research investigating the applicability of the YLS/CMI to diverse groups of Indigenous youth.

An Examination of Changes in LSI-R Scores Over Time: Making the Case for Needs-Based Case Management

2011 ◽  
Vol 38 (6) ◽  
pp. 541-553 ◽  
Author(s):  
Melinda D. Schlager ◽  
Daniel Pacheco
Keyword(s):  
Risk Assessment ◽  
Case Management ◽  
Predictive Validity ◽  
Community Corrections ◽  
Policy Implications ◽  
Assessment Instrument ◽  
Level Of Service ◽  
Change Scores ◽  
Risk Assessment Instrument ◽  
Over Time

The Level of Service Inventory—Revised (LSI-R) is an actuarially derived risk assessment instrument with a demonstrated reputation and record of supportive research. It has shown predictive validity on several offender populations. Although a significant literature has emerged on the validity and use of the LSI-R, no research has specifically examined change scores or the dynamics of reassessment and its importance with respect to case management. Flores, Lowenkamp, Holsinger, and Latessa and Lowenkamp and Bechtel, among others, specifically identify the importance and need to examine LSI-R reassessment scores. The present study uses a sample of parolees ( N = 179) from various community corrections programs that were administered the LSI-R at two different times. Results indicate that both mean composite and subcomponent LSI-R scores statistically significantly decreased between Time 1 and Time 2. The practical, theoretical, and policy implications of these results are discussed.

Client Management Classification and Prediction of Probation Outcome

1994 ◽  
Vol 40 (2) ◽  
pp. 154-174 ◽  
Author(s):  
Patricia M. Harris
Keyword(s):  
Risk Assessment ◽  
Predictive Accuracy ◽  
False Positives ◽  
Assessment Instrument ◽  
Assessment Instruments ◽  
Risk Assessment Instrument ◽  
System A ◽  
Probation Supervision ◽  
Supervision Practices ◽  
Client Management

This article compares the predictive accuracy of a traditional, objective probation risk assessment instrument with the considerably more subjective, interview-based Client Management Classification (CMC) System, a tool with no previously noted applications to the prediction of risk. Subjects of the study were probationers under supervision in Austin, Texas. Results indicated that the CMC performed far more satisfactorily than did the traditional instrument. The CMC was found to be particularly successful in minimizing false positives (i.e., probationers incorrectly predicted to be high risks). The results suggest that offender risk assessment instruments of a national scope are possible. Implications for assessment and probation supervision practices are considered.

Professional Discretion and the Predictive Validity of a Juvenile Risk Assessment Instrument

2016 ◽  
Vol 15 (2) ◽  
pp. 103-118 ◽  
Author(s):  
James T. McCafferty
Keyword(s):  
Risk Assessment ◽  
Predictive Validity ◽  
Assessment Tool ◽  
Assessment Instrument ◽  
Adjusted Risk ◽  
Risk Levels ◽  
Risk Assessment Instrument ◽  
Actuarial Risk ◽  
Using Data ◽  
The Impact

The ability for professionals to override the results of an actuarial risk assessment tool is an essential part of effective correctional risk classification; however, little is known about how this important function affects the predictive validity of these tools. Using data from a statewide sample of juveniles from Ohio, this study examined the impact of professional adjustments on the predictive validity of a juvenile risk assessment instrument. This study found that the original and adjusted risk levels were significant predictors of recidivism, but the original risk levels were stronger predictors of recidivism than the adjusted risk levels that accounted for overrides.

The Impact of Juvenile Educational Measures, Confinement Centers, and Probation on Adult Recidivism

2018 ◽  
Vol 62 (13) ◽  
pp. 4108-4123
Author(s):  
Lidón Villanueva ◽  
Keren Cuervo
Keyword(s):  
Case Management ◽  
Juvenile Court ◽  
Juvenile Detention ◽  
Level Of Service ◽  
Risk Level ◽  
Detention Center ◽  
Risk Levels ◽  
Juvenile Detention Center ◽  
The Impact

This study aimed to examine the impact of the educational measure of confinement in juvenile detention center versus probation, on adult recidivism. Participants were 264 youths with a disciplinary record in the Juvenile Court ( M = 16.5), who were sentenced to custody in a juvenile closed detention center or to probation. The risk levels were assessed using the YLS/CMI Inventory (Youth Level of Service/Case Management). A follow-up period for studying these two groups into adulthood was carried out to register possible adult recidivism. The results showed that probation was more effective in reducing subsequent adult offences than the deprivation of liberty. The variable risk level also appears to be a significant factor, improving the predictive model of adult recidivism.

Analysis of Differential Item Functioning (DIF) Using Hierarchical Logistic Regression Models

2002 ◽  
Vol 27 (1) ◽  
pp. 53-75 ◽  
Author(s):  
David B. Swanson ◽  
Brian E. Clauser ◽  
Susan M. Case ◽  
Ronald J. Nungester ◽  
Carol Featherman
Keyword(s):  
Logistic Regression ◽  
Differential Item Functioning ◽  
Empirical Bayes ◽  
Predictive Accuracy ◽  
Large Data ◽  
The United States ◽  
Related Item ◽  
Data Set ◽  
Hierarchical Logistic Regression ◽  
Item Functioning

Over the past 25 years a range of parametric and nonparametric methods have been developed for analyzing Differential Item Functioning (DIF). These procedures are typically performed for each item individually or for small numbers of related items. Because the analytic procedures focus on individual items, it has been difficult to pool information across items to identify potential sources of DIF analytically. In this article, we outline an approach to DIF analysis using hierarchical logistic regression that makes it possible to combine results of logistic regression analyses across items to identify consistent sources of DIF, to quantify the proportion of explained variation in DIF coefficients, and to compare the predictive accuracy of alternate explanations for DIF. The approach can also be used to improve the accuracy of DIF estimates for individual items by applying empirical Bayes techniques, with DIF-related item characteristics serving as collateral information. To illustrate the hierarchical logistic regression procedure, we use a large data set derived from recent computer-based administrations of Step 2, the clinical science component of the United States Medical Licensing Examination (USMLE®). Results of a small Monte Carlo study of the accuracy of the DIF estimates are also reported.

Risk Factors for Absconding Among Adult Parolees in Colorado

2018 ◽  
Vol 62 (14) ◽  
pp. 4622-4641
Author(s):  
Ráchael A. Powers ◽  
Catherine Kaukinen ◽  
Norair Khachatryan
Keyword(s):  
Risk Factors ◽  
Risk Assessment ◽  
Substance Abuse ◽  
Criminal Justice ◽  
Criminal History ◽  
Assessment Instrument ◽  
Social Characteristics ◽  
Level Of Service ◽  
Future Research ◽  
Risk Assessment Instrument

Studies that have examined absconding have pointed to the relevance of factors related to demographics, situational, and social characteristics, as well as criminal history variables as predictive of offenders’ decision to abscond. This study contributes to this literature by extending factors that have been explored for criminal justice outcomes such as recidivism to predict the likelihood of absconding. In particular, this study incorporates the Level of Service Inventory-Revised (LSI-R) risk assessment instrument and types of violations to examine their impact on the likelihood of absconding. Using a large sample of parolees from Colorado ( n = 30,181), the findings in this study indicate that the largest predictors of absconding were substance abuse problems and education. In addition, variables measuring the components of the LSI-R and specific nonabsconding parole violations moderately predict absconding. The implications of the findings and recommendations for future research are discussed.

Reliability of Differential Item Functioning in Alcohol Use Disorder: Bayesian Meta-Analysis of Criteria Discrimination Estimates

Assessment ◽  
2021 ◽  
pp. 107319112098661
Author(s):  
Colin E. Vize ◽  
Sean P. Lane
Keyword(s):  
Alcohol Use ◽  
Differential Item Functioning ◽  
Alcohol Use Disorder ◽  
Meta Analysis ◽  
Intraclass Correlation ◽  
Assessment Instrument ◽  
Parameter Estimates ◽  
Total N ◽  
Item Functioning ◽  
Study Characteristics

Numerous studies leverage item response theory (IRT) methods to examine measurement characteristics of alcohol use disorder (AUD) diagnostic criteria. Less work has examined the consistency of AUD IRT parameter estimates, an essential step for establishing measurement invariance, making statements about symptom diagnosticity, and validating the theoretical construct. A Bayesian meta-analysis of IRT discrimination values for AUD criteria across 33 independent samples (Total N = 321,998) revealed that overall consistency of AUD criteria discriminations was low (generalized intraclass correlation range = .105-.249). However, specific study characteristics accounted for substantial variability, suggesting that the unreliability is partially systematic. We replicated evidence of differential item functioning (DIF) via established factors (e.g., age, gender), but the magnitudes were small compared with DIF associated with assessment instrument. These results offer practical recommendations regarding which instruments to use when specific AUD criteria are of interest and which criteria are most sensitive when comparing demographic groups.

Erfassung von mathematischen Kompetenzen im Vorschulalter mit MARKO-D

Diagnostica ◽  
2021 ◽  
Vol 67 (1) ◽  
pp. 13-23
Author(s):  
Ariana Garrote ◽  
Elisabeth Moser Opitz
Keyword(s):  
Differential Item Functioning ◽  
Item Functioning

Zusammenfassung. In dieser Studie wurde der Test MARKO-D (Mathematik- und Rechenkonzepte im Vorschulalter–Diagnose) mit einer Stichprobe von Kindern aus der deutschsprachigen Schweiz ( N = 555) im ersten und zweiten Kindergartenjahr erprobt und es wurde analysiert, ob sich die Altersnormen der deutschen Stichprobe auf die Schweiz übertragen lassen. Zudem wurde der Test mit einer Teilstichprobe ( n = 87) hinsichtlich Messinvarianz über die Zeit untersucht. Die Ergebnisse des eindimensionalen Rasch-Modells zeigen, dass das Instrument für die Schweiz geeignet ist. Die Testleistungen hängen jedoch vom Kindergartenbesuch ab. Für die Schweiz müssten deshalb nebst Altersnormen auch Normen pro Kindergartenhalbjahr verwendet werden. Die Analyse mittels Differential Item Functioning ergab, dass 17 von 55 Items von großer Messvarianz über die Zeit betroffen sind. Um das Instrument für Längsschnittuntersuchungen einsetzen zu können, müsste es weiterentwickelt werden.

Differential Item Functioning in Brief Instruments of Disordered Eating

2019 ◽  
Vol 35 (6) ◽  
pp. 823-833 ◽  
Author(s):  
Desiree Thielemann ◽  
Felicitas Richter ◽  
Bernd Strauss ◽  
Elmar Braehler ◽  
Uwe Altmann ◽  
...  
Keyword(s):  
Differential Item Functioning ◽  
Disordered Eating ◽  
Structural Equation ◽  
Young Female ◽  
Eating Attitudes ◽  
Equation Model ◽  
German Population ◽  
Test Fairness ◽  
Item Functioning ◽  
Multiple Indicator

Abstract. Most instruments for the assessment of disordered eating were developed and validated in young female samples. However, they are often used in heterogeneous general population samples. Therefore, brief instruments of disordered eating should assess the severity of disordered eating equally well between individuals with different gender, age, body mass index (BMI), and socioeconomic status (SES). Differential item functioning (DIF) of two brief instruments of disordered eating (SCOFF, Eating Attitudes Test [EAT-8]) was modeled in a representative sample of the German population ( N = 2,527) using a multigroup item response theory (IRT) and a multiple-indicator multiple-cause (MIMIC) structural equation model (SEM) approach. No DIF by age was found in both questionnaires. Three items of the EAT-8 showed DIF across gender, indicating that females are more likely to agree than males, given the same severity of disordered eating. One item of the EAT-8 revealed slight DIF by BMI. DIF with respect to the SCOFF seemed to be negligible. Both questionnaires are equally fair across people with different age and SES. The DIF by gender that we found with respect to the EAT-8 as screening instrument may be also reflected in the use of different cutoff values for men and women. In general, both brief instruments assessing disordered eating revealed their strengths and limitations concerning test fairness for different groups.

Sign in / Sign up

Export Citation Format

Share Document