Program Provider and Observer Ratings of School-Based Preventive Intervention Implementation: Agreement and Relation to Youth Outcomes

Few prevention studies have examined the degree to which different measures of program implementation adherence predict youth outcomes. The current study was conducted with rural middle school youth participating in a longitudinal school-based preventive intervention program. Study participants’ average age at the pretest assessment was 12.3 years. The association between program implementation ratings supplied by provider self-reports and trained independent observer reports were evaluated. In addition, the relationship between measures of implementation and youth outcomes were examined. Results indicated that although program providers tended to report higher implementation than independent observers, most ratings were correlated significantly across raters. Observer-reported implementation ratings significantly predicted several youth substance-related outcomes, while provider-reported self-ratings did not.Program provider characteristics predicted several youth outcomes. Findings suggest that there might be a social desirability bias in provider self-reported ratings of implementation and that caution must be used when interpreting self-reported ratings of implementation.

Download Full-text

La prévention des problèmes de comportement à l’adolescence : le Adolescent Transition Program

Criminologie ◽

10.7202/017412ar ◽

2005 ◽

Vol 31 (1) ◽

pp. 67-85 ◽

Cited By ~ 4

Author(s):

François Poulin ◽

Thomas J. Dishion ◽

Kate Kavanagh ◽

Jeff Kiesner

Keyword(s):

Pilot Study ◽

High Risk ◽

Problem Behaviors ◽

Parenting Practices ◽

Intervention Program ◽

Preventive Intervention ◽

Transition Program ◽

School Based ◽

Adolescent Transition ◽

Adolescent Transition Program

The Adolescent Transition Program (ATP) is a multi-component preventive intervention designed to reduce escalation in problem behaviors among high-risk young adolescents. A previous evaluation of this program showed that aggregating high-risk youths for intervention purposes led to an escalation in delinquency and smoking. The results of this study also suggested that an intervention targeting parenting practices was more beneficial. These findings led to the development of a new intervention program aimed at the modification of parenting practices. This school-based program proposes a multiple gating approach to parent intervention with each level of intervention building on the previous one to reduce the overall prevalence of risk. A pilot study designed to evaluate the implementation of this intervention program suggested that schools seem to be an appropriate setting for reaching parents of high-risk adolescents and delivering intervention services.

Download Full-text

At-risk youth: Impact of mentoring program vs. school-based intervention program on academic outcomes

PsycEXTRA Dataset ◽

10.1037/e683152011-427 ◽

2011 ◽

Author(s):

Brooke R. Spangler ◽

Christopher Defranco ◽

Brittany Smith ◽

J. D. Santo

Keyword(s):

At Risk ◽

Academic Outcomes ◽

Intervention Program ◽

At Risk Youth ◽

Mentoring Program ◽

School Based Intervention ◽

School Based

Download Full-text

Socio-economic differences in smoking among adolescents in a school-based smoking intervention: The X:IT II study

Scandinavian Journal of Public Health ◽

10.1177/14034948211007683 ◽

2021 ◽

pp. 140349482110076

Author(s):

Lotus S. Bast ◽

Lisbeth Lund ◽

Stine G. LauemØller ◽

Simone G. Kjeld ◽

Pernille Due ◽

...

Keyword(s):

Preventive Intervention ◽

First Year ◽

Difference In Difference ◽

Current Smoking ◽

Smoking Intervention ◽

School Time ◽

School Based ◽

Inequality In Health ◽

Baseline Response

Aims: Socio-economic inequalities in health behaviour may be influenced by health interventions. We examined whether the X:IT II intervention, aiming at preventing smoking in adolescence, was equally effective among students from different occupational social classes (OSC). Methods: We used data from the multi-component school-based smoking preventive intervention X:IT II, targeting 13- to 15-year-olds in Denmark. The intervention was tested in 46 schools with 2307 eligible students at baseline (response rate=86.6%) and had three main intervention components: smoke-free school time, smoke-free curriculum and parental involvement. We used a difference-in-difference design and estimated the change in current smoking after the first year of implementation in high versus low OSC. Analyses were based on available cases ( N=1190) and imputation of missing data at follow-up ( N=1967). Results: We found that 1% of the students from high OSC and 4.9% from low OSC were smokers at baseline (imputed data), and 8.2% of the students from high OSC and 12.2% from low OSC were smokers at follow-up. Difference-in-difference estimates were close to zero, indicating no differential trajectory. Conclusions: As intended, the X:IT II intervention, designed to apply equally to students from all socio-economic groups, did not seem to create different trajectories in current smoking among adolescents in high and low socio-economic groups. To diminish social inequality in health, future studies should carefully consider the ability to affect all socio-economic groups equally, or even to appeal mainly to participants from lower socio-economic groups, as they are often the ones most in need of intervention.

Download Full-text

Concordance between clinician, supervisor and observer ratings of therapeutic competence in CBT and treatment as usual: does clinician competence or supervisor session observation improve agreement?

Behavioural and Cognitive Psychotherapy ◽

10.1017/s1352465819000699 ◽

2019 ◽

Vol 48 (3) ◽

pp. 350-363 ◽

Cited By ~ 2

Author(s):

EB Caron ◽

Michela A. Muggeo ◽

Heather R. Souer ◽

Jeffrey E. Pella ◽

Golda S. Ginsburg

Keyword(s):

Behavioral Therapy ◽

Training Methods ◽

Rater Training ◽

Treatment As Usual ◽

School Based ◽

Audio Recordings ◽

Evidence Based Treatments ◽

Therapeutic Competence ◽

Observer Ratings ◽

The Cost

AbstractBackground:Lowering the cost of assessing clinicians’ competence could promote the scalability of evidence-based treatments such as cognitive behavioral therapy (CBT).Aims:This study examined the concordance between clinicians’, supervisors’ and independent observers’ session-specific ratings of clinician competence in school-based CBT and treatment as usual (TAU). It also investigated the association between clinician competence and supervisory session observation and rater agreement.Method:Fifty-nine school-based clinicians (90% female, 73% Caucasian) were randomly assigned to implement TAU or modular CBT for youth anxiety. Clinicians rated their confidence after each therapy session (n = 1898), and supervisors rated clinicians’ competence after each supervision session (n = 613). Independent observers rated clinicians’ competence from audio recordings (n = 395).Results:Patterns of rater discrepancies differed between the TAU and CBT groups. Correlations with independent raters were low across groups. Clinician competence and session observation were associated with higher agreement among TAU, but not CBT, supervisors and clinicians.Conclusions:These results support the gold standard practice of obtaining independent ratings of adherence and competence in implementation contexts. Further development of measures and/or rater training methods for clinicians and supervisors is needed.

Download Full-text