Abstract: Aim, Methods, Results, DiscussionAim: This paper presents analyses of outcome data for 317 therapists treating 14,161 patients over a three-year period to determine if therapists’ effect sizes increased over time. Each therapist treated at least 5 patients in each of their first two years of using outcome measures. Multiple outcome questionnaires were employed. All measures also included a brief alliance scale administered concurrently. Method: A severity adjusted effect size was calculated for each patient using intake scores and diagnostic group as predictors. The mean severity adjusted effect size for each therapist was calculated for their first and second years of using the outcome tools. This was done using a hierarchical linear model to control for sample size in each year, with a minimum sample of 5 cases in each year. Therapist engagement in receiving feedback was measured by counting the number of times the therapist logged into the online platform to view their results in each of the two years.Results: Therapists who logged in the view their data at least 24 times in the second year (n=123; 37%) averaged .92 effect size compared to .82 effect size for those seen by therapists who reviewed their results less frequently (n=214; 63%). Login frequency during the first year was not predictive of effect size during the second year. Discussion: The data provides evidence that effect sizes can trend upwards with measurement and feedback. Therapists’ engagement in receiving feedback appears to increase the likelihood of effect size gain.
Feedback-informed treatment in emergency psychiatry; a randomised controlled trial