scholarly journals Treatment fidelity of technology‐enhanced reading therapy (CommuniCATE) for people with aphasia

Author(s):  
Katharine Bacon ◽  
Jane Marshall ◽  
Anna Caute ◽  
Katie Monnelly ◽  
Madeline Cruice ◽  
...  
2020 ◽  
Vol 29 (1S) ◽  
pp. 412-424
Author(s):  
Elissa L. Conlon ◽  
Emily J. Braun ◽  
Edna M. Babbitt ◽  
Leora R. Cherney

Purpose This study reports on the treatment fidelity procedures implemented during a 5-year randomized controlled trial comparing intensive and distributed comprehensive aphasia therapy. Specifically, the results of 1 treatment, verb network strengthening treatment (VNeST), are examined. Method Eight participants were recruited for each of 7 consecutive cohorts for a total of 56 participants. Participants completed 60 hr of aphasia therapy, including 15 hr of VNeST. Two experienced speech-language pathologists delivered the treatment. To promote treatment fidelity, the study team developed a detailed manual of procedures and fidelity checklists, completed role plays to standardize treatment administration, and video-recorded all treatment sessions for review. To assess protocol adherence during treatment delivery, trained research assistants not involved in the treatment reviewed video recordings of a subset of randomly selected VNeST treatment sessions and completed the fidelity checklists. This process was completed for 32 participants representing 2 early cohorts and 2 later cohorts, which allowed for measurement of protocol adherence over time. Percent accuracy of protocol adherence was calculated across clinicians, cohorts, and study condition (intensive vs. distributed therapy). Results The fidelity procedures were sufficient to promote and verify a high level of adherence to the treatment protocol across clinicians, cohorts, and study condition. Conclusion Treatment fidelity strategies and monitoring are feasible when incorporated into the study design. Treatment fidelity monitoring should be completed at regular intervals during the course of a study to ensure that high levels of protocol adherence are maintained over time and across conditions.


2021 ◽  
Vol 7 (1) ◽  
Author(s):  
M. Lewis ◽  
K. Bromley ◽  
C. J. Sutton ◽  
G. McCray ◽  
H. L. Myers ◽  
...  

Abstract Background The current CONSORT guidelines for reporting pilot trials do not recommend hypothesis testing of clinical outcomes on the basis that a pilot trial is under-powered to detect such differences and this is the aim of the main trial. It states that primary evaluation should focus on descriptive analysis of feasibility/process outcomes (e.g. recruitment, adherence, treatment fidelity). Whilst the argument for not testing clinical outcomes is justifiable, the same does not necessarily apply to feasibility/process outcomes, where differences may be large and detectable with small samples. Moreover, there remains much ambiguity around sample size for pilot trials. Methods Many pilot trials adopt a ‘traffic light’ system for evaluating progression to the main trial determined by a set of criteria set up a priori. We construct a hypothesis testing approach for binary feasibility outcomes focused around this system that tests against being in the RED zone (unacceptable outcome) based on an expectation of being in the GREEN zone (acceptable outcome) and choose the sample size to give high power to reject being in the RED zone if the GREEN zone holds true. Pilot point estimates falling in the RED zone will be statistically non-significant and in the GREEN zone will be significant; the AMBER zone designates potentially acceptable outcome and statistical tests may be significant or non-significant. Results For example, in relation to treatment fidelity, if we assume the upper boundary of the RED zone is 50% and the lower boundary of the GREEN zone is 75% (designating unacceptable and acceptable treatment fidelity, respectively), the sample size required for analysis given 90% power and one-sided 5% alpha would be around n = 34 (intervention group alone). Observed treatment fidelity in the range of 0–17 participants (0–50%) will fall into the RED zone and be statistically non-significant, 18–25 (51–74%) fall into AMBER and may or may not be significant and 26–34 (75–100%) fall into GREEN and will be significant indicating acceptable fidelity. Discussion In general, several key process outcomes are assessed for progression to a main trial; a composite approach would require appraising the rules of progression across all these outcomes. This methodology provides a formal framework for hypothesis testing and sample size indication around process outcome evaluation for pilot RCTs.


2021 ◽  
Author(s):  
Thomas Langford ◽  
Alex Leff ◽  
Daniela Romano
Keyword(s):  

Author(s):  
Lisa Sanetti ◽  
Melissa A. Collier-Meek ◽  
Lindsay Fallon

Research has linked the use of evidence-supported treatments to effective, efficient therapeutic outcomes. Questions related to the best way to disseminate and implement evidence-supported treatments in the field has led to discussions about transportability of treatments from controlled to applied settings. Specifically, scholars have focused on issues related to treatment fidelity, acceptability, and adoption versus adaptation of evidence-based treatments in practice. Treatment fidelity, a multidimensional construct, pertains to how extensively a treatment is delivered to a client, and it may be affected by several variables. Although the relationship is complex, treatment fidelity is considered an important moderator of client outcomes. Furthermore, the acceptability of a treatment appears to be of importance. Simply, if a treatment is perceived to be acceptable, it is more likely to be implemented with high levels of fidelity, increasing the chances that successful therapeutic outcomes will result. Nevertheless data indicate that some clinicians are wary of using evidence-supported treatments; their chief concern is feasibility of implementation, which could affect treatment fidelity and acceptability. Thus, there is a debate about whether evidence-supported treatments should be adopted strictly as developed or whether they might be adapted to improve implementation and acceptability. In adaptation of a treatment, relevant clinician variables (e.g., training received, availability of resources) and client factors (e.g., cultural fit) might be considered to promote therapeutic outcomes. This chapter describes how the key to treatment success may be to strike a balance between fidelity and adaptation of evidence-based treatments and fidelity with flexibility.


2016 ◽  
Vol 9 ◽  
Author(s):  
Pamela Myles

Welcome to this Special Issue of tCBT. Our focus in this special edition of the journal is on supervision. Few would argue the vital role of supervision during CBT training and beyond to ensure treatment fidelity to evidence-based protocols. I would like to take this opportunity to thank Professors Derek Milne and Robert Reiser for kindly acting as guest editors. In addition, we are grateful for their fine contributions to the supervision literature in this particular edition of the journal. Thanks too to Professor Cory Newman from the tCBT editorial board for contributing to the overarching paper provided by Professors Milne and Reiser. Thanks also to all the authors for their fine contributions and to our reviewers who gave so generously of their time to comment on the submitted manuscripts. Our intention is to publish one Special Issue a year, next year we look forward to a special edition with a focus on ‘complexity’ with guest editors Dr Claire Lomax and Dr Stephen Barton from Newcastle University.


2008 ◽  
Vol 5 (3) ◽  
pp. 398-417 ◽  
Author(s):  
Jeff David Breckon ◽  
Lynne Halley Johnston ◽  
Andrew Hutchison

Background:Physical activity (PA) counseling is becoming commonplace in primary care settings, although there is a high degree of variation in the quality and quantity of this intervention. The purpose of this review was to examine the theory on which the intervention is based and the level of treatment fidelity applied at all stages of the intervention.Methods:A systematic review was carried out for interventions that reported an element of PA counseling. Results were mapped according to a treatment fidelity framework of intervention design, training, delivery, receipt, and enactment.Results:Most studies were underpinned by the transtheoretical model. Few studies described the frequency or duration of PA counseling training or competence level of the interventionist. The most common outcome measures were behavioral and physiological, with few studies including a cognitive outcome measure.Conclusions:Most research focuses on outcome and significance rather than intervention processes, with limited consideration of treatment fidelity. The design, training, delivery, and receipt of PA counseling should be reported more thoroughly.


2016 ◽  
Vol 13 (1) ◽  
pp. 75-84 ◽  
Author(s):  
Nienke Bleijenberg ◽  
Valerie H. ten Dam ◽  
Irene Drubbel ◽  
Mattijs E. Numans ◽  
Niek J. de Wit ◽  
...  

Author(s):  
Martha E. Snell ◽  
Nancy Brady ◽  
Lee McLean ◽  
Billy T. Ogletree ◽  
Ellin Siegel ◽  
...  

Abstract This literature review was conducted to evaluate the current state of evidence supporting communication interventions for individuals with severe intellectual and developmental disabilities. We reviewed 116 articles published between 1987 and 2007 in refereed journals meeting three criteria: (a) described a communication intervention, (b) involved one or more participants with severe intellectual and developmental disabilities, and (c) addressed one or more areas of communication performance. Many researchers failed to report treatment fidelity or to assess basic aspects of intervention effects, including generalization, maintenance, and social validity. The evidence reviewed indicates that 96% of the studies reported positive changes in some aspects of communication. These findings support the provision of communication intervention to persons with severe intellectual and developmental disabilities. Gaps in the research were reported as were recommendations for future research.


Sign in / Sign up

Export Citation Format

Share Document