Technical Adequacy of the SWPBIS Tiered Fidelity Inventory

2016 ◽  
Vol 19 (1) ◽  
pp. 3-13 ◽  
Author(s):  
Kent McIntosh ◽  
Michelle M. Massar ◽  
Robert F. Algozzine ◽  
Heather Peshak George ◽  
Robert H. Horner ◽  
...  
Keyword(s):  
Behavioral Interventions ◽  
Large Scale ◽  
Scale Validation ◽  
Action Planning ◽  
Fidelity Of Implementation ◽  
Initial Assessment ◽  
Positive Behavioral Interventions ◽  
Study Results ◽  
Fidelity Measures ◽  
Test Retest Reliability

Full and durable implementation of school-based interventions is supported by regular evaluation of fidelity of implementation. Multiple assessments have been developed to evaluate the extent to which schools are applying the core features of school-wide positive behavioral interventions and supports (SWPBIS). The SWPBIS Tiered Fidelity Inventory (TFI) was developed to be used as an initial assessment to determine the extent to which a school is using (or needs) SWPBIS, a measure of SWPBIS fidelity of implementation at all three tiers of support, and a tool to guide action planning for further implementation efforts. In this research, we evaluated the psychometric properties of the TFI in three studies: a content validity study, a usability and reliability study, and a large-scale validation study. Results showed strong construct validity for assessing fidelity at all three tiers, strong interrater and 2-week test–retest reliability, high usability for action planning, and strong relations with existing SWPBIS fidelity measures. Implications for accurate evaluation planning are discussed.

scholarly journals An Investigation of Concurrent Validity of Fidelity of Implementation Measures at Initial Years of Implementation

2019 ◽  
Vol 40 (1) ◽  
pp. 25-31
Author(s):  
Caitlin Rasplica Khoury ◽  
Kent McIntosh ◽  
Robert Hoselton
Keyword(s):  
Student Outcomes ◽  
Behavioral Interventions ◽  
Fidelity Of Implementation ◽  
Self Assessment ◽  
Cross Sectional ◽  
School Practices ◽  
Positive Behavioral Interventions ◽  
Self Assessments ◽  
Positive Correlations ◽  
Fidelity Measures

Fidelity of implementation of school practices is crucial to student outcomes. Several types of tools, including self-assessments, are available for measuring fidelity, but little is known regarding the relation of self-assessments of fidelity to fidelity instruments completed with the support of external experts, specifically, during the first few years of implementation. The present study used cross-sectional data from 1,438 schools to examine relations between fidelity self-assessment and team-based fidelity measures in the first 4 years of implementation of School-Wide Positive Behavioral Interventions and Supports (SWPBIS). Results showed strong positive correlations between fidelity self-assessments and a team-based measure of fidelity at each year of implementation.

A Survey of Team Members’ Perceptions of Coaching Activities Related to Tier 1 SWPBIS Implementation

2019 ◽  
Vol 22 (1) ◽  
pp. 51-61 ◽  
Author(s):  
Eoin Bastable ◽  
Michelle M. Massar ◽  
Kent McIntosh
Keyword(s):  
Behavioral Interventions ◽  
Implementation Fidelity ◽  
Action Planning ◽  
Fidelity Of Implementation ◽  
Team Members ◽  
Positive Behavioral Interventions ◽  
Tier 1 ◽  
Perceived Importance ◽  
Partial Correlations ◽  
Coaching Activities

Coaching is an important component in multi-tiered systems of support (MTSS) such as school-wide positive behavioral interventions and supports (SWPBIS), but little is known about which coaching activities are most related to sustained implementation of this school-wide framework. A survey was developed to examine the amount of receipt and perceived importance of coaching activities delivered to SWPBIS school teams. Respondents included SWPBIS team members ( n = 264) implementing Tier 1 SWPBIS for at least 3 years in 138 districts across nine states. Partial correlations were conducted on a subsample of schools ( n = 131) using the Benchmarks of Quality (BoQ) to assess self-reported implementation fidelity to examine the extent to which each coaching activity was associated with fidelity of implementation of SWPBIS. Results indicated Assisting With Team Action Planning, Assisting With Data Collection, and Sharing Knowledge of SWPBIS Systems were perceived as most important to SWPBIS sustainability. Partial correlations showed two activities were statistically significant and positively correlated with SWPBIS fidelity of implementation: Running Data Reports for the Team and Modeling SWPBIS Implementation. Implications for assessing and differentiating coaching supports delivered to schools are discussed.

scholarly journals Advances in Measurement in School-Wide Positive Behavioral Interventions and Supports

2019 ◽  
Vol 40 (1) ◽  
pp. 3-5
Author(s):  
Kent McIntosh ◽  
Kathleen Lynne Lane
Keyword(s):  
School Climate ◽  
Behavioral Interventions ◽  
Fidelity Of Implementation ◽  
Special Issue ◽  
Research Focus ◽  
Positive Behavioral Interventions ◽  
Staff Commitment ◽  
Systems Of Support

In recent years, there has been an increased research focus on developing tools to support the design, installation, and evaluation of tiered systems of support. In this special issue, we focus on research validating freely available tools to (a) measure fidelity of implementation of school-wide positive behavioral interventions and supports (SWPBIS), (b) assess staff commitment to implement SWPBIS, (c) inform development of teaching matrices, (d) examine issues of sustainability, and (e) assess school climate.

scholarly journals Factor Validation of a Fidelity of Implementation Measure for Social Behavior Systems

2017 ◽  
Vol 40 (1) ◽  
pp. 16-24
Author(s):  
Michelle M. Massar ◽  
Kent McIntosh ◽  
Sterett H. Mercer
Keyword(s):  
Behavioral Interventions ◽  
Critical Factor ◽  
Fidelity Of Implementation ◽  
Successful Implementation ◽  
Positive Behavioral Interventions ◽  
School Based ◽  
Confirmatory Factor ◽  
School Based Interventions ◽  
Behavior Systems ◽  
Core Features

Assessing fidelity of implementation of school-based interventions is a critical factor in successful implementation and sustainability. The Tiered Fidelity Inventory (TFI) was developed as a comprehensive measure of all three tiers of School-Wide Positive Behavioral Interventions and Supports (SWPBIS) and is intended to measure the extent to which the core features of SWPBIS are implemented with fidelity. The purpose of this study was to assess the extent to which the TFI can be used as one measure of all three tiers, three separate measures of individual tiers, or as a more granular level of fidelity that measures implementation on 10 subscales across the tiers. A confirmatory factor analysis was conducted to validate the factor structure of the TFI. Results indicate that the TFI is a valid measure of fidelity of implementation of SWPBIS and can be used to measure implementation by subscales, tiers, and as a comprehensive assessment of all three tiers.

Longitudinal Associations Between SWPBIS Fidelity of Implementation and Behavior and Academic Outcomes

2018 ◽  
Vol 43 (3) ◽  
pp. 357-369 ◽  
Author(s):  
Jerin Kim ◽  
Kent McIntosh ◽  
Sterett H. Mercer ◽  
Rhonda N. T. Nese
Keyword(s):  
Academic Outcomes ◽  
Behavioral Interventions ◽  
Implementation Fidelity ◽  
Discipline Referrals ◽  
Fidelity Of Implementation ◽  
Office Discipline Referrals ◽  
Positive Behavioral Interventions ◽  
School Suspensions ◽  
K 12 ◽  
And Behavior

The purpose of this study was to examine associations between implementation fidelity of school-wide positive behavioral interventions and supports (SWPBIS) and student outcomes over time. The sample included 477 K–12 schools across 10 states implementing SWPBIS for varying numbers of years and at varying levels of fidelity (but with 78% of schools at or above established fidelity criteria). Results indicate that, in general, schools showed a decline in office discipline referrals (ODRs) and out-of-school suspensions (OSSs) over 3 years. SWPBIS fidelity of implementation was positively associated with initial levels of ODRs and OSSs, and the relations between fidelity and OSSs varied based on years of SWPBIS implementation. Levels of fidelity did not predict change in ODRs or OSSs. Despite no statistically significant associations between fidelity and student academic outcomes, schools that had implemented SWPBIS for 3 years or more had higher achievement in mathematics after controlling for prior achievement.

Funding Support for School-Wide Positive Behavioral Interventions and Support Implementation and Scale-Up

2013 ◽  
Vol 25 (3) ◽  
pp. 164-174 ◽  
Author(s):  
Nicholas A. Gage ◽  
Jennifer Freeman ◽  
Robert H. Horner ◽  
George Sugai ◽  
Timothy J. Lewis ◽  
...  
Keyword(s):  
Behavioral Interventions ◽  
Large Scale ◽  
Scale Up ◽  
Effective Practices ◽  
Evidence Based ◽  
Evidence Based Practices ◽  
Positive Behavioral Interventions ◽  
Funding Sources ◽  
Implementation Effort ◽  
General Funding

The process of selecting, implementing, and scaling-up evidence-based practices is a major focus and difficult accomplishment for states. Renewed commitment to improving student outcomes has led directly to the need for effective practices implemented at scale. The funding decisions made at state, regional, and district levels remain a key to large-scale implementation of effective practices. In this article, we summarize the funding decisions of nine states that implemented School-Wide Positive Behavioral Interventions and Supports (SWPBIS) across at least 500 schools or 30% of the schools in the state. A survey about funding sources, funding levels, and funding decisions was completed by the key implementers in each state, and a follow-up interview was used to clarify and confirm initial information. The results indicate that different states used different funding approaches, but in general, funding of SWPBIS was provided predominantly through special education sources and that initial demonstrations led to larger scale implementation when state policy makers developed creative procedures for using multiple funding sources within a unified implementation effort. Implications for funding the scaling of evidence-based practices are discussed.

scholarly journals Examining the Relative Utility of PBIS Implementation Fidelity Scores in Relation to Student Outcomes

2019 ◽  
Vol 40 (1) ◽  
pp. 6-15 ◽  
Author(s):  
Elise T. Pas ◽  
Stacy R. Johnson ◽  
Katrina J. Debnam ◽  
Chris S. Hulleman ◽  
Catherine P. Bradshaw
Keyword(s):  
Roc Curve ◽  
Student Outcomes ◽  
Behavioral Interventions ◽  
Implementation Fidelity ◽  
School Level ◽  
Evaluation Tool ◽  
Cut Points ◽  
Cut Point ◽  
Positive Behavioral Interventions ◽  
Fidelity Measures

There are several widely used Positive Behavioral Interventions and Supports (PBIS) implementation fidelity measures, including the Schoolwide Evaluation Tool (SET), but there is limited empirical investigation substantiating the association between specific fidelity cut point scores and student outcomes. This article examined different SET cut points in reference to school-level outcomes across 180 elementary, middle, and high schools participating in randomized trials of PBIS. Specifically, we examined the implementation fidelity achieved in the sample, as well as within each school level (i.e., elementary, middle, and high). Using the binary complier index, we examined the association of each of three SET cut points with behavioral and academic outcomes using t tests and receiver operating characteristic (ROC) curve analyses. Although the t tests did not provide confirmation of one specific cut point, post hoc analyses suggested that the cut point may need to be tailored to school levels. There was moderate convergence between implementation on one scale (i.e., responses to behavioral violations) and academic achievement, based on ROC curve analyses for the 70% and 80% cut points. Implications for research and practice are discussed.

Sign in / Sign up

Export Citation Format

Share Document