The Effect of Different Types of Feedback Statements on Educators’ Use of Naturalistic Instruction

2021 ◽  
pp. 016264342110193
Author(s):  
Christan Grygas Coogle ◽  
Clarissa Bunch Wade ◽  
Jennifer R. Ottley ◽  
Laura McCorkle

We used an adapted alternating treatment single-case design to compare the effect of affirmative feedback to affirmative plus suggestive feedback on educators’ use of naturalistic instruction. Three early childhood special educators and a focus child within their preschool classrooms participated. Visual analysis of our data suggest that affirmative plus suggestive feedback produced stronger effects compared to affirmative feedback. Based on these data, faculty and professional development providers should plan to provide their educators with both affirmative and suggestive feedback to strengthen educators’ practice. Implications for practice and research are included.

2016 ◽  
Vol 36 (4) ◽  
pp. 218-229 ◽  
Author(s):  
Jennifer R. Ottley ◽  
Christan Grygas Coogle ◽  
Naomi L. Rahn ◽  
Caitlin F. Spear

The goal of this study was to build the capacity of early childhood teachers to implement evidence-based strategies. We investigated the efficacy of professional development with bug-in-ear peer coaching in improving teachers’ use of communication strategies, the teachers’ maintenance of strategies post intervention, and the social validity of the intervention. Four early childhood co-teacher dyads participated in the single-case design study. Data were analyzed through visual analysis and masked visual analysis. Results indicate that three of the four teacher dyads increased the frequency with which they used the strategies, with one dyad sustaining their use of targeted strategies post intervention. All teachers perceived that the intervention had positive effects on their children and indicated that bug-in-ear peer coaching was an acceptable form of professional development. Nonetheless, implications for research and practice are discussed to ensure that performance-based feedback is as meaningful as possible.


Author(s):  
Mattias Erhardsson ◽  
Margit Alt Murphy ◽  
Katharina S. Sunnerhagen

Abstract Background Rehabilitation is crucial for maximizing recovery after stroke. Rehabilitation activities that are fun and rewarding by themselves can be more effective than those who are not. Gamification with virtual reality (VR) exploits this principle. This single-case design study probes the potential for using commercial off-the-shelf, room-scale head-mounted virtual reality for upper extremity rehabilitation in individuals with chronic stroke, the insights of which can inform further research. Methods A heterogeneous volunteer sample of seven participants living with stroke were recruited through advertisement. A single-case design was employed with a 5-week baseline (A), followed by a 10-week intervention (B) and a 6-month follow-up. Upper extremity motor function was assessed with validated kinematic analysis of drinking task. Activity capacity was assessed with Action Research Arm Test, Box and Block Test and ABILHAND questionnaire. Assessments were done weekly and at follow-up. Playing games on a VR-system with head-mounted display (HTC Vive) was used as rehabilitation intervention. Approximately 300 games were screened and 6 tested. Visual analysis and Tau-U statistics were used to interpret the results. Results Visual analysis of trend, level shift and overlap as well as Tau-U statistics indicated improvement of Action Research Arm Test in six participants. Four of these had at least a moderate Tau-U score (0.50–0.92), in at least half of the assessed outcomes. These four participants trained a total of 361 to 935 min. Two out of four participants who were able to perform the drinking task, had the highest training dose (> 900 min) and showed also improvements in kinematics. The predominant game played was Beat Saber. No serious adverse effects related to the study were observed, one participant interrupted the intervention phase due to a fall at home. Conclusions This first study of combining commercial games, a commercial head-mounted VR, and commercial haptic hand controls, showed promising results for upper extremity rehabilitation in individuals with chronic stroke. By being affordable yet having high production values, as well as being an easily accessible off-the-shelf product, this variant of VR technology might facilitate widespread adaption. Insights garnered in this study can facilitate the execution of future studies. Trial registration The study was registered at researchweb.org (project number 262331, registered 2019-01-30, https://www.researchweb.org/is/vgr/project/262331) prior to participant enrolment.


2017 ◽  
Vol 40 (1) ◽  
pp. 87-103 ◽  
Author(s):  
Christan Grygas Coogle ◽  
Jennifer R. Ottley ◽  
Naomi L. Rahn ◽  
Sloan Storie

A multiple-probe, single-case design was used to determine the effects of bug-in-ear eCoaching on teachers’ use of two targeted naturalistic communication strategies and focus children’s responses to these strategies. Results indicated that bug-in-ear eCoaching enhanced teachers’ use of communication strategies and the appropriate responses of children with communication difficulties. Moreover, novice teachers reported that bug-in-ear eCoaching was a socially valid intervention.


2017 ◽  
Vol 19 (1) ◽  
pp. 4-17 ◽  
Author(s):  
Jennifer R. Ledford ◽  
Justin D. Lane ◽  
Katherine E. Severini

Single case designs (SCDs) allow researchers to objectively evaluate the impact of an intervention by repeatedly measuring a dependent variable across baseline and intervention conditions. Rooted in baseline logic, SCDs evaluate change over time, with each participant serving as his or her own control during the course of a study. Formative and summative evaluation of data is critical to determining causal relations. Visual analysis involves evaluation of level, trend, variability, consistency, overlap, and immediacy of effects within (baseline and intervention) and between conditions (baseline to intervention). The purpose of this paper is to highlight the process for visually analysing data collected in the context of a SCD and to provide structures and procedures for evaluating the six data characteristics of interest. A checklist with dichotomous responses (i.e., yes/no) is presented to facilitate implementation and reporting of systematic visual analysis.


2019 ◽  
pp. 174462951989538 ◽  
Author(s):  
Helen I Cannella-Malone ◽  
Scott A Dueker ◽  
Mary A Barczak ◽  
Matthew E Brock

Students with significant intellectual and developmental disabilities deserve access to instruction on academic skills in addition to functional skills. Many teachers, however, report challenges with identifying appropriate evidence-based practices to teach academics to these students. The purpose of this systematic review was to summarize and analyze literature on academic instruction for students with significant disabilities. Two hundred twenty-two articles with 225 experiments utilizing a single-case design and published between 1976 and 2018 were included in the review. Visual analysis indicated that, in most cases, interventions enabled students to make progress on targeted academic skills. The majority of studies focused on basic reading skills and included participants with moderate disabilities. Most studies used a combination of three or four evidence-based practices, with modeling, prompting, visual supports, time delay, and reinforcement being the most frequently used combination across studies.


2021 ◽  
Vol 11 (2) ◽  
pp. 76
Author(s):  
Chao-Ying Joanne Peng ◽  
Li-Ting Chen

Due to repeated observations of an outcome behavior in N-of-1 or single-case design (SCD) intervention studies, the occurrence of missing scores is inevitable in such studies. Approximately 21% of SCD articles published in five reputable journals between 2015 and 2019 exhibited evidence of missing scores. Missing rates varied by designs, with the highest rate (24%) found in multiple baseline/probe designs. Missing scores cause difficulties in data analysis. And inappropriate treatments of missing scores lead to consequences that threaten internal validity and weaken generalizability of intervention effects reported in SCD research. In this paper, we comprehensively review nine methods for treating missing SCD data: the available data method, six single imputations, and two model-based methods. The strengths, weaknesses, assumptions, and examples of these methods are summarized. The available data method and three single imputation methods are further demonstrated in assessing an intervention effect at the class and students’ levels. Assessment results are interpreted in terms of effect sizes, statistical significances, and visual analysis of data. Differences in results among the four methods are noted and discussed. The extensive review of problems caused by missing scores and possible treatments should empower researchers and practitioners to account for missing scores effectively and to support evidence-based interventions vigorously. The paper concludes with a discussion of contingencies for implementing the nine methods and practical strategies for managing missing scores in single-case intervention studies.


Author(s):  
Keith C. Radley ◽  
Evan H. Dart

As previously described, single-case design has several advantages in the evaluation of evidence-based practices and for the evaluation of the effects of interventions in applied settings. Following collection of data, data are typically graphed in order to determine the effects of an intervention on student behavior. However, recent research has determined that the manner in which graphs are constructed is likely to impact the decisions that visual analysts make regarding the effect of an intervention. As such, it is important that graphs be constructed in a manner that minimizes potential for error. This chapter describes quality indicators for graphs, and discusses analysis- and aesthetic-altering elements of graphs. In particular, the chapter describes two analysis-altering elements that must be considered when constructing graphs: scaling of the y-axis and the data points per x- to y-ratio (DPPXYR). Finally, the chapter describes how to conduct visual analysis. Six elements are discussed: changes in level, trend, and variability, consistency across similar conditions, overlap across adjacent phases, and immediacy of intervention effects.


2018 ◽  
Vol 40 (2) ◽  
pp. 97-111
Author(s):  
Ethan R. Van Norman ◽  
David A. Klingbeil ◽  
Katherine E. McLendon

Researchers and practitioners frequently use curriculum-based measures of reading (CBM-R) within single-case design (SCD) frameworks to evaluate the effects of reading interventions with individual students. Effect sizes (ESs) developed specifically for SCDs are often used as a supplement to visual analysis to gauge treatment effects. The degree to which measurement error associated with academic measures like CBM-R influences said ESs has not been fully explored. We used simulation methodology to evaluate how common magnitudes of error influenced the consistency and accuracy of outcomes from two nonparametric SCD ESs, percentage of data exceeding baseline trend and TauU. After accounting for other data characteristics, measurement error accounted for a statistically and practically significant amount of variance in the consistency and accuracy of outcomes from both ESs. This article suggests that the psychometric properties of academic measures are important to consider when interpreting ESs from SCDs.


2021 ◽  
Author(s):  
Corey Peltier ◽  
Kristi L. Morin ◽  
Kimberly Vannest ◽  
April Haas ◽  
Joshua Pulos ◽  
...  

Students identified with emotional or behavioral disorders (EBD) display deficits across academic content areas, most notably in mathematics. We reviewed research on student-mediated math interventions for students with EBD. A total of 19 studies published between 1968 and 2019 met inclusion criteria, with 24 of 32 cases meeting the What Works Clearinghouse Pilot Single-Case Design Standards (Version 4.0) with or without reservations. Participants included 51 students identified with EBD, ages 8 to 16 years old. Results from visual analysis revealed 0 cases demonstrated strong evidence, 11 cases demonstrated moderate evidence, and 21 cases demonstrated weak evidence of intervention effects. The omnibus Tau-U was 74.35% (CI95 = 64.2% to 84.4%), representing data from 17 studies including 46 students. Implications for research and practice are discussed.


Sign in / Sign up

Export Citation Format

Share Document