Predictors of on-task Behaviors: Evaluating Student-level Characteristics

Objective: In this study, we examined students’ fitness, body mass index (BMI), and demographics as predictors of observed time on-task (TOT) behaviors as an indicator of behavioral inattention. Methods: We collected demographics, fitness estimates, and BMI from 2020 fourth-graders (Mean age = 8.6 (SD = 0.5); 47% girls; 49% white) from 28 schools. We measured TOT through momentary time sampling observations. Three-level linear models were conducted to determine whether characteristics predicted differences in TOT. We tested interactions between characteristics and TOT. Results: Older students exhibited greater percent of TOT (estimate = 2.34, SE = 1.02, df = 919, t = 2.30, p < .05). Additionally, boys spent less percent TOT (estimate = -3.59, SE = 1.03, df = 906, t = -3.49, p < .05). There were no differences by race/ethnicity, SES, BMI, fitness, or time of day and percent TOT. Furthermore, none of the interactions were statistically significant (p > .15). Conclusions: Girls and older students spent more TOT. These findings are of interest to educators and psychologists working on the development of research-based guidelines aimed to support elementary students’ engagement in the classroom.

Estimation of Engagement in Moderate-to-Vigorous Physical Activity from Direct Observation: A Proposal for School Physical Education

This study aimed to test an observational momentary time sampling tool to estimate in-class moderate-to-vigorous physical activity (MVPA), in terms of validity, reliability and agreement between observational momentary time sampling and accelerometry, and to develop a regression equation to estimate MVPA from observational momentary time sampling. The sample comprised 78 pupils (38 girls), mean age 14.0 ± 1.1 years. Measurements were taken in three similar Physical Education classes, on three different days. To monitor MVPA, we applied the observational momentary time sampling method. Students wore an ActiGraph GT3X+ accelerometer. Reliabilities were determined by the intraclass correlations, the agreement between methods was analyzed using the Bland–Altman method, and a multiple regression analysis was performed to estimate the equation. The observational momentary time sampling showed good reliability across time (0.59 < r < 0.72, p < 0.001). It was significantly correlated with accelerometry (r = 0.51, p < 0.001). The MVPA assessed via accelerometer could be predicted from the following equation: Y = 44.3 + 0.47⋅(MVPA observational momentary time sampling method) + 8.0⋅(sex; with 0 = girls and 1 = boys). This observational momentary time sampling method is a stable and reliable tool to estimate MVPA. A regression equation using the score of observational momentary time sampling and sex can be used to better estimate the real MVPA.

The Good Behavior Game: Evaluation of a Classroom Behavior Intervention with English Language Learners

Various reinforcement strategies have been used to manage classroom behavior, including group contingencies such as the Good Behavior Game (GBG). This study examined whether the Good Behavior Game could be effective in increasing academic engagement and decreasing verbal disruptions in a classroom of kindergarten students who are English Language Learners (ELLs). An ABAB reversal design was used to compare baseline conditions to intervention conditions where the GBG was implemented. Academic engagement was measured using momentary time sampling, and verbal disruptions were measured using partial interval recording. Visual analysis of the data demonstrated a clear functional relation, providing evidence that the GBG intervention successfully increased academic engagement and decreased verbal disruptions. Immediate changes in behavior were observed and remained consistent across conditions. A measure of social validity indicated that the intervention was easy to implement, effective, and beneficial for the students.

ART TO LIFE: THE IMPACT OF AN EXPERIENTIAL ARTS PROGRAM ON ENGAGEMENT IN PERSONS LIVING WITH DEMENTIAS

The Art to Life (ATL) program aims to improve the quality of life for persons living with dementia (PWD) through art therapy, intergenerational contact with college students, and life story preservation within an adult day service. This poster will present the results of an ongoing program evaluation to determine the effects of the intervention on PWDs’ engagement in (1) communication with others and (2) art/creative activity. A two-member analysis team independently coded ethnographic field notes utilizing operational definitions of PWDs’ observed behavior during momentary time sampling, and recording events of communication and art engagement using the modified ENGAGE measure (Hartmann et. al, 2017). Results across sessions (N=97) reveal communication engagement (M=28.30, SD=13.36) significantly exceeded art engagement (M=9.86, SD=5.56), t (96)=20.85, p=0.001). These results suggest that engagement in reminiscence via intergenerational contact is a fundamental feature in comparison to art and creative activity within the ATL program. Exploratory qualitative content analysis of ethnographic field notes by a three-member coding team identified two key themes within the communication engagements. These emergent themes included validation of personhood and reminiscence of family ties. More studies are needed to determine if the scope and reach of intergenerational interventions may be increased through the nationwide translation of the ATL program.

Empowering Teachers With Low-Intensity Strategies to Support Instruction: Implementing Across-Activity Choices During Third-Grade Reading Instruction

Students with and at-risk for academic and behavioral challenges often have low levels of academic engagement. Providing instructional choice is one way to increase engagement in the classroom. In this study, we replicated and extended previous inquiry by investigating the effects of across-activity choices offered by third-grade teachers during reading instruction to participating students with behavioral (one with internalizing and two with internalizing and externalizing patterns) and academic needs. Using a standardized professional development module, teachers learned to implement instructional choice during reading instruction while collecting direct observation data on a student’s academic engagement. Teachers implemented practices with integrity and collected momentary time sampling data for one student in their classroom with high levels of reliability. Results of a withdrawal design indicated a functional relation between the introduction of instructional choice and increases in the academic engagement for the three students. Teachers and students rated the intervention goals, procedures, and outcomes as acceptable. Limitations and future directions are presented.

Brief Report: Measurement of Young Children’s Engagement and Problem Behavior in Early Childhood Settings

Given the importance of engagement and impact of problem behavior on young children’s behavioral, social, and academic development, these two behaviors are often observed and measured in early childhood settings. The purpose of this brief report is to describe the findings from an examination of the use of multiple direct observation methods to measure engagement and problem behaviors of five children in early childhood settings across two different activity types. Findings from this study support previous research that young children’s engagement and problem behavior differ depending on the type of classroom activity. In addition, the data indicate that behavioral estimates for both engagement and problem behavior obtained using momentary time sampling produced measures of behaviors comparable with those obtained with continuous recording, whereas partial-interval recording consistently overestimated the occurrence of the behaviors compared with continuous recording. Implications of the findings and directions for future research are discussed.

A Comparison of In-Vivo and Videoconference Momentary Time Sampling Observations of On-Task Behavior

Systematic direct observation (SDO) is frequently used in schools to document student response to evidence-based interventions, determine eligibility for special education services, and provide objective data during high-stakes decisions. However, there are several limitations associated with this widely used data collection tool including a shortage of service providers available to implement it and the significant travel time required for itinerant personnel. Using videoconferencing (VC) software to aid in the implementation of SDO is an intuitive application of technology that stands to increase the feasibility and efficiency with which SDO can be utilized in research and practice. The purpose of this study was to evaluate the reliability and equivalence of the results generated from two modes of SDO, traditional in-vivo SDO and SDO conducted through VC software. The results suggest that VC SDO produces estimates of student on-task behavior that are practically equivalent (i.e., ±3%) to estimates generated through traditional SDO. Furthermore, two frequently used reliability indices indicate that VC SDO results are adequately reliable against traditional in-vivo SDO. Implications for school-based practice are discussed.

Empowering Teachers With Low-Intensity Strategies to Support Instruction: Within-Activity Choices in Third-Grade Math With Null Effects

Instructional choice is a low-intensity strategy that can improve academic engagement. In this study, we investigated the effects of within-activity choices offered during math by third-grade teachers to participating students with behavioral and academic needs. We utilized a professional development model to train teachers to implement instructional choice in the classroom while collecting direct observation data on student’s academic engagement. Teachers were able to implement practices with high levels of integrity and collect momentary time sampling data on one student with high levels of reliability. Using a withdrawal design, we found no clear functional relation between instructional choice and increases in student’s academic engagement. However, some students demonstrated an increase in level upon the introduction of the intervention. Both teachers and students rated the intervention goals, procedures, and outcomes as acceptable. Possible reasons for a lack of treatment effect on student academic engagement are discussed.