A systematic review of observational methods used to quantify personal protective behaviours among members of the public during the COVID-19 pandemic, and the concordance between observational and self-report measures in infectious disease health protection

Objectives: To assess the quantity and quality of studies using an observational measure of behaviour during the COVID-19 pandemic, and to narratively describe the association between self-report and observational data for behaviours relevant to controlling an infectious disease outbreak. Design: Systematic review and narrative synthesis of observational studies. Data sources: We searched Medline, Embase, PsychInfo, Publons, Scopus and the Public Health England behavioural science LitRep database from inception to 17th September 2021 for relevant studies. Study selection: We included studies which collected observational data of at least one of three health protective behaviours (hand hygiene, face covering use and maintaining physical distance from others (social distancing) during the COVID-19 pandemic. Studies where observational data were compared to self-report data in relation to any infectious disease were also included. Data extraction and synthesis: We evaluated the quality of studies using the NIH quality assessment scale for observational studies, extracted data on sample size, setting and adherence to health protective behaviours, and synthesized results narratively. Results: Of 27,279 published papers on COVID-19 relevant health protective behaviours that included one or more terms relating to hand hygiene, face covering and social distancing, we identified 48 studies that included an objective observational measure. Of these, 35 assessed face covering use, 17 assessed hand hygiene behaviour and seven assessed physical distancing. The general quality of these studies was good. When expanding the search to all infectious diseases, we included 21 studies that compared observational versus self-report data. These almost exclusively studied hand hygiene. The difference in outcomes was striking, with self-report over-estimating observed adherence by up to a factor of five in some settings. In only four papers did self-report match observational data in any domains. Conclusions: Despite their importance in controlling the pandemic, we found remarkably few studies assessing protective behaviours by observation, rather than self-report, though these studies tended to be of reasonably good quality. Observed adherence tends to be substantially lower than estimates obtained via self-report. Accurate assessment of levels of personal protective behaviour, and evaluation of interventions to increase this, would benefit from the use of observational methods.

Development of the Video Analysis Scale of Engagement (VASE) for people with advanced dementia

Background: The current study sought to develop a valid, reliable and unobtrusive tablet computer-based observational measure to assess engagement of people with advanced dementia. The Video Analysis Scale of Engagement (VASE) was designed to enable the rating of moment-by-moment changes in engagement during an activity, which would be useful for both future research and current residential care. Methods: An initial version of the VASE was tested. Face validity and content validity were assessed to validate an operational definition of engagement and develop an acceptable protocol for the scale. Thirty-seven non-professional and professional volunteers were recruited to view and rate level of engagement in music activities using the VASE. Results: An inter-class coefficient (ICC) test gave a high level of rating agreement across professionals and non-professionals. However, the ICC results of within-professionals were mixed. Linear mixed modelling suggested that the types of interventions (active or passive music listening), the particular intervention session being rated, time period of video and the age of raters could affect the ratings. Conclusions: Results suggested that raters used the VASE in a dynamic fashion and that the measure was able to distinguish between interventions. Further investigation and adjustments are warranted for this to be considered a valid and reliable scale in the measurement of engagement of people with advanced dementia in a residential care setting.

Development of the Video Analysis Scale of Engagement (VASE) for people with advanced dementia

Background: The current study sought to develop a valid, reliable and unobtrusive tablet computer-based observational measure to assess engagement of people with advanced dementia. The Video Analysis Scale of Engagement (VASE) was designed to enable the rating of moment-by-moment changes in engagement during an activity, which would be useful for both future research and current residential care. Methods: An initial version of the VASE was tested. Face validity and content validity were assessed to validate an operational definition of engagement and develop an acceptable protocol for the scale. Thirty-seven non-professional and professional volunteers were recruited to view and rate level of engagement in music activities using the VASE. Results: An inter-class coefficient (ICC) test gave a high level of rating agreement across professionals and non-professionals. However, the ICC results of within-professionals were mixed. Linear mixed modelling suggested that the types of interventions (active or passive music listening), the particular intervention session being rated, time period of video and the age of raters could affect the ratings. Conclusions: Results suggested that raters used the VASE in a dynamic fashion and that the measure was able to distinguish between interventions. Further investigation and adjustments are warranted for this to be considered a valid and reliable scale in the measurement of engagement of people with advanced dementia in a residential care setting.

Sensory Responsiveness Is Linked With Communication in Infant Siblings of Children With and Without Autism

Purpose Differences in communication development impact long-term outcomes of children with autism. Previous research has identified factors associated with communication in children with autism, but much of the variance in communication skill remains unexplained. It has been proposed that early differences in sensory responsiveness (i.e., hyporesponsiveness, hyperresponsiveness, and sensory seeking) may produce “cascading effects” on communication. Evidence for this theory is limited, however, as relations between sensory responsiveness and communication in the earliest stages of development have not been well established. The purpose of this study was to evaluate (a) whether infants with a heightened likelihood of autism diagnosis (i.e., infants with an older sibling with autism) differ from infants at general population–level likelihood of autism (i.e., infants with an older, nonautistic sibling) on patterns of sensory responsiveness, (b) whether early sensory responsiveness is correlated with concurrent communication, and (c) whether the aforementioned between-groups differences and associations are moderated by age. Method Participants were 40 infants (20 infants with an older sibling with autism, 20 infants with an older, nonautistic sibling) aged 12–18 months. A series of observational and parent report measures of sensory responsiveness and communication skill were administered. Results Group differences in sensory responsiveness across the 12- to 18-month period were limited (i.e., only observed for one measure of hyporesponsiveness), though selected differences in sensory responsiveness (i.e., parent-reported hyperresponsiveness and sensory seeking) emerged between groups over this developmental window. Parent-reported hyporesponsiveness was unconditionally, negatively associated with communication skills. Associations between expressive communication and (a) parent-reported sensory seeking and (b) an observational measure of hyperresponsiveness were moderated by age. Conclusions This study provides new insights into the nature of sensory responsiveness and theorized links with communication skill in infants at elevated and general population–level likelihood of autism diagnosis. Further work is needed to better characterize the effects of interest in a larger sample spanning a wider age range. Supplemental Material https://doi.org/10.23641/asha.14515542

Behavioral Inhibition in Childhood: European Portuguese Adaptation of an Observational Measure (Lab-TAB)

The assessment of behaviorally inhibited children is typically based on parent or teacher reports, but this approach has received criticisms, mainly for being prone to bias. Several researchers proposed the additional use of observational methods because they provide a direct and more objective description of the child's functioning in different contexts. The lack of a laboratory assessment of temperament for Portuguese children justifies the adaptation of some episodes of the Laboratory Temperament Assessment Battery (Lab-TAB) as an observational measure for behavioral inhibition. Method: In our study, we included 124 children aged between 3 and 9 years and their parents. The evaluation of child behavioral inhibition was made by parent report (Behavioral Inhibition Questionnaire) and through Lab-TAB episodes. Parental variables with potential influence on parents’ reports were also collected using the Social Interaction and Performance Anxiety and Avoidance Scale (SIPAAS) and the Parental Overprotection Measure (POM). Results and Discussion: The psychometric analyses provided evidence that Lab-TAB is a reliable instrument and can be incorporated in a multi-method approach to assess behavioral inhibition in studies involving Portuguese-speaking children. Moderate convergence between observational and parent report measures of behavioral inhibition was obtained. Mothers’ characteristics, as well as child age, seem to significantly affect differences between measures, being potential sources of bias in the assessment of child temperament.

Virtual Reality or Augmented Reality as a Tool for Studying Bystander Behaviors in Interpersonal Violence: Scoping Review

Background To provide participants with a more real and immersive intervening experience, virtual reality (VR) and/or augmented reality (AR) technologies have been integrated into some bystander intervention training programs and studies measuring bystander behaviors. Objective We focused on whether VR or AR can be used as a tool to enhance training bystanders. We reviewed the evidence from empirical studies that used VR and/or AR as a tool for examining bystander behaviors in the domain of interpersonal violence research. Methods Two librarians searched for articles in databases, including APA PsycInfo (Ovid), Criminal Justice Abstracts (EBSCO), Medline (Ovid), Applied Social Sciences Index & Abstracts (ProQuest), Sociological Abstracts (ProQuest), and Scopus till April 15, 2020. Studies focusing on bystander behaviors in conflict situations were included. All study types (except reviews) written in English in any discipline were included. Results The search resulted in 12,972 articles from six databases, and the articles were imported into Covidence. Eleven studies met the inclusion and exclusion criteria. All 11 articles examined the use of VR as a tool for studying bystander behaviors. Most of the studies were conducted in US young adults. The types of interpersonal violence were school bullying, dating violence, sexual violence/assault, and soccer-associated violence. VR technology was used as an observational measure and bystander intervention program. We evaluated the different uses of VR for bystander behaviors and noted a lack of empirical evidence for AR as a tool. We also discuss the empirical evidence regarding the design, effectiveness, and limitations of implementing VR as a tool in the reviewed studies. Conclusions The reviewed results have implications and recommendations for future research in designing and implementing VR/AR technology in the area of interpersonal violence. Future studies in this area may further contribute to the use of VR as an observational measure and explore the potential use of AR to study bystander behaviors.

Protocol for the Adaptation of a Direct Observational Measure of Parent-Child Interaction for Use With 7–8-Year-Old Children

ObjectiveParenting sensitivity and mutual parent-child attunement are key features of environments that support children’s learning and development. To-date, observational measures of these constructs have focused on children aged 2–6 years and are less relevant to the more sophisticated developmental skills of children aged 7–8 years, despite parenting being equally important at these ages. We undertook a rigorous process to adapt an existing observational measure for 7–8-year-old children and their parents. This paper aimed to: (i) describe a protocol for adapting an existing framework for rating parent-child interactions, (ii) determine variations in parents’ sensitive responding and parent-child mutual attunement (‘positive mutuality’) by family demographics, and (iii) evaluate the psychometric properties of the newly developed measure (i.e., inter-rater reliability, construct validity).MethodParent-child dyads completed one home visit, including a free-play observation and parent questionnaire. Dyads were provided with three toy sets: LEGO® Classic Box, Classic Jenga®, and animal cards. The Coding of Attachment-Related Parenting (CARP) was adapted for use with 7–8-year-old children, and rating procedures were streamlined for reliable use by non-clinician/student raters, producing the SCARP:7–8 Years. Trained staff rated video-recorded observations on 11 behaviors across two domains (five for parents’ sensitive responding, six for parent-child positive mutuality).ResultsData were available for 596 dyads. Consistently strong inter-rater agreement on the 11 observed behaviors was achieved across the 10-week rating period (average: 87.6%, range: 71.7% to 96.7%). Average ICCs were 0.77 for sensitive responding and 0.84 for positive mutuality. These domains were found to be related but distinct constructs (r = 0.49, p < 0.001). For both domains, average ratings were strongly associated with the main toy used during the observation (p < 0.001, highest: cards, lowest: LEGO®). Adjusted multivariate linear regression models (accounting for toy choice) revealed that less sensitive responding was associated with younger parent (p = 0.04), male parent (p = 0.03), non-English speaking background (p = 0.04), and greater neighborhood disadvantage (p = 0.02). Construct validity was demonstrated using six parent-reported psychosocial and parenting measures.ConclusionThe SCARP: 7–8 Years shows promise as a reliable and valid measure of parent-child interaction in the early school years. Toy selection for direct observation should be considered carefully in research and practice settings.

Virtual reality or augmented reality as a tool for studying bystander behaviors in interpersonal violence: a scoping review (Preprint)

BACKGROUND To provide participants with a more real and immersive intervening experience, virtual reality, and/or augmented reality technologies have been integrated into some bystander intervention training programs and studies measuring bystander behaviors. OBJECTIVE The study focuses on whether virtual reality and/or augmented reality can be used as a tool to enhance training bystanders. We review the evidence from empirical studies that use virtual reality (VR) and/or augmented reality (AR) as a tool for examining bystander behaviors in the domain of interpersonal violence research. METHODS Two librarians searched for articles in databases, including APA PsycInfo (Ovid), Criminal Justice Abstracts (EBSCO), Medline (Ovid), Applied Social Sciences Index & Abstracts (ProQuest), Sociological Abstracts (ProQuest), and Scopus till April 15, 2020. Studies focusing on bystander behaviors in conflict situations were included. All study types (except reviews) written in English in any disciplines were included. RESULTS The search resulted in 12,972 articles from six databases, and the articles were imported into Covidence. Eleven studies met the inclusion and exclusion criteria. All 11 articles examined the use of VR as a tool for studying bystander behaviors. Most of the studies were conducted in US young adults. Types of interpersonal violence were school bullying, dating violence, sexual violence/assault, and soccer-associated violence. Virtual reality technology was used as an observational measure and bystander intervention program. We evaluate the different use of VR for bystander behaviors and a lack of empirical evidence of AR as a tool. We also discuss the empirical evidence regarding the design, effectiveness, and limitations of implementing VR as a tool in the reviewed studies. CONCLUSIONS Reviewed results have implications and recommendations for future research in designing and implementing VR/AR technology in the area. Future studies in this area may further contribute to the use of VR as an observational measure and explore the potential use of AR for the study of bystander behaviors.

Development of the Video Analysis Scale of Engagement (VASE) for people with advanced dementia

Background: The current study sought to develop a valid, reliable and unobtrusive tablet computer-based observational measure to assess engagement of people with advanced dementia. The Video Analysis Scale of Engagement (VASE) was designed to enable the rating of moment-by-moment changes in engagement during an activity, which would be useful for both future research and current residential care. Methods: An initial version of the VASE was tested. Face validity and content validity were assessed to validate an operational definition of engagement and develop an acceptable protocol for the scale. Thirty-seven non-professional and professional volunteers were recruited to view and rate level of engagement in music activities using the VASE. Results: An inter-class coefficient (ICC) test gave a high level of rating agreement across professionals and non-professionals. However, the ICC results of within-professionals were mixed. Linear mixed modelling suggested that the types of interventions (active or passive music listening), the particular intervention session being rated, time period of video and the age of raters could affect the ratings. Conclusions: Results suggested that raters used the VASE in a dynamic fashion and that the measure was able to distinguish between interventions. Further investigation and adjustments are warranted for this to be considered a valid and reliable scale in the measurement of engagement of people with advanced dementia in a residential care setting.