scholarly journals Specifying who delivers behaviour change interventions: development of an Intervention Source Ontology

2021 ◽  
Vol 6 ◽  
pp. 77
Author(s):  
Emma Norris ◽  
Alison J. Wright ◽  
Janna Hastings ◽  
Robert West ◽  
Neil Boyt ◽  
...  

Background:  Identifying how behaviour change interventions are delivered, including by whom, is key to understanding intervention effectiveness. However, information about who delivers interventions is reported inconsistently in intervention evaluations, limiting communication and knowledge accumulation. This paper reports a method for consistent reporting: The Intervention Source Ontology. This forms one part of the Behaviour Change Intervention Ontology, which aims to cover all aspects of behaviour change interventions. Methods: The Intervention Source Ontology was developed following methods for ontology development and maintenance used in the Human Behaviour-Change Project, with seven key steps: 1) define the scope of the ontology, 2) identify key entities and develop their preliminary definitions by reviewing existing classification systems (top-down) and reviewing 100 behaviour change intervention reports (bottom-up), 3) refine the ontology by piloting the preliminary ontology on 100 reports, 4) stakeholder review by 34 behavioural science and public health experts, 5) inter-rater reliability testing of annotating intervention reports using the ontology, 6) specify ontological relationships between entities and 7) disseminate and maintain the Intervention Source Ontology. Results: The Intervention Source Ontology consists of 140 entities. Key areas of the ontology include Occupational Role of Source, Relatedness between Person Source and the Target Population, Sociodemographic attributes and Expertise. Inter-rater reliability was found to be 0.60 for those familiar with the ontology and 0.59 for those unfamiliar with it, levels of agreement considered ‘acceptable’. Conclusions: Information about who delivers behaviour change interventions can be reliably specified using the Intervention Source Ontology. For human-delivered interventions, the ontology can be used to classify source characteristics in existing behaviour change reports and enable clearer specification of intervention sources in reporting.

2020 ◽  
Vol 5 ◽  
pp. 124 ◽  
Author(s):  
Emma Norris ◽  
Marta M. Marques ◽  
Ailbhe N. Finnerty ◽  
Alison J. Wright ◽  
Robert West ◽  
...  

Background: Contextual factors such as an intervention’s setting are key to understanding how interventions to change behaviour have their effects and patterns of generalisation across contexts. The intervention’s setting is not consistently reported in published reports of evaluations. Using ontologies to specify and classify intervention setting characteristics enables clear and reproducible reporting, thus aiding replication, implementation and evidence synthesis. This paper reports the development of a Setting Ontology for behaviour change interventions as part of a Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Intervention Setting Ontology was developed following methods for ontology development used in the Human Behaviour-Change Project: 1) Defining the ontology’s scope, 2) Identifying key entities by reviewing existing classification systems (top-down) and 100 published behaviour change intervention reports (bottom-up), 3) Refining the preliminary ontology by literature annotation of 100 reports, 4) Stakeholder reviewing by 23 behavioural science and public health experts to refine the ontology, 5) Assessing inter-rater reliability of using the ontology by two annotators familiar with the ontology and two annotators unfamiliar with it, 6) Specifying ontological relationships between setting entities and 7) Making the Intervention Setting Ontology machine-readable using Web Ontology Language (OWL) and publishing online. Results: The Intervention Setting Ontology consists of 72 entities structured hierarchically with two upper-level classes: Physical setting including Geographic location, Attribute of location (including Area social and economic condition, Population and resource density sub-levels) and Intervention site (including Facility, Transportation and Outdoor environment sub-levels), as well as Social setting. Inter-rater reliability was found to be 0.73 (good) for those familiar with the ontology and 0.61 (acceptable) for those unfamiliar with it. Conclusion: The Intervention Setting Ontology can be used to code information from diverse sources, annotate the setting characteristics of existing intervention evaluation reports and guide future reporting.


2018 ◽  
Author(s):  
Emma Norris ◽  
Ailbhe Noelle Finnerty ◽  
Janna Hastings ◽  
Gillian Stokes ◽  
Susan Michie

Ontologies are classification systems specifying entities, definitions and inter-relationships for a given domain, with the potential to advance knowledge about human behaviour change. A scoping review was conducted to: i) identify what ontologies exist related to human behaviour change, ii) describe the methods used to develop these ontologies and iii) assess the quality of identified ontologies. Using a systematic search, 2303 papers were identified. Fifteen ontologies met the eligibility criteria for inclusion, developed in areas such as cognition, mental disease and emotions. Methods used for developing the ontologies were expert consultation, data-driven techniques and re-use of terms from existing taxonomies, terminologies and ontologies. Best practices used in ontology development and maintenance were documented. The review did not identify any ontologies representing the breadth and detail of human behaviour change. This suggests that advancing behavioural science would benefit from the development of a behaviour change intervention ontology.


2021 ◽  
Vol 5 ◽  
pp. 125 ◽  
Author(s):  
Marta M. Marques ◽  
Rachel N. Carey ◽  
Emma Norris ◽  
Fiona Evans ◽  
Ailbhe N. Finnerty ◽  
...  

Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an ontology for specifying the mode of delivery of interventions, which forms part of the Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Mode of Delivery Ontology was developed in an iterative process of annotating behaviour change interventions evaluation reports, and consulting with expert stakeholders. It consisted of seven steps: 1) annotation of 110 intervention reports to develop a preliminary classification of modes of delivery; 2) open review from international experts (n=25); 3) second round of annotations with 55 reports to test inter-rater reliability and identify limitations; 4) second round of expert review feedback (n=16); 5) final round of testing of the refined ontology by two annotators familiar and two annotators unfamiliar with the ontology; 6) specification of ontological relationships between entities; and 7) transformation into a machine-readable format using the Web Ontology Language (OWL) and publishing online. Results: The resulting ontology is a four-level hierarchical structure comprising 65 unique modes of delivery, organised by 15 upper-level classes: Informational, Environmental change, Somatic, Somatic alteration, Individual-based/ Pair-based /Group-based, Uni-directional/Interactional, Synchronous/ Asynchronous, Push/ Pull, Gamification, Arts feature. Relationships between entities consist of is_a. Inter-rater reliability of the Mode of Delivery Ontology for annotating intervention evaluation reports was a=0.80 (very good) for those familiar with the ontology and a= 0.58 (acceptable) for those unfamiliar with it. Conclusion: The ontology can be used for both annotating and writing behaviour change intervention evaluation reports in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions.


2020 ◽  
Vol 5 ◽  
pp. 125 ◽  
Author(s):  
Marta M. Marques ◽  
Rachel N. Carey ◽  
Emma Norris ◽  
Fiona Evans ◽  
Ailbhe N. Finnerty ◽  
...  

Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an ontology for specifying the mode of delivery of interventions, which forms part of the Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Mode of Delivery Ontology was developed in an iterative process of annotating behaviour change interventions evaluation reports, and consulting with expert stakeholders. It consisted of seven steps: 1) annotation of 110 intervention reports to develop a preliminary classification of modes of delivery; 2) open review from international experts (n=25); 3) second round of annotations with 55 reports to test inter-rater reliability and identify limitations; 4) second round of expert review feedback (n=16); 5) final round of testing of the refined ontology by two annotators familiar and two annotators unfamiliar with the ontology; 6) specification of ontological relationships between entities; and 7) transformation into a machine-readable format using the Web Ontology Language (OWL) language and publishing online. Results: The resulting ontology is a four-level hierarchical structure comprising 65 unique modes of delivery, organised by 15 upper-level classes: Informational, Environmental change, Somatic, Somatic alteration, Individual-based/ Pair-based /Group-based, Uni-directional/Interactional, Synchronous/ Asynchronous, Push/ Pull, Gamification, Arts feature. Relationships between entities consist of is_a. Inter-rater reliability of the Mode of Delivery Ontology for annotating intervention evaluation reports was a=0.80 (very good) for those familiar with the ontology and a= 0.58 (acceptable) for those unfamiliar with it. Conclusion: The ontology can be used for both annotating and writing behaviour change intervention evaluation reports in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions.


2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Veena A. Satyanarayana ◽  
Cath Jackson ◽  
Kamran Siddiqi ◽  
Prabha S. Chandra ◽  
Rumana Huque ◽  
...  

Abstract Background Home exposure to secondhand smoke (SHS) is highly prevalent amongst pregnant women in low- and middle-income countries like India and Bangladesh. The literature on the efficacy of behaviour change interventions to reduce home exposure to SHS in pregnancy is scarce. Methods We employed a theory and evidence-based approach to develop an intervention using pregnant women as agents of change for their husband’s smoking behaviours at home. A systematic review of SHS behaviour change interventions led us to focus on developing a multicomponent intervention and informed selection of behaviour change techniques (BCTs) for review in a modified Delphi survey. The modified Delphi survey provided expert consensus on the most effective BCTs in reducing home exposure to SHS. Finally, a qualitative interview study provided context and detailed understanding of knowledge, attitudes and practices around SHS. This insight informed the content and delivery of the proposed intervention components. Results The final intervention consisted of four components: a report on saliva cotinine levels of the pregnant woman, a picture booklet containing information about SHS and its impact on health as well strategies to negotiate a smoke-free home, a letter from the future baby to their father encouraging him to provide a smoke-free home, and automated voice reminder and motivational messages delivered to husbands on their mobile phone. Intervention delivery was in a single face-to-face session with a research assistant who explained the cotinine report, discussed key strategies for ensuring a smoke-free environment at home and practised with pregnant women how they would share the booklet and letter with their husband and supportive family members. Conclusion A theory and evidence-based approach informed the development of a multicomponent behaviour change intervention, described here. The acceptability and feasibility of the intervention which was subsequently tested in a pilot RCT in India and Bangladesh will be published later.


2020 ◽  
Author(s):  
Emma Norris ◽  
Yiwei He ◽  
Rachel Loh ◽  
Robert West ◽  
Susan Michie

Introduction: Activities promoting research reproducibility and transparency are crucial for generating trustworthy evidence. Evaluation of smoking interventions is one area where vested interests may motivate reduced reproducibility and transparency. Aims: Assess markers of transparency and reproducibility in smoking behaviour change intervention evaluation reports.Methods: One hundred evaluation reports of smoking behaviour change intervention randomised controlled trials published in 2018-2019 were identified. Reproducibility markers of pre-registration, protocol sharing, data-, materials- and analysis script-sharing, replication of a previous study and open access publication were coded in identified reports. Transparency markers of funding and conflict of interest declarations were also coded. Coding was performed by two researchers, with inter-rater reliability calculated using Krippendorff’s alpha.Results: Seventy-one percent of reports were open access and 73% pre-registered. However, only 13% provided accessible materials, 7% accessible data and 1% accessible analysis scripts. No reports were replication studies. Ninety-four percent of reports provided a funding source statement and eighty-eight percent of reports provided a conflict of interest statement.Conclusions: Open data, materials, analysis and replications are rare in smoking behaviour change interventions, whereas funding source and conflict of interest declarations are common. Future smoking research should be more reproducible to enable knowledge accumulation.


2021 ◽  
Author(s):  
Alexander K Saeri ◽  
Peter Slattery ◽  
Morgan James Tear ◽  
Chiara Varazzani ◽  
Daniel Epstein ◽  
...  

Behaviour science has been applied for public value by more than 100 government and public purpose organisations worldwide. Much of this work has focused on evidence production through rigorous research design and theories of behaviour change.However, successfully tested interventions are not always scaled up to an entire population of interest, a new setting, or adapted to new target behaviours. Scaling up effective behaviour change interventions is often the true goal and often represents a challenge for government and research end-users working in behavioural science. We conducted a systematic search for an overview of reviews of scholarly evidence on scale up, and 11 practice interviews with behaviour science researchers and practitioners to identify the factors and activities that influence the scale up of behaviour change interventions. This work is aimed not only at uncovering the effectiveness of these activities but also at increasing the reach and impact of behaviour change interventions at scale.


2020 ◽  
Vol 5 ◽  
pp. 126 ◽  
Author(s):  
Alison J. Wright ◽  
Emma Norris ◽  
Ailbhe N. Finnerty ◽  
Marta M. Marques ◽  
Marie Johnston ◽  
...  

Background: Behaviour and behaviour change are integral to many aspects of wellbeing and sustainability. However, reporting behaviour change interventions accurately and synthesising evidence about effective interventions is hindered by lacking a shared, scientific terminology to describe intervention characteristics. Ontologies are knowledge structures that provide controlled vocabularies to help unify and connect scientific fields. To date, there is no published guidance on the specific methods required to develop ontologies relevant to behaviour change. We report the creation and refinement of a method for developing ontologies that make up the Behaviour Change Intervention Ontology (BCIO). Aims: (1) To describe the development method of the BCIO and explain its rationale; (2) To provide guidance on implementing the activities within the development method. Method and results: The method for developing ontologies relevant to behaviour change interventions was constructed by considering principles of good practice in ontology development and identifying key activities required to follow those principles. The method’s details were refined through application to developing two ontologies. The resulting ontology development method involved: (1) defining the ontology’s scope; (2) identifying key entities; (3) refining the ontology through an iterative process of literature annotation, discussion and revision; (4) expert stakeholder review; (5) testing inter-rater reliability; (6) specifying relationships between entities, and; (7) disseminating and maintaining the ontology. Guidance is provided for conducting relevant activities for each step.  Conclusions: We have developed a detailed method for creating ontologies relevant to behaviour change interventions, together with practical guidance for each step, reflecting principles of good practice in ontology development. The most novel aspects of the method are the use of formal mechanisms for literature annotation and expert stakeholder review to develop and improve the ontology content. We suggest the mnemonic SELAR3, representing the method’s first six steps as Scope, Entities, Literature Annotation, Review, Reliability, Relationships.


2021 ◽  
Vol 10 (3) ◽  
pp. 55-61
Author(s):  
Jessica Holloway

Regular dental attendance is a key oral health behaviour. Behaviour change interventions are increasingly being used to promote positive oral health behaviours. A systematic approach to understanding behaviour has led to the development of frameworks which aim to guide the process of designing behaviour change interventions. One such framework is the Behaviour Change Wheel (BCW). This article aims to explore and identify barriers to regular dental attendance which may be targeted using behaviour change interventions based on the Capability, Opportunity and Motivation Behaviour model (COM-B) and the BCW, and suggests potential behaviour change techniques which could be utilised into a behaviour change intervention with the aim to promote regular dental attendance.


Sign in / Sign up

Export Citation Format

Share Document