Iterative development and evaluation methods of mHealth behavior change interventions

2016 ◽  
Vol 9 ◽  
pp. 33-37 ◽  
Author(s):  
Megan A Jacobs ◽  
Amanda L Graham
Author(s):  
Madalina Sucala ◽  
Nnamdi Peter Ezeanochie ◽  
Heather Cole-Lewis ◽  
Jennifer Turgiss

Abstract The rapid expansion of technology promises to transform the behavior science field by revolutionizing the ways in which individuals can monitor and improve their health behaviors. To fully live into this promise, the behavior science field must address distinct challenges, including: building interventions that are not only scientifically sound but also engaging; using evaluation methods to precisely assess intervention components for intervention optimization; and building personalized interventions that acknowledge and adapt to the dynamic ecosystem of individual and contextual variables that impact behavior change. The purpose of this paper is to provide a framework to address these challenges by leveraging behavior science, human-centered design, and data science expertise throughout the cycle of developing and evaluating digital behavior change interventions (DBCIs). To define this framework, we reviewed current models and practices for intervention development and evaluation, as well as technology industry models for product development. The framework promotes an iterative process, aiming to maximize outcomes by incorporating faster and more frequent testing cycles into the lifecycle of a DBCI. Within the framework provided, we describe each phase, from development to evaluation, to discuss the optimal practices, necessary stakeholders, and proposed evaluation methods. The proposed framework may inform practices in both academia and industry, as well as highlight the need to offer collaborative platforms to ensure successful partnerships that can lead to more effective DBCIs that reach broad and diverse populations.


2020 ◽  
Vol 54 (12) ◽  
pp. 942-947
Author(s):  
Pol Mac Aonghusa ◽  
Susan Michie

Abstract Background Artificial Intelligence (AI) is transforming the process of scientific research. AI, coupled with availability of large datasets and increasing computational power, is accelerating progress in areas such as genetics, climate change and astronomy [NeurIPS 2019 Workshop Tackling Climate Change with Machine Learning, Vancouver, Canada; Hausen R, Robertson BE. Morpheus: A deep learning framework for the pixel-level analysis of astronomical image data. Astrophys J Suppl Ser. 2020;248:20; Dias R, Torkamani A. AI in clinical and genomic diagnostics. Genome Med. 2019;11:70.]. The application of AI in behavioral science is still in its infancy and realizing the promise of AI requires adapting current practices. Purposes By using AI to synthesize and interpret behavior change intervention evaluation report findings at a scale beyond human capability, the HBCP seeks to improve the efficiency and effectiveness of research activities. We explore challenges facing AI adoption in behavioral science through the lens of lessons learned during the Human Behaviour-Change Project (HBCP). Methods The project used an iterative cycle of development and testing of AI algorithms. Using a corpus of published research reports of randomized controlled trials of behavioral interventions, behavioral science experts annotated occurrences of interventions and outcomes. AI algorithms were trained to recognize natural language patterns associated with interventions and outcomes from the expert human annotations. Once trained, the AI algorithms were used to predict outcomes for interventions that were checked by behavioral scientists. Results Intervention reports contain many items of information needing to be extracted and these are expressed in hugely variable and idiosyncratic language used in research reports to convey information makes developing algorithms to extract all the information with near perfect accuracy impractical. However, statistical matching algorithms combined with advanced machine learning approaches created reasonably accurate outcome predictions from incomplete data. Conclusions AI holds promise for achieving the goal of predicting outcomes of behavior change interventions, based on information that is automatically extracted from intervention evaluation reports. This information can be used to train knowledge systems using machine learning and reasoning algorithms.


Author(s):  
Ana Paula Delgado Bomtempo Batalha ◽  
Isabela Coelho Ponciano ◽  
Gabriela Chaves ◽  
Diogo Carvalho Felício ◽  
Raquel Rodrigues Britto ◽  
...  

2021 ◽  
Vol 27 (1) ◽  
pp. 48-63
Author(s):  
Angela Makris ◽  
Mahmooda Khaliq ◽  
Elizabeth Perkins

Background: One in four Americans have a disability but remain an overlooked minority population at risk for health care disparities. Adults with disabilities can be high users of primary care but often face unmet needs and poor-quality care. Providers lack training, knowledge and have biased practices and behaviors toward people with disabilities (PWD); which ultimately undermines their quality of care. Focus of the Article: The aim is to identify behavior change interventions for decreasing health care disparities for people with disabilities in a healthcare setting, determine whether those interventions used key features of social marketing and identify gaps in research and practice. Research Question: To what extent has the social marketing framework been used to improve health care for PWD by influencing the behavior of health care providers in a primary health care setting? Program Design/Approach: Scoping Review. Importance to the Social Marketing Field: Social marketing has a long and robust history in health education and public health promotion, yet limited work has been done in the disabilities sector. The social marketing framework encompasses the appropriate features to aligned with the core principles of the social model of disability, which espouses that the barriers for PWD lie within society and not within the individual. Incorporating elements of the social model of disability into the social marketing framework could foster a better understanding of the separation of impairment and disability in the healthcare sector and open a new area of research for the field. Results: Four articles were found that target primary care providers. Overall, the studies aimed to increase knowledge, mostly for clinically practices and processes, not clinical behavior change. None were designed to capture if initial knowledge gains led to changes in behavior toward PWD. Recommendations: The lack of published research provides an opportunity to investigate both the applicability and efficacy of social marketing in reducing health care disparities for PWD in a primary care setting. Integrating the social model of disability into the social marketing framework may be an avenue to inform future interventions aimed to increase health equity and inclusiveness through behavior change interventions at a systems level.


2020 ◽  
Vol 34 (5) ◽  
pp. 1176-1189 ◽  
Author(s):  
Gavin McDonald ◽  
Molly Wilson ◽  
Diogo Veríssimo ◽  
Rebecca Twohey ◽  
Michaela Clemence ◽  
...  

2020 ◽  
Author(s):  
Sea Rotmann ◽  
Beth Karlin

Within the commercial sector, energy managers and building operators have a large impact over their organizations’ energy use. However, they mostly focus on technology solutions and retrofits, rather than human or corporate behaviors, and how to change them. This gap in targeted commercial sector research and behavioral interventions provides a great opportunity which is currently not being addressed. This paper presents a field research pilot where an empirical behavior change research process was applied and taught to commercial energy users in Ontario, Canada. This course served to fill an identified market gap and to improve commercial energy managers’ literacy in behavioral science theory and techniques. A needs assessment identified a clear gap in behavioral training for energy managers, and high interest in the course further proved out the market opportunity for professional training on how to design, implement and evaluate behavior change interventions. Evaluation results identified positive feedback in terms of course reaction, self-reported learning and behavioral outcomes, and tangible results when course participants returned to work to apply their learnings. Evaluation results suggest that such training fills a vital gap in the current Strategic Energy Management (SEM) landscape, and could unlock significant savings in the commercial energy sector.


Author(s):  
E Beard ◽  
F Lorencatto ◽  
B Gardner ◽  
S Michie ◽  
L Owen ◽  
...  

Abstract Background To help implement behavior change interventions (BCIs) it is important to be able to characterize their key components and determine their effectiveness. Purpose This study assessed and compared the components of BCIs in terms of intervention functions identified using the Behaviour Change Wheel Framework (BCW) and in terms of their specific behavior change techniques (BCTs) identified using the BCT TaxonomyV1, across six behavioral domains and the association of these with cost-effectiveness. Methods BCIs in 251 studies targeting smoking, diet, exercise, sexual health, alcohol and multiple health behaviors, were specified in terms of their intervention functions and their BCTs, grouped into 16 categories. Associations with cost-effectiveness measured in terms of incremental cost-effectiveness ratio (ICER) upper and lower estimates were determined using regression analysis. Results The most prevalent functions were increasing knowledge through education (72.1%) and imparting skills through training (74.9%). The most prevalent BCT groupings were shaping knowledge (86.5%), changing behavioral antecedents (53.0%), supporting self-regulation (47.7%), and providing social support (44.6%). Intervention functions associated with better cost-effectiveness were those based on training (βlow = −15044.3; p = .002), persuasion (βlow = −19384.9; p = .001; βupp = −25947.6; p < .001) and restriction (βupp = −32286.1; p = .019), and with lower cost-effectiveness were those based on environmental restructuring (β = 15023.9low; p = .033). BCT groupings associated with better cost-effectiveness were goals and planning (βlow = −8537.3; p = .019 and βupp = −12416.9; p = .037) and comparison of behavior (βlow = −13561.9, p = .047 and βupp = −30650.2; p = .006). Those associated with lower cost-effectiveness were natural consequences (βlow = 7729.4; p = .033) and reward and threat (βlow = 20106.7; p = .004). Conclusions BCIs that focused on training, persuasion and restriction may be more cost-effective, as may those that encourage goal setting and comparison of behaviors with others.


Sign in / Sign up

Export Citation Format

Share Document