Navigating through digital health outcome evaluation methodologies: an algorithm based on a scoping review and emerging methodologies. (Preprint)

2019 ◽  
Author(s):  
Caroline Perrin ◽  
Mirana Randriambelonoro ◽  
Antoine Geissbuhler
Keyword(s):  
Health Outcome ◽  
Health Outcomes ◽  
Scoping Review ◽  
Digital Health ◽  
Database Search ◽  
Outcome Evaluation ◽  
Health Interventions ◽  
Cochrane Central Register ◽  
Design Features ◽  
The Impact

BACKGROUND Digital health interventions are recognized for their potential and are increasingly implemented globally. The evidence base is growing, but currently there are still relatively few studies evaluating improvements of digital health interventions in health outcomes OBJECTIVE The objectives of this article were to understand, analyze and map how researchers approach digital health outcome evaluations in different settings through a scoping review and to develop an algorithm, based on these results, to provide a pedagogical overview of methods for evaluating health outcomes of digital health interventions. METHODS For the scoping review PubMed, EMBASE, and the Cochrane Central Register of Controlled Trials (CENTRAL) were scanned using a predefined search strategy to identify articles measuring the impact of digital health interventions on health outcomes. The algorithm was developed based on analysis and insights from the scoping review. RESULTS The database search retrieved 3584 citations of which 208 were included. These articles were reviewed in detail and were classified into different categories: level of income (of the country where the study was conducted), system categories, disease addressed by the intervention, and evaluation method. The gap analysis identified additional emerging approaches that were included in the algorithm. CONCLUSIONS Through analysis of the literature, we were able to demonstrate that digital health outcome studies rely on traditional clinical evaluation designs, even though these interventions are often more complex and depended on the context, culture, and the individual than classical interventions like insulin on its receptor. In addition to the methodologies extracted from studies through the database search we identified study methodologies through desk research, whose design features address some of the shortcomings of traditional clinical methodologies, when applying them to digital health interventions. We integrated all identified methodologies into an algorithm that provides a high-level overview, enables the user to navigate through these methodologies based on the design features and investigator’s priorities, and to facilitate the identification of one or more potential appropriate methodologies.

scholarly journals Social Cognitive Theories and Electronic Health Design: Scoping Review (Preprint)

2018 ◽  
Author(s):  
Patricia Grace-Farfaglia
Keyword(s):  
Scoping Review ◽  
Social Cognitive ◽  
Digital Health ◽  
Health Intervention ◽  
Health Interventions ◽  
Design Features ◽  
Social Design ◽  
Web Based ◽  
Cognitive Theories ◽  
Social Cognitive Theories

BACKGROUND There are several social cognitive theories (SCTs) and models that support platform design in electronic health (eHealth) promotion trials. The rationale for this scoping review was to determine how social design features (informational aid, expressive support, gaming, and tailored content) are used to promote self-efficacy, engagement, knowledge, and behavior change. OBJECTIVE This study aimed to review a broad spectrum of digital health interventions in the literature seeking trials that use SCTs for the design of eHealth applications. METHODS The author conducted a systematic scoping review of 161 Web-based health interventions from published randomized clinical trials using 1 or more tools to address the social cognitive determinants in their website design from January 2006 to April 2016. An iterative approach was used in the selection of studies and data extraction. The studies were analyzed for quality and coded for type of social design features employed. RESULTS Expressive interaction tools were found in 48.6% (54/111) of studies categorized as a strong recommendation by the Joanna Briggs Institute criteria. Overall, less than half of the studies addressed participant social support and motivational needs (43.8%). The vast majority of studies (100%) relied on the use of the Web for delivery of informational aid and tailored content for the individual participant (75.9%). CONCLUSIONS This review fills a research gap by linking social theory to Web strategy to improve the impact and sustainability of eHealth interventions. A Digital Health Intervention Model was developed to provide a framework to enhance future Web-based health intervention design and execution.

scholarly journals The impact of digital health interventions on health-related outcomes in the workplace: A systematic review

2018 ◽  
Vol 4 ◽  
pp. 205520761877086 ◽  
Author(s):  
Ana Howarth ◽  
Jose Quesada ◽  
Jessica Silva ◽  
Stephanie Judycki ◽  
Peter R Mills
Keyword(s):  
Systematic Review ◽  
Health Outcomes ◽  
Positive Impact ◽  
Digital Health ◽  
Controlled Trial ◽  
Health Interventions ◽  
Activity Levels ◽  
Standardized Measures ◽  
Health Related ◽  
The Impact

Background The impact of employee health on productivity in the workplace is generally evidenced through absenteeism and presenteeism. Multicomponent worksite health programmes, with significant online elements, have gained in popularity over the last two decades, due in part to their scalability and low cost of implementation. However, little is known about the impact of digital-only interventions on health-related outcomes in employee groups. The aim of this systematic review was to assess the impact of pure digital health interventions in the workplace on health-related outcomes. Methods Multiple databases, including MEDLINE, EMBASE, PubMed and PsycINFO, were used to review the literature using PRISMA guidelines. Results Of 1345 records screened, 22 randomized controlled trial studies were found to be eligible. Although there was a high level of heterogeneity across these studies, significant improvements were found for a broad range of outcomes such as sleep, mental health, sedentary behaviours and physical activity levels. Standardized measures were not always used to quantify intervention impact. All but one study resulted in at least one significantly improved health-related outcome, but attrition rates ranged widely, suggesting sustaining engagement was an issue. Risk of bias assessment was low for one-third of the studies and unclear for the remaining ones. Conclusions This review found modest evidence that digital-only interventions have a positive impact on health-related outcomes in the workplace. High heterogeneity impacted the ability to confirm what interventions might work best for which health outcomes, although less complex health outcomes appeared to be more likely to be impacted. A focus on engagement along with the use of standardized measures and reporting of active intervention components would be helpful in future evaluations.

scholarly journals Pediatric Health Outcome Evaluation in Low-and Middle-Income Countries: A Scoping Review of NGO Practice

2021 ◽  
Vol 8 ◽  
pp. 2333794X2199101
Author(s):  
Jennifer Taylor ◽  
Paula Forgeron ◽  
Amanda Vandyk ◽  
Allen Finley ◽  
Sophie Lightfoot
Keyword(s):  
Health Outcome ◽  
Health Outcomes ◽  
Scoping Review ◽  
Outcome Evaluation ◽  
Middle Income ◽  
Pediatric Health ◽  
Middle Income Countries ◽  
Governmental Organizations ◽  
Non Governmental Organizations ◽  
Low And Middle Income

Objective. The purpose of this study was to explore the research on the delivery and evaluation of pediatric health services by non-governmental organizations in low-and middle-income countries to better understand how they contribute to positive and sustainable health outcomes. Methods. A scoping review was completed using a 2-step study selection procedure. Results. Of the 5742 studies, 17 met criteria, including quantitative and mixed method designs, representing 10 different non-governmental organizations with programs in 33 low-and middle-income countries. Health outcomes were reported 89 times across the studies. A total of 56 different outcomes were identified in total, of which 24 were positive, 27 were negative, and 5 were unchanged. Conclusions. Widespread variation between non-governmental organizations exist, however, comprehensive pediatric health outcome evaluation is growing. Further emphasis should be given to adolescent specific research and robust measurement of quality of life.

scholarly journals Exploring digital health interventions to support community health workers in low-and-middle-income countries during the COVID-19 pandemic: a scoping review protocol

BMJ Open ◽  
2021 ◽  
Vol 11 (9) ◽  
pp. e053871
Author(s):  
Anam Shahil Feroz ◽  
Komal Valliani ◽  
Hajra Khwaja ◽  
Sehrish Karim
Keyword(s):  
Community Health ◽  
Community Health Workers ◽  
Scoping Review ◽  
Health Workers ◽  
Digital Health ◽  
Healthcare Services ◽  
Health Interventions ◽  
Cochrane Central Register ◽  
Middle Income ◽  
Middle Income Countries

IntroductionCOVID-19 has significantly affected community health workers’ (CHWs) performance as they are expected to perform pandemic-related tasks along with routine essential healthcare services. A plausible way to optimise CHWs’ functioning during this pandemic is to couple the efforts of CHWs with digital tools. So far, no systematic evidence is available on the use of digital health interventions to support CHWs in low-middle-income countries (LMICs) amid the COVID-19 pandemic. The article describes a protocol for a scoping review of primary research studies that aim to map evidence on the use of unique digital health interventions to support CHWs during COVID-19 in LMICs.Methods and analysisOur methodology has been adapted from scoping review guidelines provided by Arksey and O’Malley, Levac et al. and the Joanna Briggs Institute. Our search strategy has been developed for the following four main electronic databases: Excerpta Medica Database, Medical Literature Analysis and Retrieval System Online, Cochrane Central Register of Controlled Trials and Cumulated Index to Nursing and Allied Health Literature. Google Scholar and reference tracking will be used for supplementary searches. Each article will be screened against eligibility criteria by two independent researchers at the title and abstract and full-text level. The review will include studies that targeted digital health interventions at CHWs’ level to provide support in delivering COVID-19-related and other essential healthcare services. A date limit of 31 December 2019 to the present date will be placed on the search and English language articles will be included.Ethics and disseminationFormal ethical approval is not required, as primary data will not be collected in this study. The results from our scoping review will provide valuable insight into the use of digital health interventions to optimise CHWs’ functioning and will reveal current knowledge gaps in research. The results will be disseminated through journal publications and conference presentations.

The impact of Active Labour Market Policies on health outcomes: a Scoping review

2019 ◽  
Author(s):  
Vanessa Puig-Barrachina ◽  
Pol Giró ◽  
Lucía Artazcoz ◽  
Xavier Bartoll ◽  
Imma Cortés-Franch ◽  
...  
Keyword(s):  
Health Outcomes ◽  
Labour Market ◽  
Scoping Review ◽  
Labour Market Policies ◽  
Active Labour Market Policies ◽  
Active Labour ◽  
The Impact

scholarly journals Interventions directed at men for preventing intimate partner violence: a systematic review protocol

2021 ◽  
Vol 10 (1) ◽  
Author(s):  
Dina Idriss-Wheeler ◽  
Julia Hajjar ◽  
Sanni Yaya
Keyword(s):  
Systematic Review ◽  
Intimate Partner Violence ◽  
Health Outcomes ◽  
Partner Violence ◽  
Intimate Partner ◽  
Cochrane Central Register ◽  
Female Partners ◽  
Key Characteristics ◽  
Unpublished Manuscripts ◽  
The Impact

Abstract Background Intimate partner violence (IPV) is a population health problem linked to a myriad of negative psychological, physical, emotional, sexual and reproductive health outcomes for women. The movement towards working with boys and men over the past couple of decades has increased the number of interventions specifically directed at men who perpetrate violence against a female partner. There is little evidence-based research on key characteristics of effective interventions directed at men to reduce or prevent IPV against female partners. The objective of this systematic review is to identify interventions specifically directed at males , as the perpetrators of violence against women, that have proven to be effective in preventing or reducing intimate partner violence. Methods The following electronic databases will be used to search for peer-reviewed studies: MEDLINE (OVID), Embase (OVID), PsycInfo (OVID), CINAHL (EBSCO), Global Health (EBSCO), Gender Watch (ProQuest), Web of Science (Web of Knowledge), PROSPERO, Cochrane Central Register of Controlled Trials Database (Ovid) and SCOPUS. We will include randomized control trials, non-randomized studies of interventions published in peer-reviewed journals and relevant unpublished manuscripts, books/chapters and clinical or programme study reports. Studies have to demonstrate direction of effect (i.e. pre-post intervention/difference between groups) in terms of prevention or reduction in the outlined outcomes. Primary outcomes include change in behaviour and knowledge of male perpetrator regarding the impact of IPV on women as well as women’s experience of IPV. Secondary outcomes include change in behaviours around substance use and social activities, decrease in negative mental health outcomes and interactions with law enforcement. Studies will be screened, appraised and extracted by two reviewers; any conflicts will be resolved through discussion. Narrative synthesis will be used to analyse and present findings. If sufficient and comparable data is available, a meta-analysis will be conducted. Discussion This review will provide synthesized evidence on interventions directed at males to reduce or prevent their perpetration of intimate partner violence against female partners. Implications for practice will include key characteristics of interventions proven to be effective based on evidence synthesis and certainty of findings. Recommendations for further research will also be considered. Systematic review registration This protocol was submitted for registration in the International Prospective Register of Systematic Reviews (PROSPERO) on September 4, 2020.

Psychosocial Interventions Situated Within the Natural Environment with Young People Who Have Experienced Trauma: A Scoping Review

2020 ◽  
Author(s):  
Jennifer Boddy ◽  
Maddy Slattery ◽  
Jianqiang Liang ◽  
Hilary Gallagher ◽  
Amanda Smith ◽  
...  
Keyword(s):  
Mental Health ◽  
Young People ◽  
Scoping Review ◽  
Natural Environment ◽  
Psychosocial Interventions ◽  
Database Search ◽  
Inclusion Criteria ◽  
Clinical Change ◽  
Social Work Interventions ◽  
The Impact

Abstract The natural environment is increasingly used in therapeutic psychosocial interventions for young people who have experienced trauma. However, as the research in this area has yet to be synthesised, very little is known about the types and outcomes of interventions. This prevents the optimisation of social work interventions in outdoor settings. Consequently, a scoping review of peer-reviewed research published from 2008 to 2018 was undertaken to examine how nature is being used in psychosocial interventions with young people aged ten to twenty-four years who have experienced trauma and the impact of these interventions on young people’s mental health. The database search identified 5,425 records; however, only ten papers met the inclusion criteria. These papers suggested that positive changes across a range of mental health outcomes for young people were achieved in psychosocial interventions which were situated in, or made use of the natural environment, although it is unclear whether the environment influenced the outcomes. The scoping review also highlighted the need for conducting further research that examines how environmental factors contribute to clinical change for young people who have experienced trauma.

scholarly journals Co-creating a large-scale adolescent health survey integrated with access to digital health interventions

2020 ◽  
Author(s):  
Roshini Peiris-John ◽  
Lovely Dizon ◽  
Kylie Sutcliffe ◽  
Kristy Kang ◽  
Theresa Fleming
Keyword(s):  
Adolescent Health ◽  
Health Survey ◽  
Large Scale ◽  
Service Providers ◽  
Digital Health ◽  
Health Interventions ◽  
Future Research ◽  
Health Providers ◽  
Health And Wellbeing ◽  
The Impact

Aim This paper describes how we engaged with adolescents and health providers to integrate access to digital health interventions as part of a large-scale secondary school health and wellbeing survey in New Zealand. Methods We conducted nine participatory, iterative co-design sessions involving 29 adolescents, and two workshops with young people (n = 11), digital and health service providers (n = 11) and researchers (n = 9) to gain insights into end-user perspectives on the concept and how best to integrate digital interventions in to the survey. Results Students’ perceived integrating access to digital health interventions into a large-scale youth health survey as acceptable and highly beneficial. They did not want personalized/normative feedback, but thought that every student should be offered all the help options. Participants identified key principles: assurance of confidentiality, usability, participant choice and control, and language. They highlighted wording as important for ease and comfort, and emphasised the importance of user control. Participants expressed that it would be useful and acceptable for survey respondents to receive information about digital help options addressing a range of health and wellbeing topics. Conclusion The methodology of adolescent-practitioner-researcher collaboration and partnership was central to this research and provided useful insights for the development and delivery of adolescent health surveys integrated with digital help options. The results from the ongoing study will provide useful data on the impact of digital health interventions integrated in large-scale surveys, as a novel methodology. Future research on engaging with adolescents once interventions are delivered will be useful to explore benefits over time.

Development of the Key Performance Indicators for Digital Health Interventions: A Scoping Review (Preprint)

2021 ◽  
Author(s):  
Maria Brenner ◽  
Arielle Weir ◽  
Margaret McCann ◽  
Carmel Doyle ◽  
Mary Hughes ◽  
...  
Keyword(s):  
Scoping Review ◽  
Performance Indicators ◽  
Delphi Study ◽  
Current Knowledge ◽  
Digital Health ◽  
Stakeholder Involvement ◽  
Key Performance Indicators ◽  
Healthcare Services ◽  
Health Interventions ◽  
Original Research

BACKGROUND Development of the Key Performance Indicators for Digital Health Interventions: A Scoping Review OBJECTIVE Digital health interventions (DHIs) offer new methods for delivering healthcare, with the potential to innovate healthcare services. Key performance indicators (KPIs) play a role in evaluation, measurement, and improvement in healthcare quality and service performance. The scoping review question was developed following an initial search to identify literature to assist in the development of KPIs for an ongoing DHI initiative. During the initial search, it became clear that there was limited literature on how to develop specific and measurable KPIs that evaluate DHIs. The aim of this scoping review was to identify current knowledge and evidence surrounding the development of KPIs for DHIs. METHODS A rigorous literature search was conducted across ten key databases: AMED - The Allied and Complementary Medicine Database, CINAHL Complete, Health Source: Nursing/Academic Edition, MEDLINE, APA PsycINFO, EMBASE, EBM Reviews - Cochrane Database of Systematic Reviews, EBM Reviews - Database of Abstracts of Reviews of Effects, EBM Reviews - Health Technology Assessment, and IEEE Xplore. A descriptive summary of the literature was performed, and thematic analysis identified important or reoccurring themes. RESULTS Five references (representing four unique publications) were eligible for the review. Of the four included publications, two were articles on original research studies of a specific DHI, and two were overviews of methods for developing DHIs (not specific to a single DHI). All the included reports discussed the involvement of stakeholders in developing KPIs for DHIs. The step of identifying and defining the KPIs was completed using various methodologies, but all centered on a form of stakeholder involvement. Potential options for stakeholder involvement for KPI identification include the use of an elicitation framework, a factorial survey approach, or a Delphi study. Most of the included articles recognised the lack of literature relating to KPI development for DHIs, compared to the breath of literature available on the development of KPIs in other fields like health or informatics CONCLUSIONS Few articles were identified, highlighting a significant gap in the evidence-based knowledge in this domain. All the included articles discussed the involvement of stakeholders in developing KPIs for DHIs, which was performed using various methodologies. The articles acknowledged a lack of literature related to KPI development for DHIs. To allow comparability between KPI initiatives and facilitate work in the field, further research would be beneficial to develop a common methodology for KPI development for DHIs.

Sign in / Sign up

Export Citation Format

Share Document