scholarly journals Surveying the Role of Analytics in Evaluating Digital Mental Health Interventions for Transition-Aged Youth: Scoping Review (Preprint)

2019 ◽  
Author(s):  
Brian Lo ◽  
Jenny Shi ◽  
Elisa Hollenberg ◽  
Alexxa Abi-Jaoudé ◽  
Andrew Johnson ◽  
...  

BACKGROUND Consumer-facing digital health interventions provide a promising avenue to bridge gaps in mental health care delivery. To evaluate these interventions, understanding how the target population uses a solution is critical to the overall validity and reliability of the evaluation. As a result, usage data (analytics) can provide a proxy for evaluating the engagement of a solution. However, there is paucity of guidance on how usage data or analytics should be used to assess and evaluate digital mental health interventions. OBJECTIVE This review aimed to examine how usage data are collected and analyzed in evaluations of mental health mobile apps for transition-aged youth (15-29 years). METHODS A scoping review was conducted using the Arksey and O’Malley framework. A systematic search was conducted on 5 journal databases using keywords related to usage and engagement, mental health apps, and evaluation. A total of 1784 papers from 2008 to 2019 were identified and screened to ensure that they included analytics and evaluated a mental health app for transition-aged youth. After full-text screening, 49 papers were included in the analysis. RESULTS Of the 49 papers included in the analysis, 40 unique digital mental health innovations were evaluated, and about 80% (39/49) of the papers were published over the past 6 years. About 80% involved a randomized controlled trial and evaluated apps with information delivery features. There were heterogeneous findings in the concept that analytics was ascribed to, with the top 3 being engagement, adherence, and acceptability. There was also a significant spread in the number of metrics collected by each study, with 35% (17/49) of the papers collecting only 1 metric and 29% (14/49) collecting 4 or more analytic metrics. The number of modules completed, the session duration, and the number of log ins were the most common usage metrics collected. CONCLUSIONS This review of current literature identified significant variability and heterogeneity in using analytics to evaluate digital mental health interventions for transition-aged youth. The large proportion of publications from the last 6 years suggests that user analytics is increasingly being integrated into the evaluation of these apps. Numerous gaps related to selecting appropriate and relevant metrics and defining successful or high levels of engagement have been identified for future exploration. Although long-term use or adoption is an important precursor to realizing the expected benefits of an app, few studies have examined this issue. Researchers would benefit from clarification and guidance on how to measure and analyze app usage in terms of evaluating digital mental health interventions for transition-aged youth. Given the established role of adoption in the success of health information technologies, understanding how to abstract and analyze user adoption for consumer digital mental health apps is also an emerging priority.

10.2196/15942 ◽  
2020 ◽  
Vol 7 (6) ◽  
pp. e15942
Author(s):  
Brian Lo ◽  
Jenny Shi ◽  
Elisa Hollenberg ◽  
Alexxa Abi-Jaoudé ◽  
Andrew Johnson ◽  
...  

Background Consumer-facing digital health interventions provide a promising avenue to bridge gaps in mental health care delivery. To evaluate these interventions, understanding how the target population uses a solution is critical to the overall validity and reliability of the evaluation. As a result, usage data (analytics) can provide a proxy for evaluating the engagement of a solution. However, there is paucity of guidance on how usage data or analytics should be used to assess and evaluate digital mental health interventions. Objective This review aimed to examine how usage data are collected and analyzed in evaluations of mental health mobile apps for transition-aged youth (15-29 years). Methods A scoping review was conducted using the Arksey and O’Malley framework. A systematic search was conducted on 5 journal databases using keywords related to usage and engagement, mental health apps, and evaluation. A total of 1784 papers from 2008 to 2019 were identified and screened to ensure that they included analytics and evaluated a mental health app for transition-aged youth. After full-text screening, 49 papers were included in the analysis. Results Of the 49 papers included in the analysis, 40 unique digital mental health innovations were evaluated, and about 80% (39/49) of the papers were published over the past 6 years. About 80% involved a randomized controlled trial and evaluated apps with information delivery features. There were heterogeneous findings in the concept that analytics was ascribed to, with the top 3 being engagement, adherence, and acceptability. There was also a significant spread in the number of metrics collected by each study, with 35% (17/49) of the papers collecting only 1 metric and 29% (14/49) collecting 4 or more analytic metrics. The number of modules completed, the session duration, and the number of log ins were the most common usage metrics collected. Conclusions This review of current literature identified significant variability and heterogeneity in using analytics to evaluate digital mental health interventions for transition-aged youth. The large proportion of publications from the last 6 years suggests that user analytics is increasingly being integrated into the evaluation of these apps. Numerous gaps related to selecting appropriate and relevant metrics and defining successful or high levels of engagement have been identified for future exploration. Although long-term use or adoption is an important precursor to realizing the expected benefits of an app, few studies have examined this issue. Researchers would benefit from clarification and guidance on how to measure and analyze app usage in terms of evaluating digital mental health interventions for transition-aged youth. Given the established role of adoption in the success of health information technologies, understanding how to abstract and analyze user adoption for consumer digital mental health apps is also an emerging priority.


2021 ◽  
pp. 030573562110194
Author(s):  
Amy Visser ◽  
Megan Lee ◽  
Timothy Barringham ◽  
Nasim Salehi

Professional popular musicians are at increased risk of psychological distress, substance use problems, and suicide, yet little evidence is available on effective psychotherapeutic practices to address these issues. This scoping review aims to understand how professional popular musicians perceive, engage with, and respond to mental health interventions. Four databases were searched, garnering a total of 310 articles. Of these, six met inclusion criteria. Four thematic categories were explored: (1) amenability of professional popular musicians to particular therapeutic approaches; (2) attribution of treatment outcomes to tailored approaches; (3) professional popular musicians’ perceived barriers to treatment; and (4) recommendations for treatment approaches. The scoping review supports the importance of considering the characteristics of professional popular musicians as a distinct group with unique well-being needs, challenges, and strengths. There is a clear preference for tailored, affordable, and accessible approaches that consider the uniquities of musicianship and the need to explore the role of nonclinical support, such as friends, family, and industry peers.


2021 ◽  
Vol 2 ◽  
pp. 263348952098825
Author(s):  
Cheri J Shapiro ◽  
Kathleen Watson MacDonell ◽  
Mariah Moran

Background: Among the many variables that affect implementation of evidence-based interventions in real-world settings, self-efficacy is one of the most important factors at the provider level of the social ecology. Yet, research on the construct of provider self-efficacy remains limited. Objectives: This scoping review was conducted to enhance understanding of the construct of provider self-efficacy and to examine how the construct is defined and measured in the context of implementation of evidence-based mental health interventions. Design: Online databases were used to identify 190 papers published from 1999 to June of 2018 that included search terms for providers, evidence-based, and self-efficacy. To be eligible for the scoping review, papers needed to focus on the self-efficacy of mental health providers to deliver evidence-based psychosocial interventions. A total of 15 publications were included in the review. Results: The construct of provider self-efficacy is not clearly defined but is typically described as confidence to deliver a specific intervention or practice. A range of measures are used to assess provider self-efficacy across both provider and intervention types. Conclusions: Standardized definition and measurement of provider self-efficacy is needed to advance practice and implementation research. Plain language abstract: Provider self-efficacy is known to influence implementation of evidence-based mental health interventions. However, the ways in which provider self-efficacy is defined and measured in implementation research literature is not well understood; furthermore, it is not clear what types of providers and interventions are represented in this literature. This scoping review adds to current research by revealing that there is no agreed upon definition or measure of provider self-efficacy in the context of implementation of evidence-based interventions, and that the research includes multiple types of providers (e.g., social workers, counselors, psychologists) and interventions. Self-efficacy appears to change as a function of training and support. To further research in this area, a common definition and agreed upon measures of this construct are needed.


2018 ◽  
Vol 5 (1) ◽  
pp. e8 ◽  
Author(s):  
Stephany Carolan ◽  
Richard O de Visser

Background Prevalence rates of work-related stress, depression, and anxiety are high, resulting in reduced productivity and increased absenteeism. There is evidence that these conditions can be successfully treated in the workplace, but take-up of psychological treatments among workers is low. Digital mental health interventions delivered in the workplace may be one way to address this imbalance, but although there is evidence that digital mental health is effective at treating stress, depression, and anxiety in the workplace, uptake of and engagement with these interventions remains a concern. Additionally, there is little research on the appropriateness of the workplace for delivering these interventions or on what the facilitators and barriers to engagement with digital mental health interventions in an occupational setting might be. Objective The aim of this research was to get a better understanding of the facilitators and barriers to engaging with digital mental health interventions in the workplace. Methods Semistructured interviews were held with 18 participants who had access to an occupational digital mental health intervention as part of a randomized controlled trial. The interviews were transcribed, and thematic analysis was used to develop an understanding of the data. Results Digital mental health interventions were described by interviewees as convenient, flexible, and anonymous; these attributes were seen as being both facilitators and barriers to engagement in a workplace setting. Convenience and flexibility could increase the opportunities to engage with digital mental health, but in a workplace setting they could also result in difficulty in prioritizing time and ensuring a temporal and spatial separation between work and therapy. The anonymity of the Internet could encourage use, but that benefit may be lost for people who work in open-plan offices. Other facilitators to engagement included interactive and interesting content and design features such as progress trackers and reminders to log in. The main barrier to engagement was the lack of time. The perfect digital mental health intervention was described as a website that combined a short interactive course that was accessed alongside time-unlimited information and advice that was regularly updated and could be dipped in and out of. Participants also wanted access to e-coaching support. Conclusions Occupational digital mental health interventions may have an important role in delivering health care support to employees. Although the advantages of digital mental health interventions are clear, they do not always fully translate to interventions delivered in an occupational setting and further work is required to identify ways of minimizing potential barriers to access and engagement. Trial Registration ClinicalTrials.gov: NCT02729987; https://clinicaltrials.gov/ct2/show/NCT02729987?term=NCT02729987& rank=1 (Archived at WebCite at http://www.webcitation.org/6wZJge9rt)


2017 ◽  
Author(s):  
Stephany Carolan ◽  
Richard O de Visser

BACKGROUND Prevalence rates of work-related stress, depression, and anxiety are high, resulting in reduced productivity and increased absenteeism. There is evidence that these conditions can be successfully treated in the workplace, but take-up of psychological treatments among workers is low. Digital mental health interventions delivered in the workplace may be one way to address this imbalance, but although there is evidence that digital mental health is effective at treating stress, depression, and anxiety in the workplace, uptake of and engagement with these interventions remains a concern. Additionally, there is little research on the appropriateness of the workplace for delivering these interventions or on what the facilitators and barriers to engagement with digital mental health interventions in an occupational setting might be. OBJECTIVE The aim of this research was to get a better understanding of the facilitators and barriers to engaging with digital mental health interventions in the workplace. METHODS Semistructured interviews were held with 18 participants who had access to an occupational digital mental health intervention as part of a randomized controlled trial. The interviews were transcribed, and thematic analysis was used to develop an understanding of the data. RESULTS Digital mental health interventions were described by interviewees as convenient, flexible, and anonymous; these attributes were seen as being both facilitators and barriers to engagement in a workplace setting. Convenience and flexibility could increase the opportunities to engage with digital mental health, but in a workplace setting they could also result in difficulty in prioritizing time and ensuring a temporal and spatial separation between work and therapy. The anonymity of the Internet could encourage use, but that benefit may be lost for people who work in open-plan offices. Other facilitators to engagement included interactive and interesting content and design features such as progress trackers and reminders to log in. The main barrier to engagement was the lack of time. The perfect digital mental health intervention was described as a website that combined a short interactive course that was accessed alongside time-unlimited information and advice that was regularly updated and could be dipped in and out of. Participants also wanted access to e-coaching support. CONCLUSIONS Occupational digital mental health interventions may have an important role in delivering health care support to employees. Although the advantages of digital mental health interventions are clear, they do not always fully translate to interventions delivered in an occupational setting and further work is required to identify ways of minimizing potential barriers to access and engagement. CLINICALTRIAL ClinicalTrials.gov: NCT02729987; https://clinicaltrials.gov/ct2/show/NCT02729987?term=NCT02729987& rank=1 (Archived at WebCite at http://www.webcitation.org/6wZJge9rt)


2021 ◽  
Vol 12 ◽  
Author(s):  
Marilon van Doorn ◽  
Laurens A. Nijhuis ◽  
Mees D. Egeler ◽  
Joost G. Daams ◽  
Arne Popma ◽  
...  

Objective: Between the ages of 12 and 25 the onset of mental disorders typically occurs, and the burden of mental health problems is greatest for this group. Indicated preventive interventions to target individuals with subclinical symptoms to prevent the transition to clinical levels of disorders have gained considerable traction. However, the threshold to seek help appears to be high even when help is needed. Online interventions could offer a solution, especially during the COVID-19 pandemic. This scoping review will present an overview of the recent research of indicated online preventive interventions for youth (12–25 years) experiencing the early stages of mental health complaints with the aim of identifying the nature and extent of the research evidence.Methods: The 5-stage framework by Arksey and O'Malley was used. Academic literature published from 2013 onwards in printed or electronic format was included from Scopus, PsychINFO, and Ovid MEDLINE(R) ALL.Results: The search yielded 11,122 results, with the final selection resulting in inclusion of 30 articles for this review. In total, the articles included 4,950 participants. 26.7% of the selected articles focused on youth between 12 and 25 years. Of the articles 60% did not screen for, nor exclude participants with clinical levels of symptoms. Most studies used a common evidence-based therapy for the disorder-category targeted. More than half of the online interventions included some form of human support. Adherence levels ranged between 27.9 and 98%. The results indicate general effectiveness, usability and acceptability of online indicated preventive interventions. The most commonly used approach was CBT (n = 12 studies). Studies varied in their size, rigor of study, effectiveness and outcome measures. Online interventions with a combination of clinical and peer moderation (n = 3 studies) appear to result in the most stable and highest effect sizes.Conclusion: Online indicated preventive mental health interventions for youth with emerging mental health issues show promise in reducing various mental health complaints, and increasing positive mental health indicators such as well-being and resilience. Additionally, high levels of usability and acceptability were found. However, the included studies show important methodological shortcomings. Also, the research has mainly focused on specific diagnostic categories, meaning there is a lack of transdiagnostic approaches. Finally, clear definitions of- as well as instruments to measure- emerging or subclinical mental health symptoms in youth remain are missing.


2021 ◽  
pp. 104973152110109
Author(s):  
Caroline Walters ◽  
Melissa Petrakis

Purpose: Families experience their own journey in adjusting to the role of carer. The purpose of this review was to understand from the perspective of families and carers which practices, and health system responses meet their needs in supporting people who experience mental health challenges. Methods: A systematic evidence mapping review was conducted, through searching five electronic databases to identify peer-reviewed studies, written in English and published between the years 2010 and 2020, that prioritized the perspectives of families. Results: Fifty-five studies met the inclusion criteria and were mapped according to the country of author, year, methodology, who delivered, and intervention mode and format. Discussion: The review demonstrated a diversity of interventions with growing numbers of studies considering the view and experiences of carers. There is evidence of increasingly active participation of carers in designing, leading, or facilitating interventions, recognizing the importance of coproduction in tailoring family and carer support.


2016 ◽  
Vol 50 (5) ◽  
pp. 636-658 ◽  
Author(s):  
Rebecca J. Haines-Saah ◽  
Carla T. Hilario ◽  
Emily K. Jenkins ◽  
Cara K. Y. Ng ◽  
Joy L. Johnson

This article is based on findings from a qualitative study with 27 adolescents in northern British Columbia, Canada. Our aim was to explore youths’ perspectives on the sources of emotional distress in their lives and how these are connected to peer-based aggression and victimization within their community. Our analysis of narrative findings suggests that youths’ narratives about bullying reflect intersecting and socially embedded configurations of “race,” neocolonialism, and place. We argue that mainstream approaches to addressing bullying as a relationship-based problem must be re-oriented to account for the role of the social or structural contexts of youths’ lives. By applying an intersectional lens, we make the case for a widening of the focus of interventions away from individual victims and perpetrators, toward a contextual approach that addresses how adolescents experience bullying as a site of health and social inequities in their community.


Sign in / Sign up

Export Citation Format

Share Document