scholarly journals An Assessment Framework for e-Mental Health Apps in Canada: Results of a Modified Delphi Process (Preprint)

2018 ◽  
Author(s):  
Jennifer Zelmer ◽  
Krystle van Hoof ◽  
MaryAnn Notarianni ◽  
Trevor van Mierlo ◽  
Megan Schellenberg ◽  
...  

BACKGROUND The number of e-mental health apps is increasing rapidly. Studies have shown that the use of some apps is beneficial, whereas others are ineffective or do not meet users’ privacy expectations. Individuals and organizations that curate, recommend, host, use, or pay for apps have an interest in categorizing apps according to the consensus criteria of usability and effectiveness. Others have previously published recommendations for assessing health-related apps; however, the extent to which these recommendations can be generalized across different population groups (eg, culture, gender, and language) remains unclear. This study describes an attempt by Canadian stakeholders to develop an e-mental health assessment framework that responds to the unique needs of people living in Canada in an evidence-based manner. OBJECTIVE The objective of our study was to achieve consensus from a broad group of Canadian stakeholders on guiding principles and criteria for a framework to assess e-mental health apps in Canada. METHODS We developed an initial set of guiding principles and criteria from a rapid review and environmental scan of pre-existing app assessment frameworks. The initial list was refined through a two-round modified Delphi process. Participants (N=25) included app developers and users, health care providers, mental health advocates, people with lived experience of a mental health problem or mental illness, policy makers, and researchers. Consensus on each guideline or criterion was defined a priori as at least 70% agreement. The first round of voting was conducted electronically. Prior to Round 2 voting, in-person presentations from experts and a persona empathy mapping process were used to explore the perspectives of diverse stakeholders. RESULTS Of all respondents, 68% (17/25) in Round 1 and 100% (13/13) in Round 2 agreed that a framework for evaluating health apps is needed to help Canadian consumers identify high-quality apps. Consensus was reached on 9 guiding principles: evidence based, gender responsive, culturally appropriate, user centered, risk based, internationally aligned, enabling innovation, transparent and fair, and based on ethical norms. In addition, 15 informative and evaluative criteria were defined to assess the effectiveness, functionality, clinical applicability, interoperability, usability, transparency regarding security and privacy, security or privacy standards, supported platforms, targeted users, developers’ transparency, funding transparency, price, user desirability, user inclusion, and meaningful inclusion of a diverse range of communities. CONCLUSIONS Canadian mental health stakeholders reached the consensus on a framework of 9 guiding principles and 15 criteria important in assessing e-mental health apps. What differentiates the Canadian framework from other scales is explicit attention to user inclusion at all stages of the development, gender responsiveness, and cultural appropriateness. Furthermore, an empathy mapping process markedly influenced the development of the framework. This framework may be used to inform future mental health policies and programs.

10.2196/10016 ◽  
2018 ◽  
Vol 6 (7) ◽  
pp. e10016 ◽  
Author(s):  
Jennifer Zelmer ◽  
Krystle van Hoof ◽  
MaryAnn Notarianni ◽  
Trevor van Mierlo ◽  
Megan Schellenberg ◽  
...  

2021 ◽  
Author(s):  
Laura Martinengo ◽  
Anne-Claire Stona ◽  
Konstadina Griva ◽  
Paola Dazzan ◽  
Carmine Maria Pariante ◽  
...  

BACKGROUND Mental health disorders affect one in ten people globally, of which around 300 million are affected by depression. At least half of affected people remain untreated. Cognitive behavioral therapy (CBT) is an effective treatment but access to specialized providers, habitually challenging, has worsened with COVID-19. Internet-based CBT (iCBT) is effective and a feasible strategy to increase access to treatment for people with depression. Mental health apps may further assist in facilitating self-management for people affected by depression but accessing the right app might be cumbersome given the large number and wide variety of apps offered by public app marketplaces. OBJECTIVE To systematically assess features, functionality, data security and congruence with evidence of self-guided CBT-based apps available in major app stores, suitable for users suffering from depression. METHODS A systematic assessment of self-guided CBT-based apps available in Google Play and Apple’s App Store was conducted. Apps launched or updated since August 2018 were identified through a systematic search in 42matters using CBT-related terms. Apps meeting inclusion criteria were downloaded and assessed using a Samsung Galaxy J7 Pro (Android 9) and iPhone 7 (iOS 13.3.1). Apps were appraised using a 182-question checklist developed by the research team, comprising apps’ general characteristics, CBT-related features, including six evidence-based CBT techniques as informed by a CBT manual, CBT competences framework and a literature review of iCBT clinical trial protocols (psychoeducation, behavioral activation, cognitive restructuring, problem solving, relaxation, and exposure for comorbid anxiety), and technical aspects and quality assurance. Results were reported as a narrative review, using descriptive statistics. RESULTS The initial search yielded 3006 apps, of which 98 apps met inclusion criteria and were systematically assessed. There were 20 wellbeing apps, 65 mental health apps and 13 depression apps. Twenty-eight apps offered at least four evidence-based CBT techniques, particularly depression apps. Cognitive restructuring was the most common technique, offered by 77/98 apps. Only a third of apps offered suicide- risk management resources while less than 20% of apps offered COVID-19-related information. Most apps included a privacy policy, but only a third of apps presented it before account creation. Eighty percent of privacy policies stated sharing data with third party service providers. Half of app development teams included academic institutions or healthcare providers. CONCLUSIONS Only few self-guided CBT-based apps offer comprehensive CBT programs or suicide risk management resources. Sharing of users’ data is widespread, highlighting shortcomings in the health app market governance. To fulfill their potential, self-guided CBT-based apps should follow evidence-based clinical guidelines, be patient-centered and enhance users’ data security. CLINICALTRIAL NA


2021 ◽  
Author(s):  
Laura Martinengo ◽  
Anne-Claire Stona ◽  
Lorainne Tudor Car ◽  
Jimmy Lee ◽  
Konstadina Griva ◽  
...  

BACKGROUND Suboptimal understanding of depression and mental health disorders by the general population is an important contributor to the wide treatment gap in depression. Mental health literacy encompasses knowledge and beliefs about mental disorders and supports their recognition, management, and prevention. Besides knowledge improvement, psychoeducational interventions reduce symptoms of depression, enhance help-seeking behavior, and decrease stigma. Mental health apps often offer educational content, but the trustworthiness of included information is unclear OBJECTIVE To systematically evaluate adherence to depression clinical guidelines of the information offered by mental health apps available in major commercial app stores. METHODS A systematic assessment of the educational content about depression in apps available in Google Play and Apple’s App Store was conducted in July 2020. A systematic search for apps published or updated since January 2019 was performed using 42matters. Apps meeting inclusion criteria were downloaded and assessed using an iPhone 7 (iOS 14.0.1) and a Sony XPERIA XZs (Android 8.0.0) smartphones. The 156 questions assessment checklist comprised general characteristics of apps, appraisal of educational content and its adherence to evidence-based clinical guidelines, and technical aspects and quality assurance. Results were tabulated and reported as a narrative review, using descriptive statistics. RESULTS The app search retrieved 2,218 apps of which 58 were included in the analysis (29 Android apps and 29 iOS apps). Thirty-seven apps (64%) offered educational content within a more comprehensive depression or mental health management app. Twelve apps (21%) provided non-evidence-based information. Most apps (51/58, 88%) included up to 20/38 educational topics assessed. Common educational topics were listing symptoms of depression (52/58, 90%) and available treatments (48/58, 83%), particularly psychotherapy. Depression-associated stigma was mentioned by 38% of apps, while suicide risk was mentioned by 71% of apps, generally as one item in a list of symptoms. Forty-four (76%) apps highlighted the importance of help-seeking, and 50% of apps emphasized the importance of involving the user’s support network. Thirty apps (52%) referenced their content and ten apps (17%) included advertisements. CONCLUSIONS Information in mental health and depression apps is often brief and incomplete. One in five apps provided non-evidence-based information. Given the unmet needs and stigma associated with the disease, it is imperative that apps seize the opportunity to offer quality, evidence-based education and/or point the users to relevant resources. A multi-stakeholder consensus on a more stringent development and publication process for mental health apps is imperative.


CJEM ◽  
2020 ◽  
Vol 22 (S1) ◽  
pp. S21-S22
Author(s):  
C. Yeh ◽  
S. Cope ◽  
T. Thompson ◽  
S. McGilvray ◽  
A. Petrosoniak ◽  
...  

Background: Massive hemorrhage protocols (MHPs) streamline the complex logistics required for prompt care of the bleeding patient, but their uptake has been variable and few regions have a system to measure outcomes from these events. Aim Statement: We aim to implement a standardized MHP with uniform quality improvement (QI) metrics to increase uptake of evidence-based MHPs across 150-hospitals in Ontario between 2017 and 2021. Measures & Design: We performed ongoing PDSA cycles; 1) stakeholder analysis by surveying the Ontario Regional Blood Coordinating Network (ORBCoN), 2) problem characterization and Ishikawa analysis for key QI metrics based on areas of MHP variability in 150 Ontario hospitals using a web-based survey, 3) creation of a consensus MHP via a modified Delphi process, 4) problem characterization at ORBCoN for the design of a freely available toolkit for provincial implementation by expert working groups, 5) design of 8 key QI metrics by a modified Delphi process, and 6) identification of process measures for QI data collection by implementation metrics. Evaluation/Results: PDSA1-2; 150-hospitals were surveyed. 33% of hospitals lacked MHPs, mostly in smaller sites. Major areas for QI were related to activation criteria, hemostatic agents, protocolized hypothermia management, variable MHP naming, QI metrics and serial blood work requirements. PDSA3; 3 Delphi rounds were held to reach 100% expert consensus for 42 statements and 8 CQI metrics. Major areas for modification were protocol name, laboratory resuscitation targets, cooler configurations, and role of factor VIIa. PDSA4; adaptable toolkit is under development by the steering committee and expert working groups. Implementation is scheduled for Spring 2020. PDSA5; the 8 CQI metrics are: TXA administration < 1 h, RBC transfusion < 15 min, call to transfer for definitive care < 60 min, temp >35°C at end of protocol, Hgb kept between 60-110g/L, transition to group-specific RBC by 90 min, appropriate activation defined by ≥6 units RBC in the first 24 hours, and any blood component wastage. Discussion/Impact: MHP uptake, content, and tracking is variable. A standardized MHP that is adaptable to diverse settings decreases complexity, improves use of evidence-based practices, and provides a platform for continuous QI. PDSA6 will occur after implementation; we will complete an implementation survey, and design a pilot and feasibility study for prospective tracking of patient outcomes using existing prospectively collected inter-hospital and provincial databases.


2019 ◽  
Author(s):  
Huifang Yin ◽  
Klaas J Wardenaar ◽  
Yuhao Wang ◽  
Nan Wang ◽  
Wenjin Chen ◽  
...  

BACKGROUND Smartphones have become ubiquitous in China, offering a promising way to deliver mental health interventions; however, little is known about the current use and characteristics of smartphone apps for mental health. OBJECTIVE The purpose of this study was to gain insight into mobile mental health apps available in China as of December 2018. METHODS A systematic search was conducted to identify and evaluate the most downloaded apps from iOS and Android platforms. Apps were categorized according to their main purpose and downloaded to evaluate their content. Each app’s affiliation, cost, target users, information security, and evidence-based nature were evaluated. RESULTS Of the 172 unique apps that were identified, there were 37 apps (21.5%) for psychological counseling, 50 apps (29.1%) for assessment, 12 apps (7.0%) to relieve stress, 24 apps (14.0%) for psychoeducation, and 49 (28.4%) multipurpose apps (ie, a combination of counseling and assessment). Most apps were developed for adults in the general population (166/172, 96.5%), rather than for psychiatric patients. App-based counseling was mostly provided by psychologists, and of the assessed apps, only 40% (70/172) used evidence-based scales to assess mental health problems such as anxiety or depressed mood. Guided meditation was used as the main technique in stress-relieving apps. CONCLUSIONS Many apps contained useful and evidence-based elements, such as good quality information, validated measurements, and useful meditation methods; however, for mobile apps to contribute significantly to mental health care in China, considerable challenges remain, including the need for more patient-focused apps that can actually take on the role of a health care provider. In addition, efficacy studies are needed.


2021 ◽  
Author(s):  
Ajay Major ◽  
Fay J Hlubocky

Background: The ongoing COVID-19 pandemic has profoundly affected the mental health of health care workers (HCWs), and optimal strategies to provide psychological support for HCWs are not currently established. Aims: To rapidly review recently-published literature on the mental health of HCWs during the COVID-19 pandemic. Methods: Query of all quantitative research through the PubMed database on the mental health of HCWs during the COVID-19 pandemic which utilized validated mental health instruments. 723 articles were screened and 87 articles were included. Results: Nearly all included studies were cross-sectional, survey-based assessments of the prevalence of and risk factors for mental illness. Only one interventional study was identified. Prevalence of mental health outcomes varied widely: 7.0-97.3% anxiety, 10.6-62.1% depression, 2.2-93.8% stress, 3.8-56.6% post traumatic stress, 8.3-88.4% insomnia, and 21.8-46.3% burnout. Risk and protective factors were identified in personal and professional domains, including degree of COVID-19 exposure, adequacy of protective equipment, and perception of organizational support. Conclusions: The myriad risk factors for poor mental health among HCWs suggests that a comprehensive psychosocial support model with individual- and organization-level interventions is necessary. Further longitudinal research on specific evidence-based interventions to mitigate adverse mental health outcomes among HCWs is urgently needed as the pandemic continues.


2022 ◽  
Vol 3 (1) ◽  
Author(s):  
Alex R. Dopp ◽  
Marylou Gilbert ◽  
Jane Silovsky ◽  
Jeanne S. Ringel ◽  
Susan Schmidt ◽  
...  

Abstract Background Sustained delivery of evidence-based treatments (EBTs) is essential to addressing the public health and economic impacts of youth mental health problems, but is complicated by the limited and fragmented funding available to youth mental health service agencies (hereafter, “service agencies”). Strategic planning tools are needed that can guide these service agencies in their coordination of sustainable funding for EBTs. This protocol describes a mixed-methods research project designed to (1) develop and (2) evaluate our novel fiscal mapping process that guides strategic planning efforts to finance the sustainment of EBTs in youth mental health services. Method Participants will be 48 expert stakeholder participants, including representatives from ten service agencies and their partners from funding agencies (various public and private sources) and intermediary organizations (which provide guidance and support on the delivery of specific EBTs). Aim 1 is to develop the fiscal mapping process: a multi-step, structured tool that guides service agencies in selecting the optimal combination of strategies for financing their EBT sustainment efforts. We will adapt the fiscal mapping process from an established intervention mapping process and will incorporate an existing compilation of 23 financing strategies. We will then engage participants in a modified Delphi exercise to achieve consensus on the fiscal mapping process steps and gather information that can inform the selection of strategies. Aim 2 is to evaluate preliminary impacts of the fiscal mapping process on service agencies’ EBT sustainment capacities (i.e., structures and processes that support sustainment) and outcomes (e.g., intentions to sustain). The ten agencies will pilot test the fiscal mapping process. We will evaluate how the fiscal mapping process impacts EBT sustainment capacities and outcomes using a comparative case study approach, incorporating data from focus groups and document review. After pilot testing, the stakeholder participants will conceptualize the process and outcomes of fiscal mapping in a participatory modeling exercise to help inform future use and evaluation of the tool. Discussion This project will generate the fiscal mapping process, which will facilitate the coordination of an array of financing strategies to sustain EBTs in community youth mental health services. This tool will promote the sustainment of youth-focused EBTs.


2020 ◽  
Author(s):  
Suzannah Stuijfzand ◽  
Camille Deforges ◽  
Vania Sandoz ◽  
Consuela-Thais Consuela-Thais Sajin ◽  
Cécile Jaques ◽  
...  

Abstract Background: Epidemics or pandemics, such as the current Coronavirus Disease 2019 (COVID-19) crisis, pose unique challenges to healthcare professionals (HCPs). Caring for patients during an epidemic/pandemic may impact negatively on the mental health of HCPs. There is a lack of evidence-based advice on what would be effective in mitigating this impact. Objectives: This rapid review synthesizes the evidence on the psychological impact of pandemics/epidemics on the mental health of HCPs, what factors predict this impact, and the evidence of prevention/intervention strategies to reduce this impact. Method: According to rapid review guidelines, systematic searches were carried out in Embase.com, PubMed, APA PsycINFO-Ovid SP, and Web of Science (core collection). Searches were restricted to the years 2003 or later to ensure inclusion of the most recent epidemic/pandemics, such as Severe Acute Respiratory Syndrome (SARS). Papers written in French or English, published in peer-reviewed journals, and of quantitative design using validated measures of mental health outcomes were included. Of 1308 papers found, 50 were included. The full protocol for this rapid review was registered with Prospero ( reg.no. CRD42020175985). Results: Results show that exposed HCPs working with patients during an epidemic/pandemic are at heightened risk of mental health problems in the short and longer term, particularly: psychological distress, insomnia, alcohol/drug misuse, and symptoms of posttraumatic stress disorder (PTSD), depression, anxiety, burnout, anger, and higher perceived stress. These mental health problems are predicted by organizational, social, personal, and psychological factors and may interfere with the quality of patient care. Few evidence-based early interventions exist so far. Discussion: HCPs need to be provided with psychosocial support to protect their mental wellbeing if they are to continue to provide high quality patient care. Several recommendations relevant during and after an epidemic/pandemic, such as COVID-19, and in preparation for a future outbreak, are proposed.


10.2196/14915 ◽  
2020 ◽  
Vol 22 (7) ◽  
pp. e14915
Author(s):  
Huifang Yin ◽  
Klaas J Wardenaar ◽  
Yuhao Wang ◽  
Nan Wang ◽  
Wenjin Chen ◽  
...  

Background Smartphones have become ubiquitous in China, offering a promising way to deliver mental health interventions; however, little is known about the current use and characteristics of smartphone apps for mental health. Objective The purpose of this study was to gain insight into mobile mental health apps available in China as of December 2018. Methods A systematic search was conducted to identify and evaluate the most downloaded apps from iOS and Android platforms. Apps were categorized according to their main purpose and downloaded to evaluate their content. Each app’s affiliation, cost, target users, information security, and evidence-based nature were evaluated. Results Of the 172 unique apps that were identified, there were 37 apps (21.5%) for psychological counseling, 50 apps (29.1%) for assessment, 12 apps (7.0%) to relieve stress, 24 apps (14.0%) for psychoeducation, and 49 (28.4%) multipurpose apps (ie, a combination of counseling and assessment). Most apps were developed for adults in the general population (166/172, 96.5%), rather than for psychiatric patients. App-based counseling was mostly provided by psychologists, and of the assessed apps, only 40% (70/172) used evidence-based scales to assess mental health problems such as anxiety or depressed mood. Guided meditation was used as the main technique in stress-relieving apps. Conclusions Many apps contained useful and evidence-based elements, such as good quality information, validated measurements, and useful meditation methods; however, for mobile apps to contribute significantly to mental health care in China, considerable challenges remain, including the need for more patient-focused apps that can actually take on the role of a health care provider. In addition, efficacy studies are needed.


Sign in / Sign up

Export Citation Format

Share Document