scholarly journals Usability guidelines for developing and evaluating web-based mental health interventions: Establishing a practical framework

2019 ◽  
Author(s):  
Gustav Petersen ◽  
Jakob Hyldig Nielsen ◽  
Johannes Verner Olsen ◽  
Robin Niels Kok

Background: Even though problems with usability constitute a major challenge to the implementation of new eHealth technology, the field web-based interventions is lacking usability guidelines for development and evaluation of web-based intervention platforms. Objective: The aim of present study is to create a set of eHealth-specific usability guidelines for the development and evaluation of web-based mental health interventions. Methods: Knowledge about usability was gathered from peripheral fields of e-learning, emotional design, and human-computer interaction in a top-down approach. This knowledge was synthesized into usability guidelines for web-based interventions, which were then case-tested on an existing web-based intervention for patients with health anxiety, using the heuristic evaluation method. Results: Nine broad guidelines were developed. The subsequent case-test of the web-based intervention showed that application of the guidelines was feasible and was able to identify several important usability issues with the intervention. Conclusions: Health professionals should be included in intervention design. Future usability assessment should focus on the different usability attributes. The relationship between usability and adherence needs further investigation.

2017 ◽  
Vol 8 ◽  
Author(s):  
Derek de Beurs ◽  
Inge van Bruinessen ◽  
Janneke Noordman ◽  
Roland Friele ◽  
Sandra van Dulmen

2018 ◽  
Vol 5 (3) ◽  
pp. e50 ◽  
Author(s):  
Michael Jae Song ◽  
John Ward ◽  
Fiona Choi ◽  
Mohammadali Nikoo ◽  
Anastasia Frank ◽  
...  

Background Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. Objective The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. Methods Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. Results The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. Conclusions Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools.


2021 ◽  
Author(s):  
Dilan Hulaj ◽  
Sophie Antesberger ◽  
Tabea Blum ◽  
Raffaela Böswald ◽  
Hannah M. Brandl ◽  
...  

Importance: Although young adults are on average less affected by the physical consequences of COVID-19 infections, showing less severe disease progression and lower mortality risk, they suffer strongly from the mental health impact of the pandemic.Objective: We, a group of psychology students experiencing these impacts, aim to provide an overview of the existing literature on prevention and intervention efforts to effectively reduce the development of, or suffering from, mental health problems in young adults (18-35) during the COVID-19 pandemic.Evidence Review: A rapid systematic review was conducted to identify studies focusing on the implementation of mental health interventions for young adults of the general population during the COVID-19 pandemic. Literature was searched with Pubmed and Web of Science on June 17, 2021. The quality of each study was assessed by two reviewers with the Standard Quality Assessment Criteria for Evaluating Primary Research Papers.Findings: Of N = 76 records initially screened, eight studies met the inclusion criteria. Six applied web-based interventions, of which four were randomized controlled trials. Interventions were based on Cognitive Behavioral Therapy approaches (n = 5), mindfulness practices, logo-autobiography, and synergistic thinking methods. The interventions varied in length from single sessions to multiple sessions over a period of up to 10 weeks. All interventions were effective in reducing depression and anxiety symptoms, as well as stress with small to medium effect sizes and a symptom reduction up to 78.9%. With only three studies being of high quality, the overall quality was low.Conclusions and Relevance: Research on mental health interventions for young adults in the general population during the pandemic is sparse. However, all interventions resulted in symptoms reductions and thus have been shown to be effective ways of counteracting the potential development of mental disorders during times of uncertainty, with high levels of stress, such as during a pandemic. Therefore, we propose a concept for an innovative and cost-effective web-based platform to structure and raise awareness for existing measures.


2010 ◽  
Vol 45 ◽  
Author(s):  
Samuel Ssemugabi ◽  
Ruth De Villiers

The Internet, World Wide Web (WWW) and e-learning are contributing to new forms of teaching and learning. Such environments should be designed and evaluated in effective ways, considering both usability- and pedagogical issues. The selection of usability evaluation methods (UEMs) is influenced by the cost of a methods and its effectiveness in addressing users’ issues. The issue of usability is vital in e-learning, where students cannot begin to learn unless they can first use the application. Heuristic evaluation (HE) remains the most widely-used usability evaluation method. This paper describes meta-evaluation research that investigated an HE of a web-based learning (WBL) application. The evaluations were based on a synthesised framework of criteria, related to usability and learning within WBL environments. HE was found to be effective in terms of the number and nature of problems identified in the target application by a complementary team of experienced experts. The findings correspond closely with those of a survey among learners.


2017 ◽  
Author(s):  
Michael Jae Song ◽  
John Ward ◽  
Fiona Choi ◽  
Mohammadali Nikoo ◽  
Anastasia Frank ◽  
...  

BACKGROUND Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. OBJECTIVE The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. METHODS Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. RESULTS The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. CONCLUSIONS Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools.


2021 ◽  
Author(s):  
Jessica Kemp ◽  
Jill Chorney ◽  
Iman Kassam ◽  
Julie MacDonald ◽  
Tara MacDonald ◽  
...  

BACKGROUND The coronavirus disease (COVID-19) pandemic has increased the demand for youth mental health services in Canada as disruptions to care continue to persist due to risk of transmission and exposure to the virus. Digital mental health interventions, including web-based resources and mobile apps, have provided opportunities to support youth mental health remotely across Canada. There is a need to better understand the ways in which these digital interventions are being selected, recommended, and used in various regions across Canada. OBJECTIVE A national jurisdictional scan was completed to 1) determine what online programs, apps and websites are promoted and/or licensed in Canada for youth mental health, 2) identify criteria and/or decision-making processes that Canadian jurisdictions use to select online programs, apps and websites for youth mental health, and 3) identify upcoming trends, innovations and digital mental health possibilities that are emerging in the youth sector. METHODS The aims of the jurisdictional scan were addressed through a review of related academic and grey literature, stakeholder interviews including individuals involved in various areas of the youth mental health sector, and a social media review of pertinent Twitter content. RESULTS A total of 66 web-based resources and apps were identified for use by youth in Canada. 16 stakeholder interviews were completed and included discussions with researchers, clinicians, youth organizations, and others involved in digital interventions for youth mental health. Over a 4-week period, 2,184 tweets were reviewed to identify global trends and innovations involving digital mental health and youth. CONCLUSIONS As organizations begin to plan for the delivery of mental healthcare post-pandemic, there are some concerns about the sustainability of these digital mental health interventions as well as need for services to be more informed by experiences and preferences of youth.


2021 ◽  
pp. 1-12
Author(s):  
Peter Musiat ◽  
Catherine Johnson ◽  
Melissa Atkinson ◽  
Simon Wilksch ◽  
Tracey Wade

Abstract Web-based interventions are increasingly used for the prevention, treatment and aftercare of mental disorders. A crucial factor to the efficacy of such online programmes is adherence to the intervention content and procedure. It has been frequently suggested that adherence in web-based interventions is low and little is known about which factors influence adherence. To increase intervention uptake and completion, studies increasingly include interventions with some form of guidance. Guided interventions have been shown to have higher efficacy, however, evidence for the impact on adherence is limited and mixed. This meta-analysis explored the impact of human guidance on intervention completion in web-based mental health interventions. A total of 22 studies were included with interventions primarily targeting symptoms of depression and anxiety disorders. Results showed that guidance significantly increases the average amount of intervention completion [g = 0.29, 95% confidence interval (CI) 0.18–0.40] and the proportion of intervention completers [log odds ratio (OR) = 0.50, 95% CI 0.34–0.66] with small effects. On average, full completion rates were 12% higher in guided intervention groups. This meta-analysis demonstrated that guidance in web-based mental health interventions does increase adherence, but more research is required to better understand the specific mechanisms between guidance, adherence and outcomes.


Author(s):  
Brandon A. Kohrt ◽  
Vikram Patel

Culture refers to values, beliefs, knowledge, norms, and practices and the notion that these are shared among a specific set of people. Culture shapes the meaning and social experience of mental illness; influences the types of exposures to factors that cause mental illness; and moderates the relationship between risks and mental health outcomes. Cultural differences in models of causality and labelling of mental illnesses contribute to degree of family support, use of religious and traditional healing, and engagement with biomedical care systems. Cultural variations in describing, disclosing, and categorizing suffering are also sources of potential bias in epidemiological research. Instruments developed in one culture may be used in others, but greater emphasis must be placed on their adaptation to ensure equivalence. Use of cultural frameworks is crucial to optimize utilization and outcomes of culturally adapted psychological treatments and other mental health interventions.


2004 ◽  
Vol 26 (3) ◽  
pp. 225-242 ◽  
Author(s):  
Jane E. Myers ◽  
Carman S. Gill

The feminization of poverty has been well documented, and the relationship between the experiences of poverty and negative mental health outcomes has been identified. These consequences remain largely unexamined for women living in rural areas that comprise a population both at risk and underserved by mental health professionals.The dynamics of poverty for these women and the relationship between poverty lifestyles and physical and mental well-being is explored.A model for assessment and mental health interventions is presented. Implications for mental health counseling and for research are considered.


2021 ◽  
Vol 27 (10) ◽  
pp. 638-666
Author(s):  
Xiaoyun Zhou ◽  
Sisira Edirippulige ◽  
Xuejun Bai ◽  
Matthew Bambling

Objectives This systematic review aims to examine the effectiveness of online mental health interventions for youth. Methods We searched seven electronic databases (PubMed, PsycINFO, Medline, Embase, CINAHL, Web of Science and SCOPUS) for the past 10 years to identify randomized controlled trials which have evaluated the use of telehealth interventions for young people with mental health problems. The included studies were assessed for quality and risk of bias. Results Forty-five randomized controlled trials ( n = 13,291 participants) were eligible for this review. Most studies (35 trials) evaluated the use of web-based self-help platforms to deliver cognitive behavioural therapy (14 trials), mindfulness (four trials), acceptance commitment therapy (five trials) and positive psychology (two trials). Mobile/computer applications were used to deliver cognitive behavioural therapy (four trials) and coping strategies training (two trials). Web-based synchronous chat (one trial) was used to assist communication between counsellors and participants. Three studies used artificial intelligence-based conversational agents to deliver cognitive behavioural therapy (two trials) and problem-solving-strategy training (one trial). Eighty-two percent ( n = 37) identified the participants as student population (i.e. university students, high school students). Sixty-four percent ( n = 29) of the telehealth interventions were found to be effective in managing depression, anxiety, stress, insomnia and improving quality of life when compared with control conditions. Conclusions Online mental health interventions were found to be effective in managing diverse mental health conditions among youth. Online self-help platforms were the most frequently used modality and artificial intelligence-based chatbots are merging as potential solutions. Future research is warranted to investigate the solutions to improve the retention rate and satisfaction of telehealth interventions among this population.


Sign in / Sign up

Export Citation Format

Share Document