scholarly journals Measuring readiness for implementation: A systematic review of measures’ psychometric and pragmatic properties

2020 ◽  
Vol 1 ◽  
pp. 263348952093389
Author(s):  
Bryan J. Weiner ◽  
Kayne D. Mettert ◽  
Caitlin N. Dorsey ◽  
Elspeth A Nolen ◽  
Cameo Stanick ◽  
...  
Keyword(s):  
Mental Health ◽  
Systematic Review ◽  
Behavioral Health ◽  
Service Providers ◽  
Research And Practice ◽  
Leadership Engagement ◽  
Access To Knowledge ◽  
And Training ◽  
Available Resources

Background: Systematic measure reviews can facilitate advances in implementation research and practice by locating reliable, valid, pragmatic measures; identifying promising measures needing refinement and testing; and highlighting measurement gaps. This review identifies and evaluates the psychometric and pragmatic properties of measures of readiness for implementation and its sub-constructs as delineated in the Consolidated Framework for Implementation Research: leadership engagement, available resources, and access to knowledge and information. Methods: The systematic review methodology is described fully elsewhere. The review, which focused on measures used in mental or behavioral health, proceeded in three phases. Phase I, data collection, involved search string generation, title and abstract screening, full text review, construct assignment, and cited citation searches. Phase II, data extraction, involved coding relevant psychometric and pragmatic information. Phase III, data analysis, involved two trained specialists independently rating each measure using Psychometric and Pragmatic Evidence Rating Scales (PAPERS). Frequencies and central tendencies summarized information availability and PAPERS ratings. Results: Searches identified 9 measures of readiness for implementation, 24 measures of leadership engagement, 17 measures of available resources, and 6 measures of access to knowledge and information. Information about internal consistency was available for most measures. Information about other psychometric properties was often not available. Ratings for internal consistency were “adequate” or “good.” Ratings for other psychometric properties were less than “adequate.” Information on pragmatic properties was most often available regarding cost, language readability, and brevity. Information was less often available regarding training burden and interpretation burden. Cost and language readability generally exhibited “good” or “excellent” ratings, interpretation burden generally exhibiting “minimal” ratings, and training burden and brevity exhibiting mixed ratings across measures. Conclusion: Measures of readiness for implementation and its sub-constructs used in mental health and behavioral health care are unevenly distributed, exhibit unknown or low psychometric quality, and demonstrate mixed pragmatic properties. This review identified a few promising measures, but targeted efforts are needed to systematically develop and test measures that are useful for both research and practice. Plain language abstract: Successful implementation of effective mental health or behavioral health treatments in service delivery settings depends in part on the readiness of the service providers and administrators to implement the treatment; the engagement of organizational leaders in the implementation effort; the resources available to support implementation, such as time, money, space, and training; and the accessibility of knowledge and information among service providers about the treatment and how it works. It is important that the methods for measuring these factors are dependable, accurate, and practical; otherwise, we cannot assess their presence or strength with confidence or know whether efforts to increase their presence or strength have worked. This systematic review of published studies sought to identify and evaluate the quality of questionnaires (referred to as measures) that assess readiness for implementation, leadership engagement, available resources, and access to knowledge and information. We identified 56 measures of these factors and rated their quality in terms of how dependable, accurate, and practical they are. Our findings indicate there is much work to be done to improve the quality of available measures; we offer several recommendations for doing so.

scholarly journals Measuring implementation outcomes: An updated systematic review of measures’ psychometric properties

2020 ◽  
Vol 1 ◽  
pp. 263348952093664 ◽  
Author(s):  
Kayne Mettert ◽  
Cara Lewis ◽  
Caitlin Dorsey ◽  
Heather Halko ◽  
Bryan Weiner
Keyword(s):  
Systematic Review ◽  
Health Care ◽  
Psychometric Properties ◽  
Behavioral Health ◽  
Internal Consistency ◽  
Behavioral Health Care ◽  
Research And Practice ◽  
Implementation Outcomes ◽  
New Treatment

Background: Systematic reviews of measures can facilitate advances in implementation research and practice by locating reliable and valid measures and highlighting measurement gaps. Our team completed a systematic review of implementation outcome measures published in 2015 that indicated a severe measurement gap in the field. Now, we offer an update with this enhanced systematic review to identify and evaluate the psychometric properties of measures of eight implementation outcomes used in behavioral health care. Methods: The systematic review methodology is described in detail in a previously published protocol paper and summarized here. The review proceeded in three phases. Phase I, data collection, involved search string generation, title and abstract screening, full text review, construct assignment, and measure forward searches. Phase II, data extraction, involved coding psychometric information. Phase III, data analysis, involved two trained specialists independently rating each measure using PAPERS (Psychometric And Pragmatic Evidence Rating Scales). Results: Searches identified 150 outcomes measures of which 48 were deemed unsuitable for rating and thus excluded, leaving 102 measures for review. We identified measures of acceptability ( N = 32), adoption ( N = 26), appropriateness ( N = 6), cost ( N = 31), feasibility ( N = 18), fidelity ( N = 18), penetration ( N = 23), and sustainability ( N = 14). Information about internal consistency and norms were available for most measures (59%). Information about other psychometric properties was often not available. Ratings for internal consistency and norms ranged from “adequate” to “excellent.” Ratings for other psychometric properties ranged mostly from “poor” to “good.” Conclusion: While measures of implementation outcomes used in behavioral health care (including mental health, substance use, and other addictive behaviors) are unevenly distributed and exhibit mostly unknown psychometric quality, the data reported in this article show an overall improvement in availability of psychometric information. This review identified a few promising measures, but targeted efforts are needed to systematically develop and test measures that are useful for both research and practice. Plain language abstract: When implementing an evidence-based treatment into practice, it is important to assess several outcomes to gauge how effectively it is being implemented. Outcomes such as acceptability, feasibility, and appropriateness may offer insight into why providers do not adopt a new treatment. Similarly, outcomes such as fidelity and penetration may provide important context for why a new treatment did not achieve desired effects. It is important that methods to measure these outcomes are accurate and consistent. Without accurate and consistent measurement, high-quality evaluations cannot be conducted. This systematic review of published studies sought to identify questionnaires (referred to as measures) that ask staff at various levels (e.g., providers, supervisors) questions related to implementation outcomes, and to evaluate the quality of these measures. We identified 150 measures and rated the quality of their evidence with the goal of recommending the best measures for future use. Our findings suggest that a great deal of work is needed to generate evidence for existing measures or build new measures to achieve confidence in our implementation evaluations.

scholarly journals The effect of resistance training on health-related quality of life in older adults: Systematic review and meta-analysis

2019 ◽  
Vol 9 (1) ◽  
pp. 1-12 ◽  
Author(s):  
Peter D. Hart ◽  
Diona J. Buck
Keyword(s):  
Mental Health ◽  
Systematic Review ◽  
Older Adults ◽  
Role Function ◽  
Health Measures ◽  
Physical Role ◽  
Emotional Role ◽  
Related Quality ◽  
Health Related

Background: Resistance training (RT) is recommended as part of our national physical activity guidelines which includes working all major muscle groups on two or more days a week.Older adults can gain many health benefits from RT, such as increased muscle strength,increased muscle mass, and maintenance of bone density. Additionally, certain dimensions of health-related quality of life (HRQOL) have been shown to improve in older adults due to RT intervention. The purpose of this study was to use systematic review and meta-analytic techniques to examine the effect of RT on HRQOL in older adults. Methods: A systematic review of current studies (2008 thru 2017) was conducted using PubMed. Studies were included if they used a randomized controlled design, had RT as an intervention, measured HRQOL using the SF-36/12 assessment, and included adults 50+ years of age. Eight dimension scores (physical functioning, bodily pain, physical role function, general health, mental health, emotional role function, social function, and vitality) and two summary scores (physical component and mental component) were extracted. Ten meta-analyses were performed using standardized mean effect sizes and random effects models. Study quality,moderator and sensitivity analyses were conducted. Results: A total of 16 studies were included in the analyses with a mean Physiotherapy Evidence Database (PEDro) score of 4.9 (SD=1.0). Among the mental health measures, RT had the greatest effect on mental health (Effect size [ES]=0.64, 95% CI: 0.30-0.99, I2=79.7). Among the physical health measures, RT had the largest effect on body pain (ES=0.81, 95% CI: 0.26-1.35, I2=85.9).Initially, RT did not significantly affect measures of emotional role function, social function or physical role function. However, after removing a single study, RT significantly increased all HRQOL measures. Conclusion: The meta-analytic evidence presented in this research clearly supports the promotion of RT in improving HRQOL in older adults.

Effect of interventions using physical activity trackers on physical activity in people aged 60 years and over: a systematic review and meta-analysis

2019 ◽  
Vol 54 (20) ◽  
pp. 1188-1194 ◽  
Author(s):  
Juliana S Oliveira ◽  
Cathie Sherrington ◽  
Elizabeth R Y Zheng ◽  
Marcia Rodrigues Franco ◽  
Anne Tiedemann
Keyword(s):  
Quality Of Life ◽  
Mental Health ◽  
Physical Activity ◽  
Systematic Review ◽  
Older People ◽  
Activity Levels ◽  
Activity Tracker ◽  
Activity Trackers ◽  
The Impact

BackgroundOlder people are at high risk of physical inactivity. Activity trackers can facilitate physical activity. We aimed to investigate the effect of interventions using activity trackers on physical activity, mobility, quality of life and mental health among people aged 60+ years.MethodsFor this systematic review, we searched eight databases, including MEDLINE, Embase and CENTRAL from inception to April 2018. Randomised controlled trials of interventions that used activity trackers to promote physical activity among people aged 60+ years were included in the analyses. The study protocol was registered with PROSPERO, number CRD42017065250.ResultsWe identified 23 eligible trials. Interventions using activity trackers had a moderate effect on physical activity (23 studies; standardised mean difference (SMD)=0.55; 95% CI 0.40 to 0.70; I2=86%) and increased steps/day by 1558 (95% CI 1099 to 2018 steps/day; I2=92%) compared with usual care, no intervention and wait-list control. Longer duration activity tracker-based interventions were more effective than short duration interventions (18 studies, SMD=0.70; 95% CI 0.47 to 0.93 vs 5 studies, SMD=0.14; 95% CI −0.26 to 0.54, p for comparison=0.02). Interventions that used activity trackers improved mobility (three studies; SMD=0.61; 95% CI 0.31 to 0.90; I2=10%), but not quality of life (nine studies; SMD=0.09; 95% CI −0.07 to 0.25; I2=45%). Only one trial included mental health outcomes and it reported similar effects of the activity tracker intervention compared with control.ConclusionsInterventions using activity trackers improve physical activity levels and mobility among older people compared with control. However, the impact of activity tracker interventions on quality of life, and mental health is unknown.

scholarly journals Guidance on defining the scope and development of text-based coaching protocols for digital mental health interventions

2019 ◽  
Vol 5 ◽  
pp. 205520761989614
Author(s):  
Emily G Lattie ◽  
Andrea K Graham ◽  
Heather D Hadjistavropoulos ◽  
Blake F Dear ◽  
Nickolai Titov ◽  
...  
Keyword(s):  
Mental Health ◽  
Clinical Outcomes ◽  
Health Interventions ◽  
Multiple Models ◽  
Adherence To Guidelines ◽  
Mental Health Interventions ◽  
Human Support ◽  
And Training ◽  
Structure Communication

A body of literature suggests that the provision of human support improves both adherence to and clinical outcomes for digital mental health interventions. While multiple models of providing human support, or coaching, to support digital mental health interventions have been introduced, specific guidance on how to develop coaching protocols has been lacking. In this Education Piece, we provide guidance on developing coaching protocols for text-based communication in digital mental health interventions. Researchers and practitioners who are tasked with developing coaching protocols are prompted to consider the scope of coaching for the intervention, the selection and training of coaches, specific coaching techniques, how to structure communication with clients and how to monitor adherence to guidelines, and quality of coaching. Our goal is to advance thinking about the provision of human support in digital mental health interventions to inform stronger, more engaging, and effective intervention designs.

Mental health quality of life after bariatric surgery: A systematic review and meta-analysis of randomized clinical trials

2018 ◽  
Vol 9 (1) ◽  
pp. e12290 ◽  
Author(s):  
Alejandro Szmulewicz ◽  
Kerollos N. Wanis ◽  
Ashley Gripper ◽  
Federico Angriman ◽  
Jeff Hawel ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Mental Health ◽  
Systematic Review ◽  
Bariatric Surgery ◽  
Clinical Trials ◽  
Randomized Clinical Trials ◽  
Meta Analysis ◽  
Health Quality ◽  
Health Quality Of Life

scholarly journals Using Mendelian randomization analysis to better understand the relationship between mental health and substance use: a systematic review

2021 ◽  
pp. 1-32
Author(s):  
Jorien L. Treur ◽  
Marcus R. Munafò ◽  
Emma Logtenberg ◽  
Reinout W. Wiers ◽  
Karin J. H. Verweij
Keyword(s):  
Public Health ◽  
Mental Health ◽  
Systematic Review ◽  
Substance Use ◽  
Mental Disorders ◽  
Alcohol Drinking ◽  
Mendelian Randomization ◽  
Higher Educational Attainment ◽  
The Relationship

Abstract Background Poor mental health has consistently been associated with substance use (smoking, alcohol drinking, cannabis use, and consumption of caffeinated drinks). To properly inform public health policy it is crucial to understand the mechanisms underlying these associations, and most importantly, whether or not they are causal. Methods In this pre-registered systematic review, we assessed the evidence for causal relationships between mental health and substance use from Mendelian randomization (MR) studies, following PRISMA. We rated the quality of included studies using a scoring system that incorporates important indices of quality, such as the quality of phenotype measurement, instrument strength, and use of sensitivity methods. Results Sixty-three studies were included for qualitative synthesis. The final quality rating was ‘−’ for 16 studies, ‘– +’ for 37 studies, and ‘+’for 10 studies. There was robust evidence that higher educational attainment decreases smoking and that there is a bi-directional, increasing relationship between smoking and (symptoms of) mental disorders. Another robust finding was that higher educational attainment increases alcohol use frequency, but decreases binge-drinking and alcohol use problems, and that mental disorders causally lead to more alcohol drinking without evidence for the reverse. Conclusions The current MR literature increases our understanding of the relationship between mental health and substance use. Bi-directional causal relationships are indicated, especially for smoking, providing further incentive to strengthen public health efforts to decrease substance use. Future MR studies should make use of large(r) samples in combination with detailed phenotypes, a wide range of sensitivity methods, and triangulate with other research methods.

Sign in / Sign up

Export Citation Format

Share Document