eHealth Literacy Instruments: a Systematic Review of Measurement Properties (Preprint)

2021 ◽  
Author(s):  
Jiyeon Lee ◽  
Eun-Hyun Lee ◽  
Duckhee Chae

BACKGROUND The internet is now a major source of health information. With the growth of internet users, electronic health literacy (eHealth literacy) has emerged as a new concept for digital health care. Health professionals need to consider the eHealth literacy of consumers when providing care utilizing digital health technologies. OBJECTIVE The objectives of this study were to identify currently available eHealth literacy instruments and evaluate their measurement properties with the intention of providing robust evidence to researchers and clinicians who are selecting an eHealth literacy instrument. METHODS A systematic review and meta-analysis was conducted of self-reported eHealth literacy instruments by applying the updated COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology. RESULTS This study included 7 instruments from 41 articles describing 57 psychometric studies, as identified in 4 databases (PubMed, CINAHL, Embase, and PsycInfo). No eHealth literacy instrument provided evidence for all measurement properties. The eHealth Literacy Scale (eHEALS) was originally developed with a single-factor structure under the definition of eHealth literacy before the rise of social media and the mobile Web. That instrument was evaluated in 18 different languages in 26 countries involving diverse populations. However, a variety of other factor structures were exhibited: seven types of two-factor structure, three types of three-factor structure, and one-bifactor structure. The Transactional eHealth Literacy Instrument (TeHLI) was developed to reflect broader concept of eHealth literacy, and was demonstrated to have a sufficient low- and very-low-quality evidence for content validity (relevance, comprehensiveness, and comprehensibility), and sufficient high-quality evidence for structural validity and internal consistency; however, that instrument has rarely been evaluated. CONCLUSIONS The eHEALS was the most frequently investigated instrument. However, it is strongly recommended that the content of the instrument be updated to reflect recent advancements in digital health technologies. The TeHLI needs improvements in content validity and further psychometric studies to increase the credibility of its synthesized evidence. CLINICALTRIAL Not applicable.

Author(s):  
Vasileios Korakakis ◽  
Argyro Kotsifaki ◽  
Manos Stefanakis ◽  
Yiannis Sotiralis ◽  
Rod Whiteley ◽  
...  

Abstract Purpose The Victorian Institute of Sport Assessment (Achilles tendon—VISA-A, greater trochanteric pain syndrome—VISA-G, proximal hamstring tendinopathy—VISA-H, patellar tendon—VISA-P) questionnaires are widely used in research and clinical practice; however, no systematic reviews have formally evaluated their content, structural, and cross-cultural validity evidence. The measurement properties referring to content, structural and cross-cultural validity of the VISA questionnaires were appraised and synthesized. Methods The systematic review was conducted according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) methodology. PubMed, Cochrane, CINAHL, EMBASE, Web of Science, SportsDiscus, grey literature, and reference lists were searched. Development studies and cross-cultural adaptations (12 languages) assessing content or structural validity of the VISA questionnaires were included and two reviewers assessed their methodological quality. Evidence for content (relevance, comprehensiveness, and comprehensibility), structural, and cross-cultural validity was synthesized. A modified Grading of Recommendations Assessment Development and Evaluation (GRADE) approach was applied to evidence synthesis. Results The VISA-A presented very-low-quality evidence of sufficient relevance, insufficient comprehensiveness, and inconsistent comprehensibility. VISA-G displayed moderate-quality evidence for sufficient comprehensibility and very-low-quality evidence of sufficient relevance and comprehensiveness. The VISA-P presented very-low-quality evidence of sufficient relevance, insufficient comprehensiveness, and inconsistent comprehensibility, while VISA-H presented very-low evidence of insufficient content validity. VISA-A displayed low-quality evidence for structural validity concerning unidimensionality and internal structure, while VISA-H presented low-quality evidence of insufficient unidimensionality. The structural validity of VISA-G and VISA-P were indeterminate and inconsistent, respectively. Internal consistency for VISA-G, VISA-H, and VISA-P was indeterminate. No studies evaluated cross-cultural validity, while measurement invariance across sexes was assessed in one study. Conclusions Only very-low-quality evidence exists for the content and structural validity of VISA questionnaires when assessing the severity of symptoms and disability in patients with lower limb tendinopathies. Level of evidence IV. Registration PROSPERO reference—CRD42019126595.


2021 ◽  
Author(s):  
Yu-Chi Chen ◽  
Christina Cheng ◽  
Richard H Osborne ◽  
Lars Kayser ◽  
Chieh-Yu Liu ◽  
...  

BACKGROUND Advancements in digital technologies seek to promote health and access to services. However, people lacking abilities and confidence to use technology are likely to be left behind, leading to health disparities. In providing digital health services, health care providers need to be aware of users diverse electronic health (eHealth) literacy to address particular needs and ensure equitable uptake and use of digital services. To understand such needs, an instrument that captures user’s knowledge, skills, trust, motivation and experiences in relation to technology is required. The eHealth Literacy Questionnaire (eHLQ) is a multi-dimensional tool with 7 scales covering diverse dimensions of eHealth literacy. The tool was simultaneously developed in English and Danish using a grounded and validity-driven approach and was shown to have strong psychometric properties. OBJECTIVE This study aimed to translate and culturally adapt the eHLQ for application among Chinese-speaking people with chronic diseases in Taiwan, and then undertake a rigorous set of validity testing procedures. METHODS The cross-cultural adaptation of the eHLQ included translation and evaluation of the translations. The measurement properties were assessed using classical test theory and Item Response Theory (IRT) approaches. Content validity, known groups validity and internal consistency were explored, as well as item characteristic curves (ICCs), item discrimination and item location/difficulty. RESULTS The adapted version was reviewed and a recommended forward translation was confirmed through consensus meetings. The tool exhibited good content validity. A total of 420 people with one or more chronic diseases participated in a validity testing survey. The eHLQ showed good internal consistency (Cronbach’s α .75 ~.95). For known groups validity, all 7 eHLQ scales showed strong expected associations with education. Unidimensionality and local independence assumptions were met, except for Scale 2. IRT analysis showed that all items demonstrated good discrimination and a good range of difficulty, except for 2 items in Scale 7. CONCLUSIONS Using a rigorous process, the eHLQ was translated from English into a culturally appropriate tool for use in the Chinese language. Validity testing provided evidence of satisfactory to strong psychometric properties of the eHLQ. The 7 scales are likely to be useful research tools for evaluating digital health interventions and for informing the development of health technology products and interventions that equitably suit diverse users’ needs. CLINICALTRIAL Inapplicable This study was not a clinical trial.


Dermatology ◽  
2020 ◽  
pp. 1-17
Author(s):  
M. Ingmar van Raath ◽  
Sandeep Chohan ◽  
Albert Wolkerstorfer ◽  
Chantal M.A.M. van der Horst ◽  
Jacqueline Limpens ◽  
...  

<b><i>Background:</i></b> A plethora of outcome measurement instruments (OMIs) are being used in port wine stain (PWS) studies. It is currently unclear how valid, responsive, and reliable these are. <b><i>Objectives:</i></b> The aim of this systematic review was to appraise the content validity and other measurement properties of OMIs for PWS treatment to identify the most appropriate instruments and future research priorities. <b><i>Methods:</i></b> This study was performed using the updated Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) methodology and adhered to PRISMA guidelines. Comprehensive searches in Medline and Embase were performed. Studies in which an OMI for PWS patients was developed or its measurement properties were evaluated were included. Two investigators independently extracted data and assessed the quality of included studies and instruments to perform qualitative synthesis of the evidence. <b><i>Results:</i></b> In total, 1,034 articles were screened, and 77 full-text articles were reviewed. A total of 8 studies were included that reported on 6 physician-reported OMIs of clinical improvement and 6 parent- or patient-reported OMIs of life impact, of which 3 for health-related quality of life and 1 for perceived stigmatization. Overall, the quality of OMI development was inadequate (63%) or doubtful (37%). Each instrument has undergone a very limited evaluation in PWS patients. No content validity studies were performed. The quality of evidence for content validity was very low (78%), low (15%), or moderate (7%), with sufficient comprehensibility, mostly sufficient comprehensiveness, and mixed relevance. No studies on responsiveness, minimal important change, and cross-cultural validity were retrieved. There was moderate- to very low-quality evidence for sufficient inter-rater reliability for some clinical PWS OMIs. Internal consistency and measurement error were indeterminate in all studies. <b><i>Conclusions:</i></b> There was insufficient evidence to properly guide outcome selection. Additional assessment of the measurement properties of OMIs is needed, preferentially guided by a core domain set tailored to PWS.


Author(s):  
Clare Burgon ◽  
Sarah Elizabeth Goldberg ◽  
Veronika van der Wardt ◽  
Catherine Brewin ◽  
Rowan H. Harwood

<b><i>Background:</i></b> Apathy is highly prevalent in dementia and is also seen in mild cognitive impairment and the general population. Apathy contributes to failure to undertake daily activities and can lead to health problems or crises. It is therefore important to assess apathy. However, there is currently no gold standard measure of apathy. A comprehensive systematic review of the measurement properties of apathy scales is required. <b><i>Methods:</i></b> A systematic review was registered with PROSPERO (ID: CRD42018094390). MEDLINE, Embase, PsycINFO, and CINAHL were searched for studies that aimed to develop or assess the validity or reliability of an apathy scale in participants over 65 years, living in the community. A systematic review was conducted in line with the COnsensus-based Standards for the selection of health Measurement INstruments procedure for reviewing patient-reported outcome measures. The studies’ risk of bias was assessed, and all relevant measurement properties were assessed for quality. Results were pooled and rated using a modified Grading of Recommendations Assessment, Development, and Evaluation procedure. <b><i>Results:</i></b> Fifty-seven publications regarding 18 measures and 39 variations met the eligibility criteria. The methodological quality of individual studies ranged from inadequate to very good and measurement properties ranged from insufficient to sufficient. Similarly, the overall evidence for measurement properties ranged from very low to high quality. The Apathy Evaluation Scale (AES) and Lille Apathy Rating Scale (LARS) had sufficient content validity, reliability, construct validity, and where applicable, structural validity and internal consistency. <b><i>Conclusion:</i></b> Numerous scales are available to assess apathy, with varying psychometric properties. The AES and LARS are recommended for measuring apathy in older adults and people living with dementia. The apathy dimension of the commonly used Neuropsychiatric Inventory should be limited to screening for apathy.


2021 ◽  
Vol 5 (1) ◽  
Author(s):  
Michaela Gabes ◽  
Christina Tischer ◽  
Anne Herrmann ◽  
Laura Howells ◽  
Christian Apfelbacher

Abstract Background Recap of atopic eczema (RECAP) is a patient-reported outcome measure (PROM) assessing eczema control. Long-term control of eczema is one of the four core outcome domains for atopic eczema trials. This instrument has been recently developed in the UK. Objective This study aimed to translate the English RECAP into German and test its content validity in a German population with self-reported atopic eczema. Methods A six-step procedure including two forward and one backward translations, two consensus decisions and an expert review was performed to obtain a German version of RECAP. We conducted semi-standardized cognitive interviews with adults with atopic eczema (n = 7) and parents having children affected by this disease (n = 5). A “think-aloud” method was used and aspects of comprehensibility, comprehensiveness and relevance according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria were examined. Interviews were coded using qualitative content analysis. Results No particular linguistic problems were encountered during forward-backward translation. Minor wording changes were made as required. The title was adjusted to a more familiar German term of the disease (which is ‘Neurodermitis’). The recall period was rephrased from ‘over the last week’ to ‘over the last seven days’ since there was a different cultural understanding of the time frame. Regarding content validity, the items of the German RECAP were considered to be comprehensible, comprehensive and relevant for the participants and parents of affected children. The participants understood the instruction and considered the one-week recall period and the response options as appropriate. Conclusions A German version of RECAP that is linguistically equivalent to the original version is now available but further assessment of its measurement properties is needed.


Author(s):  
Michaela Gabes ◽  
Helge Knüttel ◽  
Gesina Kann ◽  
Christina Tischer ◽  
Christian J. Apfelbacher

Abstract Purpose To critically appraise, compare and summarize the quality of all existing PROMs that have been validated in hyperhidrosis to at least some extend by applying the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology. Thereby, we aim to give a recommendation for the use of PROMs in future clinical trials in hyperhidrosis. Methods We considered studies evaluating, describing or comparing measurement properties of PROMs as eligible. A systematic literature search in three big databases (MEDLINE, EMBASE and Web of Science) was performed. We assessed the methodological quality of each included study using the COSMIN Risk of Bias checklist. Furthermore, we applied predefined quality criteria for good measurement properties and finally, graded the quality of the evidence. Results Twenty-four articles reporting on 13 patient-reported outcome measures were included. Three instruments can be further recommended for use. They showed evidence for sufficient content validity and moderate- to high-quality evidence for sufficient internal consistency. The methodological assessment showed existing evidence gaps for eight other PROMs, which therefore require further validation studies to make an adequate decision on their recommendation. The Hyperhidrosis Disease Severity Measure-Axillary (HDSM-Ax) and the short-form health survey with 36 items (SF-36) were the only questionnaires not recommended for use in patients with hyperhidrosis due to moderate- to high-quality evidence for insufficient measurement properties. Conclusion Three PROMs, the Hyperhidrosis Quality of Life Index (HidroQoL), the Hyperhidrosis Questionnaire (HQ) and the Sweating Cognitions Inventory (SCI), can be recommended for use in future clinical trials in hyperhidrosis. Results obtained with these three instruments can be seen as trustworthy. Nevertheless, further validation of all three PROMs is desirable. Systematic review registration PROSPERO CRD42020170247


Author(s):  
Rebecca McKeown ◽  
David R. Ellard ◽  
Abdul-Rasheed Rabiu ◽  
Eleni Karasouli ◽  
Rebecca S. Kearney

Abstract Background Ankle fractures are painful and debilitating injuries that pose a significant burden to society and healthcare systems. Patient reported outcome measures (PROMs) are commonly used outcome measures in clinical trials of interventions for ankle fracture but there is little evidence on their validity and reliability. This systematic review aims to identify and appraise evidence for the measurement properties of ankle specific PROMs used in adults with an ankle fracture using Consensus Based Standards for the Selection of Health Measurement Instrument (COSMIN) methodology. Methods We searched MEDLINE, Embase and CINAHL online databases for evidence of measurement properties of ankle specific PROMs. Articles were included if they assessed or described the development of the PROM in adults with ankle fracture. Articles were ineligible if they used the PROM to assess the measurement properties of another instrument. Abstracts without full articles and conference proceedings were ineligible, as were articles that adapted the PROM under evaluation without any formal justification of the changes as part of a cross-cultural validation or translation process. Two reviewers completed the screening. To assess methodological quality we used COSMIN risk of bias checklist and summarised evidence using COSMIN quality criteria and a modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. Two reviewers assessed the methodological quality and extracted the data for a sample of articles. Results The searches returned a total of 377 articles. From these, six articles were included after application of eligibility criteria. These articles evaluated three PROMs: A-FORM, OMAS and AAOS. The A-FORM had evidence of a robust development process within the patient population, however lacks post-formulation testing. The OMAS showed sufficient levels of reliability, internal consistency and construct validity. The AAOS showed low quality evidence of sufficient construct validity. Conclusions There is insufficient evidence to support the recommendation of a particular PROM for use in adult ankle fracture research based on COSMIN methodology. Further validation of these outcome measures is required in order to ensure PROMs used in this area are sufficiently valid and reliable to assess treatment effects. This would enable high quality, evidenced-based management of adults with ankle fracture.


2020 ◽  
Vol 28 (1) ◽  
pp. 386-404 ◽  
Author(s):  
C. F. Davies ◽  
R. Macefield ◽  
K. Avery ◽  
J. M. Blazeby ◽  
S. Potter

Abstract Background Breast reconstruction (BR) is performed to improve outcomes for patients undergoing mastectomy. A recently developed core outcome set for BR includes six patient-reported outcomes that should be measured and reported in all future studies. It is vital that any instrument used to measure these outcomes as part of a core measurement set be robustly developed and validated so data are reliable and accurate. The aim of this systematic review is to evaluate the development and measurement properties of existing BR patient-reported outcome measures (PROMs) to inform instrument selection for future studies. Methods A PRISMA-compliant systematic review of development and validation studies of BR PROMs was conducted to assess their measurement properties. PROMs with adequate content validity were assessed using three steps: (1) the methodological quality of each identified study was assessed using the COSMIN Risk of Bias checklist; (2) criteria were applied for assessing good measurement properties; and (3) evidence was summarized and the quality of evidence assessed using a modified GRADE approach. Results Fourteen articles reported the development and measurement properties of six PROMs. Of these, only three (BREAST-Q, BRECON-31, and EORTC QLQ-BRECON-23) were considered to have adequate content validity and proceeded to full evaluation. This showed that all three PROMs had been robustly developed and validated and demonstrated adequate quality. Conclusions BREAST-Q, BRECON-31, and EORTC QLQ-BRECON-23 have been well-developed and demonstrate adequate measurement properties. Work with key stakeholders is now needed to generate consensus regarding which PROM should be recommended for inclusion in a core measurement set.


2020 ◽  
Author(s):  
Yu Heng Kwan ◽  
Si Dun Weng ◽  
Dionne Hui Fang Loh ◽  
Jie Kie Phang ◽  
Livia Jia Yi Oo ◽  
...  

BACKGROUND Medication adherence is essential for improving the health outcomes of patients. Various patient-reported outcome measures (PROMs) have been developed to measure medication adherence in patients. However, no study has summarized the psychometric properties of these PROMs to guide selection for use in clinical practice or research. OBJECTIVE This study aims to evaluate the quality of the PROMs used to measure medication adherence. METHODS This study was guided by the PRISMA (Preferred Reporting Items for Systematic Review and Meta-Analysis) guidelines. Relevant articles were retrieved from the EMBASE, PubMed, Cochrane Library, Web of Science, and CINAHL (Cumulative Index to Nursing and Allied Health Literature) databases. The PROMs were then evaluated based on the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. RESULTS A total of 121 unique medication adherence PROMs from 214 studies were identified. <i>Hypotheses testing for construct validity</i> and <i>internal consistency</i> were the most frequently assessed measurement properties. PROMs with at least a <i>moderate</i> level of evidence for ≥5 measurement properties include the Adherence Starts with Knowledge 20, Compliance Questionnaire-Rheumatology, General Medication Adherence Scale, Hill-Bone Scale, Immunosuppressant Therapy Barrier Scale, Medication Adherence Reasons Scale (MAR-Scale) revised, 5-item Medication Adherence Rating Scale (MARS-5), 9-item MARS (MARS-9), 4-item Morisky Medication Adherence Scale (MMAS-4), 8-item MMAS (MMAS-8), Self-efficacy for Appropriate Medication Adherence Scale, Satisfaction with Iron Chelation Therapy, Test of Adherence to Inhalers, and questionnaire by Voils. The MAR-Scale revised, MMAS-4, and MMAS-8 have been administered electronically. CONCLUSIONS This study identified 121 PROMs for medication adherence and provided synthesized evidence for the measurement properties of these PROMs. The findings from this study may assist clinicians and researchers in selecting suitable PROMs to assess medication adherence.


2021 ◽  
Author(s):  
Ghada Alhussein ◽  
Leontios Hadjileontiadis

BACKGROUND Osteoporosis is the fourth most common chronic disease in the world. Adopting preventative measures and effective self-management interventions help in improving bone health. Mobile health (mHealth) technologies can play a key role in osteoporosis patient care and self- management. OBJECTIVE This study presents a systematic review and meta-analysis of the currently available mHealth applications targeting osteoporosis self-management, aiming to determine the current status, gaps and challenges the future research could address, proposing appropriate recommendations. METHODS In this systematic review and meta-analysis, we searched PubMed, Scopus, EBSCO, Web of Science, and IEEExplore databases between Jan 1, 2010 and May 31, 2021, for all English publications that describe apps dedicated to or being useful for osteoporosis, targeting self-management, nutrition, physical activity, risk assessment, delivered on smartphone devices for young and older adults. In addition, a survey of all osteoporosis-related apps available in iOS and Android app stores as of May 31, 2021 was also conducted. Primary outcomes of interest were the prevention or reduction of unhealthy behaviours or improvement in healthy behaviours of the six behaviours. Outcomes were summarised in a narrative synthesis and combined using random-effects meta-analysis. RESULTS In total, 3906 unique articles were identified. Of these, 32 articles met the inclusion criteria and were reviewed in depth. The 32 studies were comprising 14 235 participants, of whom on average 69.5% were female, with a mean age of 49.8 years (SD 17.8). The app search identified 23 relevant apps for osteoporosis self-management. The meta-analysis revealed that mHealth supported interventions resulted in a significant reduction in pain (Hedge’s g -1.09, 95%CI -1.68 to -0.45) and disability (Hedge’s g -0.77, 95%CI -1.59 to 0.05). The post-treatment effect of the digital intervention was significant for physical function (Hedge’s g 2.54, 95%CI -4.08 to 4.08); yet nonsignificant for wellbeing (Hedge’s g 0.17, 95% CI -1.84 to 2.17), physical activity (Hedges’ g 0.09, 95%CI -0.59 to 0.50), anxiety (Hedge’s g -0.29, 95%CI -6.11 to 5.53), fatigue (Hedge’s g -0.34, 95%CI -5.84 to 5.16), calcium (Hedge’s g -0.05, 95%CI -0.59 to 0.50) and vitamin D (Hedge’s g 0.10, 95% CI -4.05 to 4.26) intake, and trabecular score (Hedge’s g 0.06, 95%CI -1.00 to 1.12). CONCLUSIONS Osteoporosis apps have the potential to support and improve the management of the disease and its symptoms; they also appear to be a valuable tool for patients and health professionals. However, the majority of the apps that are currently available lack clinically validated evidence of their efficacy and they most focus on a limited number of symptoms. A more holistic and personalized approach, within a co-creation design ecosystem, is needed.


Sign in / Sign up

Export Citation Format

Share Document