scholarly journals A Systematic Review Evaluating Psychometric Properties of Parent or Caregiver Report Instruments on Child Maltreatment: Part 2: Internal Consistency, Reliability, Measurement Error, Structural Validity, Hypothesis Testing, Cross-Cultural Validity, and Criterion Validity

2020 ◽  
pp. 152483802091559
Author(s):  
Sangwon Yoon ◽  
Renée Speyer ◽  
Reinie Cordier ◽  
Pirjo Aunio ◽  
Airi Hakkarainen
Keyword(s):  
Systematic Review ◽  
Child Maltreatment ◽  
Psychometric Properties ◽  
Content Validity ◽  
Public Health Issue ◽  
Global Public Health ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Patient Report Outcome ◽  
Psychometric Data

Aims: Child maltreatment (CM) is global public health issue with devastating lifelong consequences. Global organizations have endeavored to eliminate CM; however, there is lack of consensus on what instruments are most suitable for the investigation and prevention of CM. This systematic review aimed to appraise the psychometric properties (other than content validity) of all current parent- or caregiver-reported CM instruments and recommend the most suitable for use. Method: A systematic search of the CINAHL, Embase, ERIC, PsycINFO, PubMed, and Sociological Abstracts databases was performed. The evaluation of psychometric properties was conducted according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines for systematic reviews of patient-report outcome measures. Responsiveness was beyond the scope of this systematic review, and content validity has been reported on in a companion paper (Part 1). Only instruments developed and published in English were included. Results: Twenty-five studies reported on selected psychometric properties of 15 identified instruments. The methodological quality of the studies was overall adequate. The psychometric properties of the instruments were generally indeterminate or not reported due to incomplete or missing psychometric data; high-quality evidence on the psychometric properties was limited. Conclusions: No instruments could be recommended as most suitable for use in clinic and research. Nine instruments were identified as promising based on current psychometric data but would need further psychometric evidence for them to be recommended.

scholarly journals A Systematic Review Evaluating Psychometric Properties of Parent or Caregiver Report Instruments on Child Maltreatment: Part 1: Content Validity

2020 ◽  
pp. 152483801989845
Author(s):  
Sangwon Yoon ◽  
Renée Speyer ◽  
Reinie Cordier ◽  
Pirjo Aunio ◽  
Airi Hakkarainen
Keyword(s):  
Systematic Review ◽  
Child Abuse ◽  
Child Maltreatment ◽  
Psychometric Properties ◽  
Content Validity ◽  
Public Health Issue ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Caregiver Report

Aims: Child maltreatment (CM) is a serious public health issue, affecting over half of all children globally. Although most CM is perpetrated by parents or caregivers and their reports of CM is more accurate than professionals or children, parent or caregiver report instruments measuring CM have never been systematically evaluated for their content validity, the most important psychometric property. This systematic review aimed to evaluate the content validity of all current parent or caregiver report CM instruments. Methods: A systematic literature search was performed in CINAHL, Embase, ERIC, PsycINFO, PubMed, and Sociological Abstracts; gray literature was retrieved through reference checking. Eligible studies needed to report on content validity of instruments measuring CM perpetrated and reported by parents or caregivers. The quality of studies and content validity of the instruments were evaluated using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines. Results: Fifteen studies reported on the content validity of 15 identified instruments. The study quality was generally poor. The content validity of the instruments was overall sufficient, but most instruments did not provide high-quality evidence for content validity. Conclusions: Most instruments included in this review showed promising content validity. The International Society for the Prevention of Child Abuse and Neglect Child Abuse Screening Tool for use in Trial appears to be the most promising, followed by the Family Maltreatment–Child Abuse criteria. However, firm conclusions cannot be drawn due to the low quality of evidence for content validity. Further studies are required to evaluate the remaining psychometric properties for recommending parent or caregiver report CM instruments.

Instruments for Measuring Satisfaction With Physical Therapy Care: A Systematic Review

2020 ◽  
Vol 100 (9) ◽  
pp. 1690-1700
Author(s):  
Daniel Gutiérrez-Sánchez ◽  
David Pérez-Cruzado ◽  
Antonio I Cuesta-Vargas
Keyword(s):  
Systematic Review ◽  
Patient Satisfaction ◽  
Physical Therapy ◽  
Psychometric Properties ◽  
Methodological Quality ◽  
Cochrane Library ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Selection Of

Abstract Objective Several instruments to measure patient satisfaction have been developed to assess satisfaction with physical therapy care. The selection of the most appropriate instrument is very important. The purpose of this study was to identify instruments for assessing satisfaction with physical therapy care and their psychometric properties and to evaluate the methodological quality of studies on psychometric properties. Methods A systematic search was conducted in ProQuest Medline, SciELO, ProQuest PsycINFO, Theseus, Cochrane Library, and Google Scholar. Articles published from 1990 to 2019, in English and Spanish, were used as limits. This systematic review followed the Consensus-based Standards for the Selection of Health Measurement Instruments and Preferred Reporting Items for Systematic Reviews and Meta-Analyses standards. The articles were evaluated by 2 independent reviewers using the Consensus-based Standards for the Selection of Health Measurement Instruments 4-point checklist. Eighteen studies were included. Results Nine instruments were found to be specifically designed to assess satisfaction with physical therapy care. The methodological quality of the studies was “fair” for most of the psychometric characteristics analyzed (43 items), with 24 properties scored as “poor,” 5 as “good,” and 3 as “excellent.” Conclusions Different instrument characteristics—such as the scope and population with which the instrument will be used, its dimensions, the number of items, and the evidence shown in the evaluation of each psychometric property—should be considered by clinicians and researchers to decide which instrument is the best to measure the construct of patient satisfaction with physical therapy. Impact Evaluating patient satisfaction is very useful in clinical practice at the hospital, community, and primary care levels. Physical therapist clinicians and researchers can use this systematic review to select instruments whose characteristics will best measure their patients’ satisfaction with physical therapy care.

scholarly journals Psychometric properties of self-reported financial toxicity measures in cancer survivors: a systematic review protocol using COSMIN methodology

BMJ Open ◽  
2020 ◽  
Vol 10 (5) ◽  
pp. e036365
Author(s):  
Zheng Zhu ◽  
Weijie Xing ◽  
Lucylynn Lizarondo ◽  
Jian Peng ◽  
Yan Hu ◽  
...  
Keyword(s):  
Systematic Review ◽  
Cancer Survivors ◽  
Psychometric Properties ◽  
Measurement Properties ◽  
Cochrane Library ◽  
Public Healthcare ◽  
Financial Toxicity ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Patient Reported

IntroductionDue to the higher costs associated with advancements in cancer treatment and longer duration of cancer survivorship, increasing financial toxicity has become a great threat to survivors, caregivers and public healthcare systems. Since accurate and reproducible measures are prerequisites for robust results, choosing an acceptable measure with strong psychometric properties to assess financial toxicity is essential. However, a description of the psychometric properties of existing measures is still lacking. The aim of this study is to apply COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology to systematically review the content and structural validity of patient-reported outcome measures (PROMs) of financial toxicity for cancer survivors.Methods and analysisPubMed/Medline, Medline (Ovid), Embase (Ovid), CINAHL (EBSCO), Web of Science, ProQuest Dissertations and Theses, and Cochrane Library (Wiley) will be comprehensively searched from database inception to 15 November 2019. Studies that report the measurement properties of PROMs assessing financial toxicity for cancer survivors will be included. The evaluation of measurement properties, data extraction and data synthesis will be conducted according to the COSMIN methodology.Ethics and disseminationNo individual data are involved in this systematic review. The results will be disseminated to a clinical audience and policy-makers though peer-reviewed journals and conferences and will support researchers in choosing the best measure to evaluate the financial toxicity of cancer survivors.

scholarly journals A systematic review of the application and psychometric properties of the graded Wolf Motor Function Test

2019 ◽  
Vol 83 (5) ◽  
pp. 285-296
Author(s):  
Beverley Turtle ◽  
Alison Porter-Armstrong ◽  
May Stinson
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Motor Function ◽  
Keyword Search ◽  
Controlled Trial ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Clinical Measurement ◽  
Function Test ◽  
Wolf Motor Function Test

Introduction Adapted from the Wolf Motor Function Test, the graded Wolf Motor Function Test is an upper limb activity assessment for use following stroke and brain injury. The aim of this systematic review was to identify and appraise evidence where the test has been used or has undergone psychometric evaluation. Method A systematic review of five databases was conducted to identify studies reporting the graded Wolf Motor Function Test using a keyword search. Intervention and clinical measurement studies were eligible for inclusion. Data quality was assessed using the adapted Critical Appraisal Skills Programme questions and the Consensus-based Standards for the Selection of Health Measurement Instruments Risk of Bias checklist. Results Twelve studies, of mostly low quality, were included. Studies included one randomised controlled trial, 10 pre- and post-studies and one clinical measurement study. All studies involved participants following stroke. Reliability was the only measurement property assessed in two studies, which were of a ‘doubtful’ and ‘poor’ quality. Conclusion Low quality studies impede the ability of clinicians and researchers to best determine the applicability of the graded Wolf Motor Function Test to patient groups and research contexts. Further exploration of the psychometric properties of the graded Wolf Motor Function Test is recommended across stroke populations using rigorous design methods.

scholarly journals Psychometric properties of quantitative sensory testing focusing on healthy and patients with shoulder pain: a systematic review protocol

2021 ◽  
Vol 8 (3) ◽  
pp. 253
Author(s):  
Paraskevi Bilika ◽  
Konstantina Savvoulidou ◽  
Achilleas Paliouras ◽  
Zacharias Dimitriadis ◽  
Evdokia Billis ◽  
...  
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Shoulder Pain ◽  
Quantitative Sensory Testing ◽  
Somatosensory System ◽  
Cochrane Library ◽  
Sensory Testing ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Level Of Evidence

<p class="abstract"><strong>Background:</strong> Quantitative sensory testing (QST) is a battery of non-invasive psychophysical methods to assess the function of somatosensory system. Although the use of QST is widespread and several studies in patients with chronic shoulder pain have used it, the level of evidence for the psychometric properties has not been established. The aim of this protocol is to investigate, through a systematic review, the level of evidence for the psychometric properties of QST in the shoulder.</p><p class="abstract"><strong>Methods:</strong> For conducting and reporting this review the preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines and the consensus-based standards for the selection of health measurement instruments (COSMIN) guidelines will be used. Nine databases including PubMed, Medline, AMED (via EBSCO), PEDRO, Embase, Web of Science, Scopus, SportDiscus, Google Scholar and Cochrane Library will be searched for the period from their inception until September 2021. Two reviewers (BP and SK) will independently evaluate the retrieved articles (titles and abstracts) and the psychometric characteristics checklist based on the standards from the COSMIN. The modified grading of recommendations assessment, development, and evaluation (GRADE) approach will be used to assess the overall quality of the evidence.</p><p class="abstract"><strong>Conclusions: </strong>Evaluation of the level of evidence for the psychometric properties of QST in the shoulder is an essential step for evidence-based assessment in clinical practice.</p><p class="abstract"><strong>Trial registration:</strong> PROSPERO registration number is CRD42021232778.</p>

scholarly journals Treatment Outcome Measurement Instruments for Port Wine Stains: A Systematic Review of Their Measurement Properties

Dermatology ◽  
2020 ◽  
pp. 1-17
Author(s):  
M. Ingmar van Raath ◽  
Sandeep Chohan ◽  
Albert Wolkerstorfer ◽  
Chantal M.A.M. van der Horst ◽  
Jacqueline Limpens ◽  
...  
Keyword(s):  
Systematic Review ◽  
Content Validity ◽  
Outcome Measurement ◽  
Measurement Properties ◽  
Minimal Important Change ◽  
Port Wine ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Patient Reported

<b><i>Background:</i></b> A plethora of outcome measurement instruments (OMIs) are being used in port wine stain (PWS) studies. It is currently unclear how valid, responsive, and reliable these are. <b><i>Objectives:</i></b> The aim of this systematic review was to appraise the content validity and other measurement properties of OMIs for PWS treatment to identify the most appropriate instruments and future research priorities. <b><i>Methods:</i></b> This study was performed using the updated Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) methodology and adhered to PRISMA guidelines. Comprehensive searches in Medline and Embase were performed. Studies in which an OMI for PWS patients was developed or its measurement properties were evaluated were included. Two investigators independently extracted data and assessed the quality of included studies and instruments to perform qualitative synthesis of the evidence. <b><i>Results:</i></b> In total, 1,034 articles were screened, and 77 full-text articles were reviewed. A total of 8 studies were included that reported on 6 physician-reported OMIs of clinical improvement and 6 parent- or patient-reported OMIs of life impact, of which 3 for health-related quality of life and 1 for perceived stigmatization. Overall, the quality of OMI development was inadequate (63%) or doubtful (37%). Each instrument has undergone a very limited evaluation in PWS patients. No content validity studies were performed. The quality of evidence for content validity was very low (78%), low (15%), or moderate (7%), with sufficient comprehensibility, mostly sufficient comprehensiveness, and mixed relevance. No studies on responsiveness, minimal important change, and cross-cultural validity were retrieved. There was moderate- to very low-quality evidence for sufficient inter-rater reliability for some clinical PWS OMIs. Internal consistency and measurement error were indeterminate in all studies. <b><i>Conclusions:</i></b> There was insufficient evidence to properly guide outcome selection. Additional assessment of the measurement properties of OMIs is needed, preferentially guided by a core domain set tailored to PWS.

scholarly journals Apathy Measures in Older Adults and People with Dementia: A Systematic Review of Measurement Properties Using the COSMIN Methodology

2021 ◽  
pp. 1-13
Author(s):  
Clare Burgon ◽  
Sarah Elizabeth Goldberg ◽  
Veronika van der Wardt ◽  
Catherine Brewin ◽  
Rowan H. Harwood
Keyword(s):  
Systematic Review ◽  
Older Adults ◽  
Rating Scale ◽  
Measurement Properties ◽  
Evaluation Procedure ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Eligibility Criteria ◽  
People With Dementia ◽  
Patient Reported

<b><i>Background:</i></b> Apathy is highly prevalent in dementia and is also seen in mild cognitive impairment and the general population. Apathy contributes to failure to undertake daily activities and can lead to health problems or crises. It is therefore important to assess apathy. However, there is currently no gold standard measure of apathy. A comprehensive systematic review of the measurement properties of apathy scales is required. <b><i>Methods:</i></b> A systematic review was registered with PROSPERO (ID: CRD42018094390). MEDLINE, Embase, PsycINFO, and CINAHL were searched for studies that aimed to develop or assess the validity or reliability of an apathy scale in participants over 65 years, living in the community. A systematic review was conducted in line with the COnsensus-based Standards for the selection of health Measurement INstruments procedure for reviewing patient-reported outcome measures. The studies’ risk of bias was assessed, and all relevant measurement properties were assessed for quality. Results were pooled and rated using a modified Grading of Recommendations Assessment, Development, and Evaluation procedure. <b><i>Results:</i></b> Fifty-seven publications regarding 18 measures and 39 variations met the eligibility criteria. The methodological quality of individual studies ranged from inadequate to very good and measurement properties ranged from insufficient to sufficient. Similarly, the overall evidence for measurement properties ranged from very low to high quality. The Apathy Evaluation Scale (AES) and Lille Apathy Rating Scale (LARS) had sufficient content validity, reliability, construct validity, and where applicable, structural validity and internal consistency. <b><i>Conclusion:</i></b> Numerous scales are available to assess apathy, with varying psychometric properties. The AES and LARS are recommended for measuring apathy in older adults and people living with dementia. The apathy dimension of the commonly used Neuropsychiatric Inventory should be limited to screening for apathy.

scholarly journals Measuring perceived adequacy of staffing to incorporate nurses’ judgement into hospital capacity management: a scoping review

BMJ Open ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. e045245
Author(s):  
Carmen J E M van der Mark ◽  
Hester Vermeulen ◽  
Paul H J Hendriks ◽  
Catharina J van Oostveen
Keyword(s):  
Psychometric Properties ◽  
Scoping Review ◽  
Care Delivery ◽  
Hospital Setting ◽  
Workforce Planning ◽  
Nurse Staffing ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Factors Influencing

BackgroundMatching demand and supply in nursing work continues to generate debate. Current approaches focus on objective measures, such as nurses per occupied bed or patient classification. However, staff numbers do not tell the whole staffing story. The subjective measure of nurses’ perceived adequacy of staffing (PAS) has the potential to enhance nurse staffing methods in a way that goes beyond traditional workload measurement or workforce planning methods.ObjectivesTo detect outcomes associated with nurses’ PAS and the factors that influence PAS and to review the psychometric properties of instruments used to measure PAS in a hospital setting.Design and methodsA scoping review was performed to identify outcomes associated with PAS, factors influencing PAS and instruments measuring PAS. A search of PubMed, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Business Source Complete and Embase databases identified 2609 potentially relevant articles. Data were independently extracted, analysed and synthesised. The quality of studies describing influencing factors or outcomes of PAS and psychometric properties of instruments measuring PAS were assessed following the National Institute for Health and Care Excellence quality appraisal checklist and the COnsensus-based Standards for the selection of health Measurement INstruments guidelines.ResultsSixty-three studies were included, describing 60 outcomes of PAS, 79 factors influencing PAS and 21 instruments measuring PAS. In general, positive PAS was related to positive outcomes for the patient, nurse and organisation, supporting the relevance of PAS as a staffing measure. We identified a variety of factors that influence PAS, including demand for care, nurse supply and organisation of care delivery. Associations between these factors and PAS were inconsistent. The quality of studies investigating the development and evaluation of instruments measuring PAS was moderate.ConclusionsMeasuring the PAS may enhance nurse staffing methods in a hospital setting. Further work is needed to refine and psychometrically evaluate instruments for measuring PAS.

scholarly journals Patient-reported outcome measures in community-acquired pneumonia: a systematic review of application and content validity

2019 ◽  
Vol 6 (1) ◽  
pp. e000398 ◽  
Author(s):  
Melanie Lloyd ◽  
Emily Callander ◽  
Amalia Karahalios ◽  
Lucy Desmond ◽  
Harin Karunajeewa
Keyword(s):  
Outcome Measures ◽  
Content Validity ◽  
Short Form ◽  
Patient Reported Outcome Measures ◽  
Patient Reported Outcome ◽  
Community Acquired Pneumonia ◽  
Current Evidence ◽  
Measurement Instruments ◽  
Health Measurement ◽  
Patient Reported

IntroductionPatient-reported outcome measures (PROMs) are a vital component of patient-centred care. Community-acquired pneumonia (CAP) is a significant contributor to morbidity, mortality and health service costs globally, but there is a lack of consensus regarding PROMs for this condition.MethodsWe searched MEDLINE, EMBASE and Cochrane Collaboration for studies, both interventional and observational, of adult recovery from CAP that applied at least one validated PROM instrument and were published before 31 December 2017. The full text of included studies was examined and data collected on study design, PROM instruments applied, constructs examined and the demographic characteristics of the populations measured. For all CAP-specific PROM instruments identified, content validity was assessed using the COnsensus based Standards for selection of health Measurement INstruments guidelines (COSMIN).ResultsForty-two articles met the inclusion criteria and applied a total of 17 different PROM instruments including five (30%) classified as CAP specific, six (35%) as generic and six (35%) that measured functional performance or were specific to another disease. The 36-Item Short Form Survey (SF-36) was the most commonly used instrument (15 articles). Only one of 11 (9%) patient cohorts assessed using a CAP-specific instrument had a mean age ≥70 years. The CAP-Sym and CAP-BIQ questionnaires had sufficient content validity, though the quality of evidence for all CAP-specific instruments was rated as very low to low.DiscussionPROM instruments used to measure recovery from CAP are inconsistent in constructs measured and have frequently been developed and validated in highly selective patient samples that are not fully representative of the hospitalised CAP population. The overall content validity of all available CAP-specific instruments is unclear, particularly in the context of elderly hospitalised populations. Based on current evidence, generic health instruments are likely to be of greater value for measuring recovery from CAP in this group.

scholarly journals Artificial intelligence applications in social media for depression screening: A systematic review protocol for content validity processes

PLoS ONE ◽  
2021 ◽  
Vol 16 (11) ◽  
pp. e0259499
Author(s):  
Priscilla N. Owusu ◽  
Ulrich Reininghaus ◽  
Georgia Koppe ◽  
Irene Dankwa-Mullan ◽  
Till Bärnighausen
Keyword(s):  
Artificial Intelligence ◽  
Systematic Review ◽  
Social Media ◽  
Content Validity ◽  
Machine Learning Techniques ◽  
Measurement Instruments ◽  
Normative Judgment ◽  
Current Application ◽  
Randomized Controlled Studies ◽  
Secondary Outcomes

Background The popularization of social media has led to the coalescing of user groups around mental health conditions; in particular, depression. Social media offers a rich environment for contextualizing and predicting users’ self-reported burden of depression. Modern artificial intelligence (AI) methods are commonly employed in analyzing user-generated sentiment on social media. In the forthcoming systematic review, we will examine the content validity of these computer-based health surveillance models with respect to standard diagnostic frameworks. Drawing from a clinical perspective, we will attempt to establish a normative judgment about the strengths of these modern AI applications in the detection of depression. Methods We will perform a systematic review of English and German language publications from 2010 to 2020 in PubMed, APA PsychInfo, Science Direct, EMBASE Psych, Google Scholar, and Web of Science. The inclusion criteria span cohort, case-control, cross-sectional studies, randomized controlled studies, in addition to reports on conference proceedings. The systematic review will exclude some gray source materials, specifically editorials, newspaper articles, and blog posts. Our primary outcome is self-reported depression, as expressed on social media. Secondary outcomes will be the types of AI methods used for social media depression screen, and the clinical validation procedures accompanying these methods. In a second step, we will utilize the evidence-strengthening Population, Intervention, Comparison, Outcomes, Study type (PICOS) tool to refine our inclusion and exclusion criteria. Following the independent assessment of the evidence sources by two authors for the risk of bias, the data extraction process will culminate in a thematic synthesis of reviewed studies. Discussion We present the protocol for a systematic review which will consider all existing literature from peer reviewed publication sources relevant to the primary and secondary outcomes. The completed review will discuss depression as a self-reported health outcome in social media material. We will examine the computational methods, including AI and machine learning techniques which are commonly used for online depression surveillance. Furthermore, we will focus on standard clinical assessments, as indicating content validity, in the design of the algorithms. The methodological quality of the clinical construct of the algorithms will be evaluated with the COnsensus-based Standards for the selection of health status Measurement Instruments (COSMIN) framework. We conclude the study with a normative judgment about the current application of AI to screen for depression on social media. Systematic review registration International Prospective Register of Systematic Reviews PROSPERO (registration number CRD42020187874).

Sign in / Sign up

Export Citation Format

Share Document