A systematic review of tools designed for teacher proxy-report of children’s physical literacy or constituting elements

Abstract Background Physical literacy (PL) in childhood is essential for a healthy active lifestyle, with teachers playing a critical role in guiding its development. Teachers can assist children to acquire the skills, confidence, and creativity required to perform diverse movements and physical activities. However, to detect and directly intervene on the aspects of children’s PL that are suboptimal, teachers require valid and reliable measures. This systematic review critically evaluates the psychometric properties of teacher proxy-report instruments for assessing one or more of the 30 elements within the four domains (physical, psychological, cognitive, social) of the Australian Physical Literacy Framework (APLF), in children aged 5–12 years. Secondary aims were to: examine alignment of each measure (and relevant items) with the APLF and provide recommendations for teachers in assessing PL. Methods Seven electronic databases (Academic Search Complete, CINAHL Complete, Education Source, Global Health, MEDLINE Complete, PsycINFO, and SPORTDiscus) were systematically searched originally in October 2019, with an updated search in April 2021. Eligible studies were peer-reviewed English language publications that sampled a population of children with mean age between 5 and 12 years and focused on developing and evaluating at least one psychometric property of a teacher proxy-report instrument for assessing one or more of the 30 APLF elements. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidance was followed for the conduct and reporting of this review. The methodological quality of included studies and quality of psychometric properties of identified tools were evaluated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidance. Alignment of each measure (and relevant items) with the APLF domains and 30 elements was appraised. Results Database searches generated 61,412 citations; reduced to 41 studies that evaluated the psychometric properties of 24 teacher proxy-report tools. Six tools were classified as single domain measures (i.e. assessing a single domain of the APLF), eleven as dual-domain measures, and seven as tri-domain measures. No single tool captured all four domains and 30 elements of the APLF. Tools contained items that aligned with all physical, psychological, and social elements; however, four cognitive elements were not addressed by any measure. No tool was assessed for all nine psychometric properties outlined by COSMIN. Included studies reported a median of 3 out of nine psychometric properties. Most reported psychometric properties were construct validity (n = 32; 78% of studies), structural validity (n = 26; 63% of studies), and internal consistency (n = 25; 61% of studies). There was underreporting of content validity, cross-cultural validity, measurement error, and responsiveness. Psychometric data across tools were mostly indeterminate for construct validity, structural validity, and internal consistency. Conclusions There is limited evidence to fully support the use of a specific teacher proxy-report tool in practice. Further psychometric testing and detailed reporting of methodological aspects in future validity and reliability studies is needed. Tools have been designed to assess some elements of the framework. However, no comprehensive teacher proxy-report tool exists to assess all 30 elements of the APLF, demonstrating the need for a new tool. It is our recommendation that such tools be developed and psychometrically tested. Trial registration This systematic review was registered in the PROSPERO international prospective register of systematic reviews, with registration number CRD42019130936.

Download Full-text

The quality of mental health literacy measurement tools evaluating the stigma of mental illness: a systematic review

Epidemiology and Psychiatric Sciences ◽

10.1017/s2045796017000178 ◽

2017 ◽

Vol 27 (5) ◽

pp. 433-462 ◽

Cited By ~ 4

Author(s):

Y. Wei ◽

P. McGrath ◽

J. Hayden ◽

S. Kutcher

Keyword(s):

Mental Health ◽

Systematic Review ◽

Mental Illness ◽

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Level Of Evidence ◽

Measurement Tools ◽

Stigma Of Mental Illness

Aims.Stigma of mental illness is a significant barrier to receiving mental health care. However, measurement tools evaluating stigma of mental illness have not been systematically assessed for their quality. We conducted a systematic review to critically appraise the methodological quality of studies assessing psychometrics of stigma measurement tools and determined the level of evidence of overall quality of psychometric properties of included tools.Methods.We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library and ERIC databases for eligible studies. We conducted risk-of-bias analysis with the Consensus-based Standards for the Selection of Health Measurement Instruments checklist, rating studies as excellent, good, fair or poor. We further rated the level of evidence of the overall quality of psychometric properties, combining the study quality and quality of each psychometric property, as: strong, moderate, limited, conflicting or unknown.Results.We identified 117 studies evaluating psychometric properties of 101 tools. The quality of specific studies varied, with ratings of: excellent (n = 5); good (mostly on internal consistency (n = 67)); fair (mostly on structural validity, n = 89 and construct validity, n = 85); and poor (mostly on internal consistency, n = 36). The overall quality of psychometric properties also varied from: strong (mostly content validity, n = 3), moderate (mostly internal consistency, n = 55), limited (mostly structural validity, n = 55 and construct validity, n = 46), conflicting (mostly test–retest reliability, n = 9) and unknown (mostly internal consistency, n = 36).Conclusions.We identified 12 tools demonstrating limited evidence or above for (+, ++, +++) all their properties, 69 tools reaching these levels of evidence for some of their properties, and 20 tools that did not meet the minimum level of evidence for all of their properties. We note that further research on stigma tool development is needed to ensure appropriate application.

Download Full-text

459 - Psychometric properties of the Geriatric Anxiety Inventory : A systematic review

International Psychogeriatrics ◽

10.1017/s1041610220003117 ◽

2020 ◽

Vol 32 (S1) ◽

pp. 180-180

Author(s):

Philippe Landreville ◽

Alexandra Champagne ◽

Patrick Gosselin

Keyword(s):

Systematic Review ◽

Psychometric Properties ◽

Internal Consistency ◽

Methodological Quality ◽

The Body ◽

Self Report ◽

Test Reliability ◽

Cosmin Checklist ◽

Validity Indices

Background.The Geriatric Anxiety Inventory (GAI) is a widely used self-report measure of anxiety symptoms in older adults. Much research has been conducted on the psychometric properties of the GAI in various populations and using different language versions. Previous reviews of this literature have examined only a small proportion of studies in light of the body of research currently available and have not evaluated the methodological quality of this research. We conducted a systematic review of the psychometric properties of the GAI.Method.Relevant studies (N = 30) were retrieved through a search of electronic databases (Pubmed, PsycINFO, CINAHL, EMBASE and Google Scholar) and a hand search. The methodological quality of the included studies was assessed by two independent reviewers using the ‘‘COnsensusbased Standards for the selection of health status Measurement INstruments’’ (COSMIN) checklist.Results.Based on the COSMIN checklist, internal consistency and test reliability were mostly rated as poorly assessed (62.1% and 70% of studies, respectively) and quality of studies examining structural validity was mostly fair (60% of studies). The GAI showed adequate internal consistency and test-retest reliability. Convergent validity indices were highest with measures of generalized anxiety and lowest with instruments that include somatic symptoms. A substantial overlap with measures of depression was reported. While there was no consensus on the factorial structure of the GAI, several studies found it to be unidimensional.Conclusions.The GAI presents satisfactory psychometric properties. However, future efforts should aim to achieve a higher degree of methodological quality.

Download Full-text

Measuring implementation outcomes: An updated systematic review of measures’ psychometric properties

Implementation Research and Practice ◽

10.1177/2633489520936644 ◽

2020 ◽

Vol 1 ◽

pp. 263348952093664 ◽

Cited By ~ 1

Author(s):

Kayne Mettert ◽

Cara Lewis ◽

Caitlin Dorsey ◽

Heather Halko ◽

Bryan Weiner

Keyword(s):

Systematic Review ◽

Health Care ◽

Psychometric Properties ◽

Behavioral Health ◽

Internal Consistency ◽

Behavioral Health Care ◽

Research And Practice ◽

Implementation Outcomes ◽

New Treatment

Background: Systematic reviews of measures can facilitate advances in implementation research and practice by locating reliable and valid measures and highlighting measurement gaps. Our team completed a systematic review of implementation outcome measures published in 2015 that indicated a severe measurement gap in the field. Now, we offer an update with this enhanced systematic review to identify and evaluate the psychometric properties of measures of eight implementation outcomes used in behavioral health care. Methods: The systematic review methodology is described in detail in a previously published protocol paper and summarized here. The review proceeded in three phases. Phase I, data collection, involved search string generation, title and abstract screening, full text review, construct assignment, and measure forward searches. Phase II, data extraction, involved coding psychometric information. Phase III, data analysis, involved two trained specialists independently rating each measure using PAPERS (Psychometric And Pragmatic Evidence Rating Scales). Results: Searches identified 150 outcomes measures of which 48 were deemed unsuitable for rating and thus excluded, leaving 102 measures for review. We identified measures of acceptability ( N = 32), adoption ( N = 26), appropriateness ( N = 6), cost ( N = 31), feasibility ( N = 18), fidelity ( N = 18), penetration ( N = 23), and sustainability ( N = 14). Information about internal consistency and norms were available for most measures (59%). Information about other psychometric properties was often not available. Ratings for internal consistency and norms ranged from “adequate” to “excellent.” Ratings for other psychometric properties ranged mostly from “poor” to “good.” Conclusion: While measures of implementation outcomes used in behavioral health care (including mental health, substance use, and other addictive behaviors) are unevenly distributed and exhibit mostly unknown psychometric quality, the data reported in this article show an overall improvement in availability of psychometric information. This review identified a few promising measures, but targeted efforts are needed to systematically develop and test measures that are useful for both research and practice. Plain language abstract: When implementing an evidence-based treatment into practice, it is important to assess several outcomes to gauge how effectively it is being implemented. Outcomes such as acceptability, feasibility, and appropriateness may offer insight into why providers do not adopt a new treatment. Similarly, outcomes such as fidelity and penetration may provide important context for why a new treatment did not achieve desired effects. It is important that methods to measure these outcomes are accurate and consistent. Without accurate and consistent measurement, high-quality evaluations cannot be conducted. This systematic review of published studies sought to identify questionnaires (referred to as measures) that ask staff at various levels (e.g., providers, supervisors) questions related to implementation outcomes, and to evaluate the quality of these measures. We identified 150 measures and rated the quality of their evidence with the goal of recommending the best measures for future use. Our findings suggest that a great deal of work is needed to generate evidence for existing measures or build new measures to achieve confidence in our implementation evaluations.

Download Full-text

A Systematic Review of the Psychometric Properties of the Geriatric Anxiety Inventory

Innovation in Aging ◽

10.1093/geroni/igaa057.1185 ◽

2020 ◽

Vol 4 (Supplement_1) ◽

pp. 368-368

Author(s):

Philippe Landreville ◽

Alexandra Champagne ◽

Patrick Gosselin

Keyword(s):

Systematic Review ◽

Psychometric Properties ◽

Internal Consistency ◽

Methodological Quality ◽

Short Form ◽

Self Report ◽

Test Reliability ◽

Cosmin Checklist ◽

Validity Indices

Abstract The Geriatric Anxiety Inventory (GAI) is a widely used self-report measure of anxiety symptoms in older adults. Although much research has been conducted on the psychometric properties of the GAI, previous reviews have examined only a small proportion of studies and have not evaluated the methodological quality of this work. In view of this, we conducted a systematic review of the psychometric properties of the GAI and it’s short form (GAI-SF). Relevant studies (N = 31) were retrieved through a search of electronic databases (Pubmed, PsycINFO, CINAHL, EMBASE and Google Scholar) and a hand search. The methodological quality of the included studies was assessed by two independent reviewers using the ‘‘COnsensus-based Standards for the selection of health status Measurement INstruments’’ (COSMIN) checklist. Based on the COSMIN checklist, internal consistency and test reliability were mostly rated as poorly assessed (63% and 72.7% of studies, respectively) and quality of studies examining structural validity was mostly fair (60% of studies). Both the GAI and GAI-SF showed adequate internal consistency and test-retest reliability. Convergent validity indices were highest with measures of generalized anxiety and lowest with instruments that include somatic symptoms. Substantial overlap with measures of depression was reported. While there is no consensus on the factorial structure of the GAI, the short version was found to be unidimensional. Our review therefore suggests that the GAI and GAI-SF have satisfactory psychometric properties while indicating that future efforts should aim to achieve a higher degree of methodological quality.

Download Full-text

Quality of life of children and adolescents with visual impairment

British Journal of Visual Impairment ◽

10.1177/0264619617737123 ◽

2018 ◽

Vol 36 (1) ◽

pp. 42-56 ◽

Cited By ~ 1

Author(s):

Olivete Oliveira ◽

Célia Ribeiro ◽

Cristina Simões ◽

Paulo Pereira

Keyword(s):

Quality Of Life ◽

Construct Validity ◽

Visual Impairment ◽

Conceptual Framework ◽

Psychometric Properties ◽

Children And Adolescents ◽

Internal Consistency ◽

Low Vision ◽

The Mean

The conceptual framework of quality of life (QOL) have received considerable attention within students with visual impairment. The main purpose of this study was to analyse the QOL of children and adolescents with low vision and blindness. Data were collected from 18 children and adolescents, and respective parents ( n = 18). QOL was assessed by the KIDSCREEN 52 questionnaire. Cronbach’s alpha and correlations were calculated to examine the psychometric properties of the scale in the visual impairment field. The scale showed suitable internal consistency and construct validity. The findings highlighted that the mean scores were higher in participants with low vision, in male group, and in children. Furthermore, children and adolescents reported higher scores regarding their QOL than their parents. The results emphasized the importance of collecting information from the person about his or her own life to know the personal outcomes, as well as the perception of their parents.

Download Full-text

P487 Development and validation of a new patient-reported outcome measure for Crohn’s perianal fistula: Crohn’s anal fistula quality-of-life (CAF-QoL) scale

Journal of Crohn s and Colitis ◽

10.1093/ecco-jcc/jjz203.616 ◽

2020 ◽

Vol 14 (Supplement_1) ◽

pp. S428-S428

Author(s):

S Adegbola ◽

L Dibley ◽

K Sahnan ◽

P Tozer ◽

T Wade ◽

...

Keyword(s):

Quality Of Life ◽

Systematic Review ◽

Construct Validity ◽

Anal Fistula ◽

Internal Consistency ◽

Perianal Fistula ◽

Specific Patient ◽

Perianal Fistulas ◽

Patient Reported

Abstract Background Crohn’s perianal fistulas are challenging for patients and clinicians. Many do not respond to available treatments, and despite recommendations by a recent global consensus, there are currently no specific patient-derived quality of life (QoL) tools to measure outcomes including response to treatment, in patients with Crohn’s perianal fistulas. Exploratory qualitative work has demonstrated that Crohn’s perianal fistulas reduce QoL far beyond restricting daily and sexual activities, and a patient-centred, patient-derived tool is needed. We present a patient-reported outcomes measure (PROM) for this complicated disease phenotype. Methods A 35 item draft questionnaire was generated using information from: (a) unstructured qualitative patient interviews, exploring the experience of living with Crohn’s perianal fistulas; (b) a consensus exercise analysing outcomes from a systematic review of studies assessing medical, surgical and combined (medical/surgical) treatment of Crohn’s perianal fistula; and (c) a patient and public involvement meeting. Psychometric properties were assessed including construct validity (by comparison with the Hospital Anxiety and Depression Scale, HADS and the United Kingdom version of the Inflammatory Bowel Disease Questionnaire, UK-IBDQ), and reliability and responsiveness assessed by test-retest analysis. Results Data from 211 patients contributed to the development of the CAF-QoL scale, following the collation of items including patient experience interviews, a systematic review and a consensus exercise involving 187 stakeholders (patients, gastroenterologists, surgeons, IBD specialist nurses, radiologists). Internal consistency was good with Cronbach’s α of 0.88. Analysis aided reduction of the questionnaire to 26 items that demonstrated good internal consistency, good stability (intra-class correlation 0.98) and good construct validity and responsiveness with positive correlation with the UK IBDQ and HADS. Conclusion A disease-specific PROM to assess clinical outcome (i.e. QoL) as baseline and following interventions in patients with Crohn’s anal fistula—the CAF-QoL—is ready for use. Translation and cross-cultural validation will aid wider international dissemination.

Download Full-text

Translation and validation of the Uterine Fibroid Symptom and Quality of Life (UFS-QOL) questionnaire for the Brazilian Portuguese language

Sao Paulo Medical Journal ◽

10.1590/1516-3180.2016.0223281016 ◽

2017 ◽

Vol 135 (2) ◽

pp. 107-115 ◽

Cited By ~ 1

Author(s):

Luiz Gustavo Oliveira Brito ◽

Daniela Alves Malzone-Lott ◽

Mayra Fernanda Sandoval Fagundes ◽

Pedro Sérgio Magnani ◽

Mariana Alves Fernandes Arouca ◽

...

Keyword(s):

Quality Of Life ◽

Construct Validity ◽

Internal Consistency ◽

Uterine Fibroid ◽

Brazilian Portuguese ◽

Control Group ◽

Structural Validity ◽

Symptom Intensity ◽

Good Internal Consistency

ABSTRACT CONTEXT AND OBJECTIVE: Uterine fibroids (UF), also known as leiomyomas, are the most prevalent gynecological tumors. The Uterine Fibroid Symptoms and Quality of Life (UFS-QOL) is the only specific questionnaire that assesses symptom intensity and quality-of-life issues for women with symptomatic UF; however, it only exists in the English language. Thus, we aimed to translate and culturally validate the UFS-QOL questionnaire for the Brazilian Portuguese language. DESIGN AND SETTING: Cross-sectional study, Department of Gynecology and Obstetrics, FMRP-USP. METHODS: 113 patients with UF (case group) and 55 patients without UF (control group) were interviewed using the UFS-QOL questionnaire after translation and cultural adaptation. The Short Form-36 questionnaire was used as a control. Demographic and psychometric variables were analyzed. RESULTS: Women with UF presented higher mean age, body mass index, weight, parity and comorbidities than the control group (P < 0.05). The most prevalent complaints were abnormal uterine bleeding (93.8%), pelvic pain (36.3%) and extrinsic compression (10.6%) and these presented adequate construct validity regarding UFS-QOL severity (P < 0.05). The UFS-QOL questionnaire presented good internal consistency regarding symptom severity and quality-of-life-related domains (intraclass correlation coefficient, ICC = 0.82/0.88). Structural validity presented correlation coefficients ranging from 0.59 to 0.91. Test-retest comparison did not show differences among the UFS-QOL subscales. After treatment, women with UF presented improvements on all subscales. CONCLUSION: The UFS-QOL questionnaire presented adequate translation to the Brazilian Portuguese language, with good internal consistency, discriminant validity, construct validity, structural validity and responsiveness, along with adequate test-retest results.

Download Full-text

Psychometric properties of the external Housing-Related Control Belief Questionnaire among people with Parkinson’s disease

Aging Clinical and Experimental Research ◽

10.1007/s40520-020-01477-4 ◽

2020 ◽

Vol 32 (12) ◽

pp. 2639-2647 ◽

Cited By ~ 1

Author(s):

Nilla Andersson ◽

Maria H. Nilsson ◽

Björn Slaug ◽

Frank Oswald ◽

Susanne Iwarsson

Keyword(s):

Parkinson’S Disease ◽

Parkinson's Disease ◽

Construct Validity ◽

Data Quality ◽

Psychometric Properties ◽

Internal Consistency ◽

Control Beliefs ◽

Control Belief ◽

Structural Validity ◽

Ceiling Effects

Abstract Background Housing-related control beliefs are associated with aspects of health among older people in general. Research on Parkinson’s disease (PD) focusing on perceptions of the home are rare and instruments capturing perceived aspects of home have seldom been used. Aims To evaluate psychometric properties of the external Housing-related Control Beliefs Questionnaire (HCQ) among people with PD. Methods The external HCQ were administrated to 245 participants with PD, (mean age = 69.9 years; mean PD duration = 9.7 years). External HCQ has 16-items, with five response options. The psychometric properties evaluated were data quality, structural validity (factor analysis), floor and ceiling effects, corrected item total correlations, internal consistency and construct validity (testing correlations with relevant constructs according to pre-defined hypotheses). Results Data quality was high. Structural validity showed a unidimensional construct with removal of two items. Homogeneity was questionable, but strengthened after the removal of the two items. For the 14-item version internal consistency was α = 0.78 and SEM 4.47. Corrected item total correlation ranged between 0.31 and 0.54 and no floor or ceiling effects. Significant correlations with relevant constructs supported the construct validity. Conclusions Taken together, the psychometric results suggest a 14-item version of the external HCQ to be sufficiently reliable and valid for use in the PD population. The results pave the way for further studies, using the HCQ to analyse how perceptions of control of the home may be associated with health among people ageing with PD.

Download Full-text

A Systematic Review Approach to Find Robust Items of the Zimbardo Time Perspective Inventory

Frontiers in Psychology ◽

10.3389/fpsyg.2021.627578 ◽

2021 ◽

Vol 12 ◽

Author(s):

Chunhua Peng ◽

Caizhen Yue ◽

Andrew Avitt ◽

Youguo Chen

Keyword(s):

Systematic Review ◽

Older Adults ◽

Social Science ◽

Psychometric Properties ◽

Internal Consistency ◽

Time Perspective ◽

Structural Validity ◽

Short Forms ◽

Frequent Items ◽

Short Versions

The Zimbardo Time Perspective Inventory (ZTPI) is one of the most well-known and widely used measures of time perspective. Various short versions were proposed to resolve the psychometric problems of the ZTPI. The present study conducted a systematic review to obtain 25 short versions, calculated the frequency of each item of the ZTPI in short versions, and hypothesized that the more frequent the item is, the more robust it becomes. The hypothesis was tested by assessing the structural validity and internal consistency of short forms with high, medium, and low frequent items in Chinese samples (575 children, 407 undergraduates, and 411 older adults). Structural validity and internal consistency analyses showed that the form with more frequent items had better psychometric properties; item frequencies were positively correlated with factor loadings. The results suggest that the systematic review is an effective approach to identify the robust items of the ZTPI. This approach is general and can be the basis to improve the psychometric properties of scales in social science.

Download Full-text

Psychometric Evaluation of Two Short Versions of the Revised Child Anxiety and Depression Scale

10.21203/rs.2.13956/v1 ◽

2019 ◽

Author(s):

Leonie Klaufus ◽

Eva Verlinden ◽

Marcel van der Wal ◽

Mia Kösters ◽

Pim Cuijpers ◽

...

Keyword(s):

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Child Anxiety ◽

Depression Scale ◽

Anxiety Scale ◽

Anxiety And Depression ◽

Structural Validity ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Background Anxiety and depression are common in children and adolescents. These disorders can be detected via self-report screening questionnaires in a non-clinical setting like the school environment. Two short versions of the Revised Child Anxiety and Depression Scale (i.e., RCADS-25 and RCADS-20) seem to be feasible for administering in schools. However, it should be examined whether its promising psychometric properties can be replicated and whether knowledge on remaining psychometric properties can be added. This study evaluates the psychometric properties of the RCADS-25 and RCADS-20 used as screening instruments for anxiety and depression in schoolchildren and adolescents. Methods The RCADS-25 was completed by 69,487 schoolchildren and adolescents age 8 to 18 years. The RCADS-25/RCADS-20 broad anxiety scale (15 items), the RCADS-25 major depressive disorder (MDD) scale (10 items), and the RCADS-20 MDD scale (5 items) were assessed on construct validity (structural validity and hypotheses testing), reliability (internal consistency and test-retest reliability), and criterion validity in conformance with internationally consensus-based COSMIN definitions, taxonomy and quality criteria. Results The RCADS-25/RCADS-20 broad anxiety scale demonstrated a sufficient structural validity (CFI = 0.98, TLI = 0.99, RMSEA = 0.03, SRMR = 0.03), internal consistency (alpha = 0.82), test-retest reliability (ICC = 0.73), criterion validity (AUC = 0.79), and all four hypotheses concerning construct validity were confirmed. The RCADS-25 MDD scale demonstrated a sufficient test-retest reliability (ICC=0.70), and three out of four hypotheses testing construct validity were confirmed, but its structural validity was suspect (CFI = 0.89, TLI = 0.94, RMSEA = 0.09, SRMR = 0.06). The RCADS-20 MDD scale demonstrated a sufficient structural validity (CFI = 0.97, TLI = 0.97, RMSEA = 0.08, SRMR = 0.04) and internal consistency (alpha = 0.72), but two out of four hypotheses concerning construct validity were confirmed, while the test-retest reliability (ICC = 0.60) seemed insufficient. Conclusions The RCADS-25/RCADS-20 broad anxiety scale seems valid and reliable for screening schoolchildren and adolescents, but the RCADS-25 and RCADS-20 MDD scales show shortcomings. An MDD scale of seven items that showed acceptable psychometric properties is recommended.

Download Full-text