Considerations for Evaluating and Recommending Worker Productivity Outcome Measures: An Update from the OMERACT Worker Productivity Group

2019 ◽  
Vol 46 (10) ◽  
pp. 1401-1405 ◽  
Author(s):  
Suzanne M.M. Verstappen ◽  
Diane Lacaille ◽  
Annelies Boonen ◽  
Reuben Escorpizo ◽  
Catherine Hofstetter ◽  
...  
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Outcome Measures ◽  
Worker Productivity ◽  
Single Item ◽  
Retest Reliability ◽  
Test Retest Reliability

Objective.The Outcome Measures in Rheumatology (OMERACT) Worker Productivity Group continues efforts to assess psychometric properties of measures of presenteeism.Methods.Psychometric properties of single-item and dual answer multiitem scales were assessed, as well as methods to evaluate thresholds of meaning.Results.Test-retest reliability and construct validity of single item global measures was moderate to good. The value of measuring both degree of difficulty and amount of time with difficulty in multiitems questionnaires was confirmed. Thresholds of meaning vary depending on methods and external anchors applied.Conclusion.We have advanced our understanding of the performance of presenteeism measures and have developed approaches to describing thresholds of meaning.

Validation of the Beliefs of Physical Activity among Clergy (B-PAC) Instrument

2017 ◽  
Vol 32 (2) ◽  
Author(s):  
Shannon Gwin ◽  
Paul Branscum ◽  
E. Laurette Taylor
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Retest Reliability ◽  
Reliable Instrument ◽  
The Stability ◽  
Test Retest Reliability

The purpose of this study was to create a valid and reliable instrument to evaluate theory-basedbeliefs towards physical activity among clergy members. Data were collected from 174 clergy that par-ticipated in a 15-item online and paper-based survey. Psychometric properties of the instrument includedconfirmatory factor analysis (construct validity), and cronbach’s alpha (internal consistency reliability).In addition, the stability (test-retest reliability) of each subscale was evaluated with a sub-sample of 30participants. Results show the instrument was both valid and reliable, and will be useful in future studiestargeting this population. Future implications are discussed.

Psychometric properties of patient reported outcome (PRO) instruments in patients with small cell lung cancer (SCLC) in RESILIENT part 1.

2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e24027-e24027
Author(s):  
Jaba Kokhreidze ◽  
Veleka Allen ◽  
Cristina Ivanescu ◽  
Xiaopan Valerie Yao ◽  
Bin Zhang ◽  
...  
Keyword(s):  
Lung Cancer ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Life Questionnaire ◽  
Retest Reliability ◽  
Patient Reported ◽  
Eortc Qlq ◽  
Test Retest Reliability ◽  
Pro Instruments

e24027 Background: The ongoing two-part phase 2/3 RESILIENT study (NCT03088813) is investigating the efficacy and safety of liposomal irinotecan monotherapy in patients with SCLC who have progressed on or after first line platinum-based chemotherapy. This exploratory analysis from RESILIENT part 1 was conducted to confirm the psychometric properties of established PRO instruments that had not previously been validated in patients with SCLC. Methods: Patients completed the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ) Core 30 (C30) and the EORTC QLQ Lung Cancer 13 (LC13) before treatment assignment (baseline), every 6 weeks thereafter, at treatment discontinuation and at the 30-day follow-up visit. Psychometric methods included descriptive statistics (items and scales), correlations (item-to-item and item-to-total), internal consistency (Cronbach’s α), test-retest reliability (intraclass correlation coefficient [ICC], two-way random effects model), construct validity and sensitivity to change. The analysis included patients who received at least one dose of study drug and completed at least one PRO assessment. Results: Thirty patients were enrolled in RESILIENT part 1 and included in the analysis. At baseline, 68% of patients reported ‘not severe’ or ‘mild’ symptoms. Floor effects (i.e. more than 25% of responses of ‘not at all’) were observed for several of the functioning/impact and symptom scales of the EORTC QLQ C30 and LC13. Moderate to strong correlations were found among most questionnaire items within their respective scales. Acceptable evidence for internal consistency and good test-retest reliability were observed. Selected results for the EORTC QLQ LC13, including dyspnea scales, are shown in the Table. The magnitude of correlations among PRO instruments supported evidence for convergent validity in this sample. Conclusions: In RESILIENT part 1, patients experienced low and tolerable symptoms at enrollment, limiting the potential for further improvement. Overall, these PRO instruments had acceptable psychometric properties (e.g. construct validity, reliability and ability to detect change) in this sample. However, these analyses should be repeated in a larger sample using data from RESILIENT part 2. Clinical trial information: NCT03088813. [Table: see text]

scholarly journals Expressive language sampling as a source of outcome measures for treatment studies in fragile X syndrome: feasibility, practice effects, test-retest reliability, and construct validity

2020 ◽  
Vol 12 (1) ◽  
Author(s):  
Leonard Abbeduto ◽  
Elizabeth Berry-Kravis ◽  
Audra Sterling ◽  
Stephanie Sherman ◽  
Jamie O. Edgin ◽  
...  
Keyword(s):  
Construct Validity ◽  
Outcome Measures ◽  
Symptom Severity ◽  
Fragile X ◽  
Expressive Language ◽  
Practice Effects ◽  
Full Sample ◽  
Retest Reliability ◽  
Language Sampling ◽  
Test Retest Reliability

Abstract Background The evaluation of treatment efficacy for individuals with fragile X syndrome (FXS) or intellectual disability (ID) more generally has been hampered by the lack of adequate outcome measures. We evaluated expressive language sampling (ELS) as a procedure for generating outcome measures for treatment research in FXS. We addressed: (a) feasibility, (b) practice effects over two administrations, (c) test-retest reliability over the repeated administrations, and (d) construct validity. We addressed these issues for the full sample as well as for subgroups defined by age, IQ, and ASD status. Methods Participants were 106 individuals with FXS between ages 6 and 23 years who had IQs within the range of intellectual disability (IQ < 70). ELS procedures for collecting samples in conversation and narration were followed and analyzed separately. Five measures were derived from transcripts segmented into C-units (i.e., an independent clause and its modifiers): number of C-units per minute (talkativeness), number of different word roots (vocabulary), C-unit length in morphemes (syntax), percentage of C-units containing dysfluency (utterance planning), and percentage of C-units that were fully or partly unintelligible (articulatory quality). ELS procedures were administered twice at 4-week intervals for each participant. Standardized tests and informant reports were administered and provided measures for evaluating construct validity of ELS measures. Results We found low rates of noncompliance, suggesting the task can be completed meaningfully by most individuals with FXS, although noncompliance was higher for younger, lower IQ, and more autistic participants. Minimal practice effects and strong test-retest reliability over the 4-week interval were observed for the full sample and across the range of ages, IQs, and autism symptom severity. Evidence of convergent construct validity was observed for the measures of vocabulary, syntax, and unintelligibility for the full sample and across the range of IQ and autism symptom severity, but not for participants under age 12. Conversation and narration yielded largely similar results in all analyses. Conclusions The findings suggest that the ELS procedures are feasible and yield measures with adequate psychometric properties for a majority of 6 to 23 years with FXS who have ID. The procedures work equally well regardless of level of ID or degree of ASD severity. The procedures, however, are more challenging and have somewhat less adequate psychometric properties for individuals with FXS under age 12.

Cross-cultural adaptation, validity, and reliability of the Neck OutcOme Score (NOOS-Ar) among the Saudi Arabian populace

2020 ◽  
pp. 1-10
Author(s):  
Mazen Alqahtani
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Everyday Activity ◽  
Retest Reliability ◽  
Outcome Score ◽  
Convergent Construct Validity ◽  
Test Retest Reliability

BACKGROUND: To date the Neck OutcOme Score (NOOS) was not cross-culturally adapted, validated or available in the Arabic language, although it was available in other languages. OBJECTIVE: To translate and cross-culturally adapt the Arabic version of the Neck OutcOme Score (NOOS-Ar) and study its psychometric properties. METHODS: A sample of 146 subjects with chronic neck pain filled in the NOOS-Ar questionnaire to determine the Cronbach’s alpha (α) for internal consistency, test-retest reliability by intraclass correlation coefficients(2,1) [ICC(2,1)], inter-item correlation, measurement error by coefficient of variance and minimal detectable change, ceiling and floor effects, convergent construct validity with visual analog scale (VAS) by Spearman’s rank correlation coefficient (ρ) and factor analysis to calculate and determine its psychometric properties. RESULTS: Excellent internal consistency (Cronbach’s α> 0.9) and test-retest reliability [ICC(2,1)> 0.9] were observed in NOOS-Ar. None of the five subscales of the NOOS-Ar showed a floor or ceiling effect. The coefficient of variance was generally high, but the minimal detectable change was within the acceptable range (< 30%). The ‘everyday activity and pain’ and ‘symptoms’ subscales of the NOOS-Ar, showed a moderate correlation with VAS. CONCLUSION: The NOOS-Ar is highly reliable and has a moderate to good degree of convergent construct validity with VAS with no floor or ceiling effects.

scholarly journals The Development and Psychometric Properties of the Visuospatial Working Memory Assessment (VWMA) for Children

2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Thitiya Wangkawan ◽  
Cynthia Lai ◽  
Peeraya Munkhetvit ◽  
Trevor Yung ◽  
Supaporn Chinchai
Keyword(s):  
Working Memory ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Adhd Group ◽  
Visuospatial Working Memory ◽  
Normal Children ◽  
Retest Reliability ◽  
Memory Assessment ◽  
Significant Difference ◽  
Test Retest Reliability

The visuospatial working memory plays a crucial role in the occupational performance of children including daily living and academic achievement. Unfortunately, relevant visuospatial working memory tests in the occupational therapy setting are lacking. Therefore, it is of clinical interest to develop new assessment tools in this area. The present study is aimed at summarizing the development of the visuospatial working memory assessment (VWMA) and assessing its psychometric properties. The results revealed that the score of item-objective congruence index (IOC) was 1.0 in overall items of assessment. The Cronbach alpha test confirmed that the internal consistency of VWMA showed good reliability in both types of the assessment, with the total score of computerized tests being .88 and the tabletop tests being .81. The computerized test was found to have excellent test-retest reliability with intraclass correlation coefficient (ICC) values ranging from .88 to .99. The tabletop test was found to have a fair to good test-retest reliability with the ICC values ranging from .51 to .63. As regards construct validity, the results revealed that the tasks in the computerized test identified a significant difference between the control group, normal children, and children with attention deficit/hyperactivity disorder (ADHD) group. The exception to this was the N-back task in which the independent sample t-test of computerized test ranged from 1.61 to 6.23. The results of the tabletop test revealed a significant difference between normal children and the children in the ADHD group over all tasks in which the independent sample t-test ranged from 3.05 to 8.40. In conclusion, good psychometric properties established as regards content validity, internal consistency, test-retest reliability, and construct validity provide evidence to support the position that the new VWMA is appropriate for children.

scholarly journals Translation and validation of the Croatian version of the Oral Impacts on Daily Performances (OIDP) scale

2016 ◽  
Vol 73 (9) ◽  
pp. 811-816 ◽  
Author(s):  
Vlatka Lajnert ◽  
Renata Grzic ◽  
Natasa Radica ◽  
Damir Snjaric ◽  
Stjepan Spalj
Keyword(s):  
Oral Health ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Health Impact ◽  
Retest Reliability ◽  
Validity Testing ◽  
Before And After ◽  
Test Retest Reliability ◽  
Oral Impacts

Background/Aim. Among numerous sociodental indicators the Oral Impacts on Daily Performance (OIPD) is one of the most broadly applied. The aim of this study was to develop and test psychometric properties of a Croatian version of OIDP scale. Methods. The OIDP instrument was translated from English to Croatian in a forward-backward method. The Croatian version was tested for reliability, construct validity and responsiveness on a sample of 702 participants (255 men), aged 18-86 years. Results. Internal consistency of Croatian version of the OIDP was acceptable (alpha = 0.80) and 69.4% of the examinees had oral impacts relating to one or several performances. The most frequently affected performance was eating (53.7%). The test-retest reliability was high (r = 0.99; 95% CI: 0.97-0.99), the mean difference between the OIDP summary scores in two-week interval was not statistically significant. In construct validity testing there was statistically significant correlation between OIDP and self-assessed general and oral health, somatisation, depression and Oral Health Impact Profile ranging from 0.157 to 0.516. Responsiveness was confirmed by a significant reduction of oral impacts on daily performances in subjects before and after treatment of acute dental pain (p < 0.001). Conclusion. The Croatian OIDP index showed good psychometric properties in terms of construct validity, internal consistency, test-retest reliability and responsiveness confirming its appropriateness for use among Croatian population.

Psychometric Evaluation of the Vietnamese Hemodialysis Stressor Scale

2016 ◽  
Vol 27 (3) ◽  
pp. 364-385
Author(s):  
Thi Loan Dang ◽  
Fu-Chih Lai ◽  
Yen-Kuang Lin ◽  
Kuei-Ru Chou ◽  
Nae-Fang Miao ◽  
...  
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Assessment Tool ◽  
Short Form ◽  
Psychometric Evaluation ◽  
Retest Reliability ◽  
Instrument Translation ◽  
Test Retest Reliability ◽  
Stressor Scale

The lack of a suitable assessment tool may limit optimal stress management and impair the health-related quality of life of patients undergoing hemodialysis. The purpose of the study was to examine latent constructs and psychometric properties of the Vietnamese Hemodialysis Stressor Scale (HSS-V). In total, 180 patients receiving hemodialysis were recruited. Psychometric properties of the HSS-V, including the construct validity, internal consistency, and test–retest reliability, were tested after the instrument translation. The exploratory factor analysis resulted in a 24-item HSS-V with four extracted factors, which explained 58.32% of the total variance. The construct validity was confirmed by significant negative correlations between scores on the HSS-V and Vietnamese-version Short Form-36. The internal consistency (Cronbach’s α = .82-.91) and test–retest reliability (intra-class correlations coefficient = .91-.94) of the 24-item HSS-V were satisfactory. A simple structure and preliminary acceptable psychometric properties of the HSS-V were established and can serve as a basis for further studies.

scholarly journals A Short Version of the Physical Activity Enjoyment Scale: Development and Psychometric Properties

2021 ◽  
Vol 18 (21) ◽  
pp. 11035
Author(s):  
Cheng Chen ◽  
Susanne Weyland ◽  
Julian Fritsch ◽  
Alexander Woll ◽  
Claudia Niessner ◽  
...  
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Retest Reliability ◽  
Confirmatory Factor ◽  
Test Retest Reliability ◽  
Activity Enjoyment

Objective: The purposes of this paper were to (a) develop a new short, theory-driven, version of the physical activity enjoyment scale (PACES-S) using content analysis; and (b) subsequently to measure the psychometric properties (construct validity, internal consistency, test–retest reliability, and concurrent validity) of the PACES-S for adolescents. Methods: Six experts used a four-point Likert scale to assess the content validity of each of the 16 items of the physical activity enjoyment scale according to a provided definition of physical activity enjoyment. Based on the results, exploratory factor analysis was used to analyze survey data from a longitudinal study of 182 individuals (Measure 1 of Study 1: 15.75 ± 3.39 yrs; 56.6% boys, 43.4% girls), and confirmatory factor analysis (Measure 2 of Study 1: 15.69 ± 3.44 yrs; 56.3% boys, 43.7% girls) was used to analyze the survey data from a cross-sectional study of 3219 individuals (Study 2; 15.99 ± 3.10 yrs; 47.8% boys, 52.2% girls) to assess the construct validity of the new measure. To assess the reliability, test–retest reliability was assessed in Study 1 and internal consistency in Study 1 and 2. For the concurrent validity, correlations with self-reported and device-based physical activity behavior were assessed in both studies. Results: Four out of sixteen items were selected for PACES-S. Exploratory factor analysis and confirmatory factor analyses identified and supported its factorial validity (χ2 = 53.62, df = 2, p < 0.001; RMSEA = 0.073; CFI = 0.99; RFI = 0.96; NFI = 0.99; TLI = 0.96; IFI = 0.99). Results showed good test–retest reliability (r = 0.76) and internal consistency (a = 0.82 to 0.88). Regarding concurrent validity, the results showed positive correlations with a physical activity questionnaire (Study 1: r = 0.36), with a physical activity diary (Study 1: r = 0.44), and with accelerometer-recorded data (Study 1: r = 0.32; Study 2: r = 0.21). Conclusions: The results indicate that PACES-S is a reliable and valid instrument that may be particularly useful to measure physical activity enjoyment in large-scale studies. It shows comparable measurement properties as the long version of PACES.

scholarly journals Correction to: Expressive language sampling as a source of outcome measures for treatment studies in fragile X syndrome: feasibility, practice effects, test-retest reliability, and construct validity

2020 ◽  
Vol 12 (1) ◽  
Author(s):  
Leonard Abbeduto ◽  
Elizabeth Berry-Kravis ◽  
Audra Sterling ◽  
Stephanie Sherman ◽  
Jamie O. Edgin ◽  
...  
Keyword(s):  
Construct Validity ◽  
Fragile X Syndrome ◽  
Outcome Measures ◽  
Fragile X ◽  
Expressive Language ◽  
Practice Effects ◽  
Original Publication ◽  
Retest Reliability ◽  
Language Sampling ◽  
Test Retest Reliability

In the original publication of this article [1], the author name Leonard Abbeduto was misspelled as Leonardkk Abbeduto. The original article has been corrected.

scholarly journals Cross-cultural adaptation and psychometric properties of the short version of COPSOQ II-Brazil

2021 ◽  
Vol 55 ◽  
pp. 69 ◽  
Author(s):  
Josiane Sotrate Gonçalves ◽  
Cristiane Shinohara Moriguchi ◽  
Thaís Cristina Chaves ◽  
Tatiana de Oliveira Sato
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Cultural Adaptation ◽  
Cross Cultural ◽  
Short Version ◽  
Cronbach’S Alpha ◽  
Retest Reliability ◽  
Cross Cultural Adaptation ◽  
Cronbach's Alpha ◽  
Test Retest Reliability

OBJECTIVES Translate and culturally adapt the short version of Copenhagen Psychosocial Questionnaire II (COPSOQ II) into Brazilian Portuguese (COPSOQ II-Br) and evaluate its psychometric properties. METHODS Translation and cultural adaptation followed the standardized guidelines. Structural validity was assessed using exploratory factorial analysis. Test-retest reliability was evaluated by intraclass correlation coefficient (ICC3,1) and internal consistency by Cronbach’s alpha. Floor and ceiling effect was considered acceptable if less than 15% of participants reported the lowest or highest scores. Measurement error was assessed by standard error of measurement (SEM), while construct validity was tested by correlating the COPSOQ II-Br, the Job Content Questionnaire and the Nordic Musculoskeletal Questionnaire. RESULTS The study evaluated a total of 211 civil servants and service providers in the test and 157 in the retest. After cross-cultural adaptation, the COPSOQ II-Br structure comprised seven domains and 11 dimensions. Most dimensions showed acceptable floor and ceiling effects, excepting “Work family conflicts” (floor effect of 26.1%), and “Meaning and commitment” and “Job satisfaction,” with ceiling floor of 27.5% and 22.3%, respectively. Cronbach’s alpha values reached the recommended levels (varied between 0.70 and 0.87). Test-retest reliability indicated that all dimensions had ICC between 0.71 and 0.81. SEM ranged from 0.6 to 2.2 and the construct validity showed good results with the tested instruments (significant positive and negative correlations). CONCLUSIONS All psychometric properties of the short version COPSOQ II-Br are suitable for use in Brazil. The instrument is thus validated and can be used by occupational health and human resources professionals to evaluate psychosocial working conditions.

Sign in / Sign up

Export Citation Format

Share Document