Psychometric Analysis of an Ecological Vocal Effort Scale in Individuals With and Without Vocal Hyperfunction During Activities of Daily Living

2021 ◽  
pp. 1-16
Author(s):  
Katherine L. Marks ◽  
Alessandra Verdi ◽  
Laura E. Toles ◽  
Kaila L. Stipancic ◽  
Andrew J. Ortiz ◽  
...  
Keyword(s):  
Construct Validity ◽  
Intraclass Correlation ◽  
Muscle Tension ◽  
Voice Rehabilitation ◽  
Minimal Detectable Change ◽  
Retest Reliability ◽  
Vocal Hyperfunction ◽  
Before And After ◽  
Vocal Effort ◽  
Test Retest Reliability

Objective The purpose of this study was to examine the psychometric properties of an ecological vocal effort scale linked to a voicing task. Method Thirty-eight patients with nodules, 18 patients with muscle tension dysphonia, and 45 vocally healthy control individuals participated in a week of ambulatory voice monitoring. A global vocal status question was asked hourly throughout the day. Participants produced a vowel–consonant–vowel syllable string and rated the vocal effort needed to produce the task on a visual analog scale. Test–retest reliability was calculated for a subset using the intraclass correlation coefficient, ICC(A, 1). Construct validity was assessed by (a) comparing the weeklong vocal effort ratings between the patient and control groups and (b) comparing weeklong vocal effort ratings before and after voice rehabilitation in a subset of 25 patients. Cohen's d, the standard error of measurement ( SEM ), and the minimal detectable change (MDC) assessed sensitivity. The minimal clinically important difference (MCID) assessed responsiveness. Results Test–retest reliability was excellent, ICC(A, 1) = .96. Weeklong mean effort was statistically higher in the patients than in controls ( d = 1.62) and lower after voice rehabilitation ( d = 1.75), supporting construct validity and sensitivity. SEM was 4.14, MDC was 11.47, and MCID was 9.74. Since the MCID was within the error of the measure, we must rely upon the MDC to detect real changes in ecological vocal effort. Conclusion The ecological vocal effort scale offers a reliable, valid, and sensitive method of monitoring vocal effort changes during the daily life of individuals with and without vocal hyperfunction.

The Validity, Reliability, and Responsiveness of the International Hip Outcome Tool–33 (iHOT-33) in Patients With Hip and Groin Pain Treated Without Surgery

2021 ◽  
pp. 036354652110271
Author(s):  
Mark J. Scholes ◽  
Matthew G. King ◽  
Kay M. Crossley ◽  
Denise M. Jones ◽  
Adam I. Semciw ◽  
...  
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Groin Pain ◽  
Intraclass Correlation ◽  
Minimal Detectable Change ◽  
Global Rating ◽  
Group Level ◽  
Retest Reliability ◽  
Outcome Tool ◽  
Test Retest Reliability

Background: The International Hip Outcome Tool–33 (iHOT-33) was developed to evaluate patients seeking surgery for hip and/or groin (hip/groin) pain and may not be appropriate for those seeking nonsurgical treatment. Purpose: To evaluate the psychometric properties of the iHOT-33 total (iHOT-Total) score and all subscale scores in adults with hip/groin pain who were not seeking surgery. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: Patients with hip/groin pain who were not seeking surgery were recruited from 2 ongoing studies in Australia. Semistructured one-on-one interviews assessed content validity. Construct validity was assessed by testing hypothesized correlations between iHOT-33 and Copenhagen Hip and Groin Outcome Score (HAGOS) subscale scores. Test-retest reliability was assessed in patients not undertaking treatment and who reported “no change” in their Global Rating of Change (GROC) score at 6-month follow-up. Scores were reliable at group and individual levels if intraclass correlation coefficients (ICCs) were ≥0.80 and ≥0.90, respectively. Scores were responsive if Spearman rank correlations (ρ) between the change in the iHOT-33 score and the GROC score were ≥0.40. Results: In total, 278 patients with hip/groin pain (93 women; mean age, 31 years) and 55 pain-free control participants (14 women; mean age, 29 years) were recruited. The iHOT-33 demonstrated acceptable content validity. Construct validity was acceptable, with all hypothesized strong positive correlations between iHOT-33 and HAGOS subscale scores confirmed ( r range, 0.60-0.76; P < .001), except for one correlation between the iHOT-Sport and HAGOS-Sport ( r = .058; P < .001). All scores were reliable at the group level, except for the iHOT-33 job subscale (iHOT-Job) (ICC range, 0.78-0.88 [95% CI, 0.60-0.93]). None of the subscales met the criteria for adequate reliability for use at the individual level (all ICCs <0.90). Minimal detectable change values (group level) ranged from 2.3 to 3.7 (95% CI, 1.7-5.0). All iHOT-33 subscale scores were responsive (ρ range, 0.40-0.58; P≤ .001), except for the iHOT-Job in patients not undertaking treatment (ρ = 0.27; P = .001). Conclusion: All iHOT-33 subscale scores were valid for use in patients with hip/groin pain who were not seeking surgery. Acceptable test-retest reliability was found for all subscale scores at the group level, except the iHOT-Job. All subscale scores, excluding the iHOT-Job, were responsive, regardless of undertaking physical therapist–led treatment or no treatment.

scholarly journals Cross-cultural translation and validation of the Spanish version of the patellofemoral pain and osteoarthritis subscale of the KOOS (KOOS-PF)

2021 ◽  
Vol 14 (1) ◽  
Author(s):  
Juan Pablo Martinez-Cano ◽  
Daniel Vernaza-Obando ◽  
Julián Chica ◽  
Andrés Mauricio Castro
Keyword(s):  
Intraclass Correlation ◽  
Patellofemoral Pain ◽  
Spanish Version ◽  
Minimal Detectable Change ◽  
Global Rating ◽  
Minimal Important Change ◽  
Specific Patient ◽  
Retest Reliability ◽  
Patient Reported ◽  
Test Retest Reliability

Abstract Objective The aim of this study was to translate to Spanish the patellofemoral pain and osteoarthritis subscale of the knee injury and osteoarthritis outcome score (KOOS-PF) and validate this Spanish version of a disease-specific patient-reported outcome measure (PROM) for patellofemoral pain. Results The KOOS-PF was translated to Spanish and sixty patients with patellofemoral pain and/or osteoarthritis accepted to complete the questionnaire. 1-week later 58 patients answered the questions again for the test–retest reliability validation and finally 55 patients completed 1-month later for the responsiveness assessment. The Spanish version showed very good internal consistency (Cronbach’s alpha: 0.93) and test–retest reliability (intraclass correlation coefficient: 0.82). Responsiveness was confirmed, showing a strong correlation with the global rating of change (GROC) score (r 0.64). The minimal detectable change was 11.1 points, the minimal important change was 17.2 points, and there were no floor or ceiling effects for the score.

Test–Retest Reliability of the Mini-BESTest in People With Mild to Moderate Multiple Sclerosis

2021 ◽  
Author(s):  
A Wallin ◽  
M Kierkegaard ◽  
E Franzén ◽  
S Johansson
Keyword(s):  
Multiple Sclerosis ◽  
Measurement Errors ◽  
Balance Control ◽  
Intraclass Correlation ◽  
Repeated Measurements ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Limits Of Agreement ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objective The mini-BESTest is a balance measure for assessment of the underlying physiological systems for balance control in adults. Evaluations of test–retest reliability of the mini-BESTest in larger samples of people with multiple sclerosis (MS) are lacking. The purpose of this study was to investigate test–retest reliability of the mini-BESTest total and section sum scores and individual items in people with mild to moderate overall MS disability. Methods This study used a test–retest design in a movement laboratory setting. Fifty-four people with mild to moderate overall MS disability according to the Expanded Disability Status scale (EDSS) were included, with 28 in the mild subgroup (EDSS 2.0–3.5) and 26 in the moderate subgroup (EDSS 4.0–5.5). Test–retest reliability of the mini-BESTest was evaluated by repeated measurements taken 1 week apart. Reliability and measurement error were analyzed. Results Test–retest reliability for the total scores were considered good to excellent, with intraclass correlation coefficients of .88 for the whole sample, .83 for the mild MS subgroup, and .80 for the moderate MS subgroup. Measurement errors were small, with standard error of measurement and minimal detectable change of 1.3 and 3.5, respectively, in mild MS, and 1.7 and 4.7, respectively, in moderate MS. The limits of agreement were − 3.4 and 4.6. Test–retest reliability for the section scores were fair to good or excellent; weighted kappa values ranged from .62 to .83. All items but 1 showed fair to good or excellent test–retest reliability, and percentage agreement ranged from 61% to 100%. Conclusions The mini-BESTest demonstrated good to excellent test–retest reliability and small measurement errors and is recommended for use in people with mild to moderate MS. Impact Knowledge of limits of agreement and minimal detectable change contribute to interpretability of the mini-BESTest total score. The findings of this study enhance the clinical usefulness of the test for evaluation of balance control and for designing individually customized balance training with high precision and accuracy in people with MS.

scholarly journals Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study (Preprint)

2020 ◽  
Author(s):  
Pim van Oirschot ◽  
Marco Heerings ◽  
Karine Wendrich ◽  
Bram den Teuling ◽  
Marijn B Martens ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Construct Validity ◽  
Validation Study ◽  
Intraclass Correlation ◽  
Study Participant ◽  
Smartphone App ◽  
Retest Reliability ◽  
Matched Group ◽  
Test Retest Reliability ◽  
Study Participants

BACKGROUND The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS. OBJECTIVE The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT). METHODS We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the “HC matched” group) and 58 subjects had a less intense assessment schedule to determine reference values (the “HC normative” group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT. RESULTS The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS. CONCLUSIONS The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Reliability and Validity of Turkish Myasthenia Gravis-Activities of Daily Living Scale

2020 ◽  
pp. 153944922096107
Author(s):  
Ecem Karanfil ◽  
Yeliz Salcı ◽  
Ayla Fil-Balkan ◽  
Can Ebru Bekircan-Kurt ◽  
Sevim Erdem Özdamar ◽  
...  
Keyword(s):  
Construct Validity ◽  
Myasthenia Gravis ◽  
Activities Of Daily Living ◽  
Daily Living ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Life Questionnaire ◽  
Good Test ◽  
Retest Reliability ◽  
Test Retest Reliability

Linguistic, reliable, and valid secondary efficacy measures are important in clinical settings and studies. The aim of the study is to report test–retest reliability and construct validity of Turkish version of Myasthenia Gravis-Activities of Daily Living Scale (MG-ADL-T) in Myasthenia Gravis (MG) patients. Fifty-two ocular and generalized individuals with MG, applying to rehabilitation center, were included in the study. MG-ADL-T, MG quality-of-life questionnaire (MG-QoL), MG composite (MGC), quantitative MG score (QMGS), and pulmonary function test were administered. Reliability was assessed with intraclass correlation coefficient (ICC) and Cronbach’s alpha. Spearman correlation test and receiver operating characteristic (ROC) analysis were performed for construct validity. MG-ADL-T had fair internal consistency (Cronbach’s α = .67), excellent test–retest reliability (ICC = 0.96) and moderate construct validity (MG-QoL, r = 0.59; QMGS, r = .58; MGC, r = .68). MG-ADL, a unique scale that evaluates activities of daily living (ADL), has good test–retest reliability and construct validity in Turkish MG patients.

scholarly journals 72 Test-Retest Reliability and Minimal Detectable Change for Postural Sway by using Sway Meter in Elderly Subjects

2019 ◽  
Vol 48 (Supplement_4) ◽  
pp. iv18-iv27 ◽  
Author(s):  
Kitima Rongsawad ◽  
Laddawon Worawan ◽  
Karnsiree Jirarojprapa ◽  
Sararat Kaewkham ◽  
Sarawut Khattiwong
Keyword(s):  
Clinical Relevance ◽  
Postural Stability ◽  
Postural Sway ◽  
Intraclass Correlation ◽  
Elderly Subjects ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Simple Method ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Introduction Static postural stability is the ability to maintain the posture with minimum sway. Increasing postural sway during standing in different sensory conditions is associated with aging due to decline in sensory and motor functions. Sway area measured by using sway meter is usually simple method for assessing postural stability in elderly subjects. Like many biological measurements, sway area has an intrinsic variability that affects their test-retest reliability and responsiveness of postural stability assessment. The minimal detectable change (MDC) is ability to detect smallest change beyond measurement error that reflects a reliable change. Therefore, the MDC value could provide information of clinical relevance on postural stability. The aims of this study were to determine test-retest reliability and MDC of sway area obtained from sway meter in elderly subjects. Methods Twelve healthy elderly subjects aged 60 years and above were participated in this study. The test and retest repeatability of postural sway measurements were performed twice with a 1-hour interval. For each subject was assess postural sway using Lord’s sway meter during standing on 4 sensory conditions for 30 seconds of each condition. The test-retest reliability of sway area was calculated using intraclass correlation coefficient. The MDC for each sway area was calculated to quantify clinical relevance. Results The test-retest reliability of sway area revealed good to excellent reliability ranged from 0.85 to 0.94. Standard error of measurement (SEM) and MDC ranged from 75 to 205 mm2 and 209 to 568 mm2, respectively. Discussion and Conclusion Our findings reveal that sway area in different sensory conditions could be used in assessment of postural stability in elderly subjects. SEM and MDC of sway area increased when subjects were asked to close their eyes and on foam surface. The sway meter is a reliable tool for assessing postural stability in clinical setting.

scholarly journals Psychometric of the Curiosity and Exploration Inventory-II in Indonesia

2020 ◽  
Vol 9 (3) ◽  
Author(s):  
Anggi Setyowati ◽  
Min-Huey Chung ◽  
Ah. Yusuf ◽  
Setya Haksama
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Internal Consistency ◽  
Structural Model ◽  
Intraclass Correlation ◽  
Cronbach’S Alpha ◽  
Retest Reliability ◽  
Cronbach's Alpha ◽  
Test Retest Reliability ◽  
Exploration Inventory

Background: Curiosity is a personality characteristic, which fits with wellbeing and positive functioning. The objective of this study was to assess the construct validity of the Curiosity and Exploration Inventory II (CEI-II) in Indonesia.Design and Methods: The study included 256 undergraduate students who lived in Indonesia, mean age 19.8 years old. The CEI-II measures stretching and embracing using 11 items. The English version of CEI-II was translated into Bahasa. The Cronbach’s alpha coefficient and intraclass correlation coefficient (ICC) were addressed to examine internal consistency reliability and the test-retest reliability. To evaluate construct validity, exploratory factor analysis (EFA) was used to assess factor structure and confirmatory factor analysis (CFA) was used to evaluate the structural model fit of the CEI-II Indonesia version.Results: The study showed Cronbach’s alpha for the internal consistency of the overall CEI-II Indonesia version was 0.77. The ICC for the test-retest reliability ranged between 0.753-0.829. EFA showed adequate with the Kaiser-Meyer-Olkin value of 0.86 and the Bartlett’s test of sphericity was statistically significant. CFA tested the second-order model with two-order factors and showed a model fit.Conclusions: The CEI-II Indonesia version indicated acceptable construct validity to evaluate curiosity in Indonesia.

Cross-cultural adaptation, validity, and reliability of the Neck OutcOme Score (NOOS-Ar) among the Saudi Arabian populace

2020 ◽  
pp. 1-10
Author(s):  
Mazen Alqahtani
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Everyday Activity ◽  
Retest Reliability ◽  
Outcome Score ◽  
Convergent Construct Validity ◽  
Test Retest Reliability

BACKGROUND: To date the Neck OutcOme Score (NOOS) was not cross-culturally adapted, validated or available in the Arabic language, although it was available in other languages. OBJECTIVE: To translate and cross-culturally adapt the Arabic version of the Neck OutcOme Score (NOOS-Ar) and study its psychometric properties. METHODS: A sample of 146 subjects with chronic neck pain filled in the NOOS-Ar questionnaire to determine the Cronbach’s alpha (α) for internal consistency, test-retest reliability by intraclass correlation coefficients(2,1) [ICC(2,1)], inter-item correlation, measurement error by coefficient of variance and minimal detectable change, ceiling and floor effects, convergent construct validity with visual analog scale (VAS) by Spearman’s rank correlation coefficient (ρ) and factor analysis to calculate and determine its psychometric properties. RESULTS: Excellent internal consistency (Cronbach’s α> 0.9) and test-retest reliability [ICC(2,1)> 0.9] were observed in NOOS-Ar. None of the five subscales of the NOOS-Ar showed a floor or ceiling effect. The coefficient of variance was generally high, but the minimal detectable change was within the acceptable range (< 30%). The ‘everyday activity and pain’ and ‘symptoms’ subscales of the NOOS-Ar, showed a moderate correlation with VAS. CONCLUSION: The NOOS-Ar is highly reliable and has a moderate to good degree of convergent construct validity with VAS with no floor or ceiling effects.

scholarly journals Test-retest reliability and minimal detectable change of the Balance Evaluation Systems Test and its two abbreviated versions in persons with mild to moderate spinocerebellar ataxia: A pilot study

2020 ◽  
Vol 47 (4) ◽  
pp. 479-486
Author(s):  
Yuki Kondo ◽  
Kyota Bando ◽  
Yosuke Ariake ◽  
Wakana Katsuta ◽  
Kyoko Todoroki ◽  
...  
Keyword(s):  
Spinocerebellar Ataxia ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Retest Reliability ◽  
Evaluation Systems ◽  
Intraclass Correlation Coefficients ◽  
Interclass Correlation ◽  
Test Retest Reliability

BACKGROUND: The reliability of the evaluation of the Balance Evaluation Systems Test (BESTest) and its two abbreviated versions are confirmed for balance characteristics and reliability. However, they are not utilized in cases of spinocerebellar ataxia (SCA). OBJECTIVE: We aimed to examine the test-retest reliability and minimal detectable change (MDC) of the BESTest and its abbreviated versions in persons with mild to moderate spinocerebellar ataxia. METHODS: The BESTest was performed in 20 persons with SCA at baseline and one month later. The scores of the abbreviated version of the BESTest were determined from the BESTest scores. The interclass correlation coefficient (1,1) was used as a measure of relative reliability. Furthermore, we calculated the MDC in the BESTest and its abbreviated versions. RESULTS: The intraclass correlation coefficients (1,1) and MDC at 95% confidence intervals were 0.92, 8.7(8.1%), 0.91, 4.1(14.5%), and 0.81, 5.2(21.6%) for the Balance, Mini-Balance, and Brief-Balance Evaluation Systems Tests, respectively. CONCLUSIONS: The BESTest and its abbreviated versions had high test-retest reliability. The MDC values of the BESTest could enable clinicians and researchers to interpret changes in the balance of patients with SCA more precisely.

Adaptation, Test-Retest Reliability, and Construct Validity of the Physical Activity Neighborhood Environment Scale in Nigeria (PANES-N)

2013 ◽  
Vol 10 (8) ◽  
pp. 1079-1090 ◽  
Author(s):  
Adewale L. Oyeyemi ◽  
James F. Sallis ◽  
Adetoyeje Y. Oyeyemi ◽  
Mariam M. Amin ◽  
Ilse De Bourdeaudhuij ◽  
...  
Keyword(s):  
Physical Activity ◽  
Construct Validity ◽  
Intraclass Correlation ◽  
Cognitive Testing ◽  
Neighborhood Environment ◽  
Analysis Of Covariance ◽  
Environmental Perceptions ◽  
Retest Reliability ◽  
Environment Scale ◽  
Test Retest Reliability

Background:This study adapted the Physical Activity Neighborhood Environment Scale (PANES) to the Nigerian context and assessed the test-retest reliability and construct validity of the Nigerian version (PANES-N).Methods:A multidisciplinary panel of experts adapted the original PANES to reflect the built and social environment of Nigeria. The adapted PANES was subjected to cognitive testing and test retest reliability in a diverse sample of Nigerian adults (N = 132) from different neighborhood types. Intraclass Correlation Coefficients (ICC) was used to assess test-retest reliability, and construct validity was investigated with Analysis of Covariance for differences in environmental attributes between neighborhoods.Results:Four of the 17 items on the original PANES were significantly modified, 3 were removed and 2 new items were incorporated into the final version of adapted PANES-N. Test-retest reliability was substantial to almost perfect (ICC = 0.62–1.00) for all items on the PANES-N, and residents of neighborhoods in the inner city reported higher residential density, land use mix and safety, but lower pedestrian facilities and aesthetics than did residents of government reserved area/new layout neighborhoods.Conclusion:The PANES-N appears promising for assessing environmental perceptions related to physical activity in Nigeria, but further testing is required to assess its applicability across Africa.

Sign in / Sign up

Export Citation Format

Share Document