Reliability of the performance-based measure of executive functions in people with schizophrenia

Abstract Background The Performance-based measure of Executive Functions (PEF) with four domains is designed to assess executive functions in people with schizophrenia. The purpose of this study was to examine the test-retest reliability of the PEF administered by the same rater (intra-rater agreement) and by different raters (inter-rater agreement) in people with schizophrenia and to estimate the values of minimal detectable change (MDC) and MDC%. Methods Two convenience samples (each sample, n = 60) with schizophrenia were conducted two assessments (two weeks apart). The intraclass correlation coefficient (ICC) was analyzed to examine intra-rater and inter-rater agreements of the test-retest reliability of the PEF. The MDC was calculated through standard error of measurement. Results For the intra-rater agreement study, the ICC values of the four domains were 0.88–0.92. The MDC (MDC%) of the four domains (volition, planning, purposive action, and perfromance effective) were 13.0 (13.0%), 12.2 (16.4%), 16.2 (16.2%), and 16.3 (18.8%), respectively. For the inter-rater agreement study, the ICC values of the four domains were 0.82–0.89. The MDC (MDC%) were 15.8 (15.8%), 17.4 (20.0%), 20.9 (20.9%), and 18.6 (18.6%) for the volition, planning, purposive action, and performance effective domains, respectively. Conclusions The PEF has good test-retest reliability, including intra-rater and inter-rater agreements, for people with schizophrenia. Clinicians and researchers can use the MDC values to verify whether an individual with schizophrenia shows any real change (improvement or deterioration) between repeated PEF assessments by the same or different raters.

Download Full-text

Cross-cultural translation and validation of the Spanish version of the patellofemoral pain and osteoarthritis subscale of the KOOS (KOOS-PF)

BMC Research Notes ◽

10.1186/s13104-021-05619-3 ◽

2021 ◽

Vol 14 (1) ◽

Author(s):

Juan Pablo Martinez-Cano ◽

Daniel Vernaza-Obando ◽

Julián Chica ◽

Andrés Mauricio Castro

Keyword(s):

Intraclass Correlation ◽

Patellofemoral Pain ◽

Spanish Version ◽

Minimal Detectable Change ◽

Global Rating ◽

Minimal Important Change ◽

Specific Patient ◽

Retest Reliability ◽

Patient Reported ◽

Test Retest Reliability

Abstract Objective The aim of this study was to translate to Spanish the patellofemoral pain and osteoarthritis subscale of the knee injury and osteoarthritis outcome score (KOOS-PF) and validate this Spanish version of a disease-specific patient-reported outcome measure (PROM) for patellofemoral pain. Results The KOOS-PF was translated to Spanish and sixty patients with patellofemoral pain and/or osteoarthritis accepted to complete the questionnaire. 1-week later 58 patients answered the questions again for the test–retest reliability validation and finally 55 patients completed 1-month later for the responsiveness assessment. The Spanish version showed very good internal consistency (Cronbach’s alpha: 0.93) and test–retest reliability (intraclass correlation coefficient: 0.82). Responsiveness was confirmed, showing a strong correlation with the global rating of change (GROC) score (r 0.64). The minimal detectable change was 11.1 points, the minimal important change was 17.2 points, and there were no floor or ceiling effects for the score.

Download Full-text

Test–Retest Reliability of the Mini-BESTest in People With Mild to Moderate Multiple Sclerosis

Physical Therapy ◽

10.1093/ptj/pzab045 ◽

2021 ◽

Author(s):

A Wallin ◽

M Kierkegaard ◽

E Franzén ◽

S Johansson

Keyword(s):

Multiple Sclerosis ◽

Measurement Errors ◽

Balance Control ◽

Intraclass Correlation ◽

Repeated Measurements ◽

Minimal Detectable Change ◽

Detectable Change ◽

Limits Of Agreement ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objective The mini-BESTest is a balance measure for assessment of the underlying physiological systems for balance control in adults. Evaluations of test–retest reliability of the mini-BESTest in larger samples of people with multiple sclerosis (MS) are lacking. The purpose of this study was to investigate test–retest reliability of the mini-BESTest total and section sum scores and individual items in people with mild to moderate overall MS disability. Methods This study used a test–retest design in a movement laboratory setting. Fifty-four people with mild to moderate overall MS disability according to the Expanded Disability Status scale (EDSS) were included, with 28 in the mild subgroup (EDSS 2.0–3.5) and 26 in the moderate subgroup (EDSS 4.0–5.5). Test–retest reliability of the mini-BESTest was evaluated by repeated measurements taken 1 week apart. Reliability and measurement error were analyzed. Results Test–retest reliability for the total scores were considered good to excellent, with intraclass correlation coefficients of .88 for the whole sample, .83 for the mild MS subgroup, and .80 for the moderate MS subgroup. Measurement errors were small, with standard error of measurement and minimal detectable change of 1.3 and 3.5, respectively, in mild MS, and 1.7 and 4.7, respectively, in moderate MS. The limits of agreement were − 3.4 and 4.6. Test–retest reliability for the section scores were fair to good or excellent; weighted kappa values ranged from .62 to .83. All items but 1 showed fair to good or excellent test–retest reliability, and percentage agreement ranged from 61% to 100%. Conclusions The mini-BESTest demonstrated good to excellent test–retest reliability and small measurement errors and is recommended for use in people with mild to moderate MS. Impact Knowledge of limits of agreement and minimal detectable change contribute to interpretability of the mini-BESTest total score. The findings of this study enhance the clinical usefulness of the test for evaluation of balance control and for designing individually customized balance training with high precision and accuracy in people with MS.

Download Full-text

Psychometric Analysis of an Ecological Vocal Effort Scale in Individuals With and Without Vocal Hyperfunction During Activities of Daily Living

American Journal of Speech-Language Pathology ◽

10.1044/2021_ajslp-21-00111 ◽

2021 ◽

pp. 1-16

Author(s):

Katherine L. Marks ◽

Alessandra Verdi ◽

Laura E. Toles ◽

Kaila L. Stipancic ◽

Andrew J. Ortiz ◽

...

Keyword(s):

Construct Validity ◽

Intraclass Correlation ◽

Muscle Tension ◽

Voice Rehabilitation ◽

Minimal Detectable Change ◽

Retest Reliability ◽

Vocal Hyperfunction ◽

Before And After ◽

Vocal Effort ◽

Test Retest Reliability

Objective The purpose of this study was to examine the psychometric properties of an ecological vocal effort scale linked to a voicing task. Method Thirty-eight patients with nodules, 18 patients with muscle tension dysphonia, and 45 vocally healthy control individuals participated in a week of ambulatory voice monitoring. A global vocal status question was asked hourly throughout the day. Participants produced a vowel–consonant–vowel syllable string and rated the vocal effort needed to produce the task on a visual analog scale. Test–retest reliability was calculated for a subset using the intraclass correlation coefficient, ICC(A, 1). Construct validity was assessed by (a) comparing the weeklong vocal effort ratings between the patient and control groups and (b) comparing weeklong vocal effort ratings before and after voice rehabilitation in a subset of 25 patients. Cohen's d, the standard error of measurement ( SEM ), and the minimal detectable change (MDC) assessed sensitivity. The minimal clinically important difference (MCID) assessed responsiveness. Results Test–retest reliability was excellent, ICC(A, 1) = .96. Weeklong mean effort was statistically higher in the patients than in controls ( d = 1.62) and lower after voice rehabilitation ( d = 1.75), supporting construct validity and sensitivity. SEM was 4.14, MDC was 11.47, and MCID was 9.74. Since the MCID was within the error of the measure, we must rely upon the MDC to detect real changes in ecological vocal effort. Conclusion The ecological vocal effort scale offers a reliable, valid, and sensitive method of monitoring vocal effort changes during the daily life of individuals with and without vocal hyperfunction.

Download Full-text

Reliability and Validity of Turkish Myasthenia Gravis-Activities of Daily Living Scale

OTJR Occupation Participation and Health ◽

10.1177/1539449220961077 ◽

2020 ◽

pp. 153944922096107

Author(s):

Ecem Karanfil ◽

Yeliz Salcı ◽

Ayla Fil-Balkan ◽

Can Ebru Bekircan-Kurt ◽

Sevim Erdem Özdamar ◽

...

Keyword(s):

Construct Validity ◽

Myasthenia Gravis ◽

Activities Of Daily Living ◽

Daily Living ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Life Questionnaire ◽

Good Test ◽

Retest Reliability ◽

Test Retest Reliability

Linguistic, reliable, and valid secondary efficacy measures are important in clinical settings and studies. The aim of the study is to report test–retest reliability and construct validity of Turkish version of Myasthenia Gravis-Activities of Daily Living Scale (MG-ADL-T) in Myasthenia Gravis (MG) patients. Fifty-two ocular and generalized individuals with MG, applying to rehabilitation center, were included in the study. MG-ADL-T, MG quality-of-life questionnaire (MG-QoL), MG composite (MGC), quantitative MG score (QMGS), and pulmonary function test were administered. Reliability was assessed with intraclass correlation coefficient (ICC) and Cronbach’s alpha. Spearman correlation test and receiver operating characteristic (ROC) analysis were performed for construct validity. MG-ADL-T had fair internal consistency (Cronbach’s α = .67), excellent test–retest reliability (ICC = 0.96) and moderate construct validity (MG-QoL, r = 0.59; QMGS, r = .58; MGC, r = .68). MG-ADL, a unique scale that evaluates activities of daily living (ADL), has good test–retest reliability and construct validity in Turkish MG patients.

Download Full-text

72 Test-Retest Reliability and Minimal Detectable Change for Postural Sway by using Sway Meter in Elderly Subjects

Age and Ageing ◽

10.1093/ageing/afz164.72 ◽

2019 ◽

Vol 48 (Supplement_4) ◽

pp. iv18-iv27 ◽

Cited By ~ 1

Author(s):

Kitima Rongsawad ◽

Laddawon Worawan ◽

Karnsiree Jirarojprapa ◽

Sararat Kaewkham ◽

Sarawut Khattiwong

Keyword(s):

Clinical Relevance ◽

Postural Stability ◽

Postural Sway ◽

Intraclass Correlation ◽

Elderly Subjects ◽

Minimal Detectable Change ◽

Detectable Change ◽

Simple Method ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Introduction Static postural stability is the ability to maintain the posture with minimum sway. Increasing postural sway during standing in different sensory conditions is associated with aging due to decline in sensory and motor functions. Sway area measured by using sway meter is usually simple method for assessing postural stability in elderly subjects. Like many biological measurements, sway area has an intrinsic variability that affects their test-retest reliability and responsiveness of postural stability assessment. The minimal detectable change (MDC) is ability to detect smallest change beyond measurement error that reflects a reliable change. Therefore, the MDC value could provide information of clinical relevance on postural stability. The aims of this study were to determine test-retest reliability and MDC of sway area obtained from sway meter in elderly subjects. Methods Twelve healthy elderly subjects aged 60 years and above were participated in this study. The test and retest repeatability of postural sway measurements were performed twice with a 1-hour interval. For each subject was assess postural sway using Lord’s sway meter during standing on 4 sensory conditions for 30 seconds of each condition. The test-retest reliability of sway area was calculated using intraclass correlation coefficient. The MDC for each sway area was calculated to quantify clinical relevance. Results The test-retest reliability of sway area revealed good to excellent reliability ranged from 0.85 to 0.94. Standard error of measurement (SEM) and MDC ranged from 75 to 205 mm2 and 209 to 568 mm2, respectively. Discussion and Conclusion Our findings reveal that sway area in different sensory conditions could be used in assessment of postural stability in elderly subjects. SEM and MDC of sway area increased when subjects were asked to close their eyes and on foam surface. The sway meter is a reliable tool for assessing postural stability in clinical setting.

Download Full-text

Reliability of the Polar Vantage M Sports Watch when Measuring Heart Rate at Different Treadmill Exercise Intensities

Sports ◽

10.3390/sports8090117 ◽

2020 ◽

Vol 8 (9) ◽

pp. 117

Author(s):

Mike Climstein ◽

Jessica L. Alder ◽

Alyce M. Brooker ◽

Elissa J. Cartwright ◽

Kevin Kemp-Smith ◽

...

Keyword(s):

Heart Rate ◽

Treadmill Exercise ◽

Intraclass Correlation ◽

Good Test ◽

Good Reliability ◽

Measurement Variability ◽

Retest Reliability ◽

Activity Monitors ◽

Test Retest Reliability ◽

Standard Error Of Measurement

Background: Usage of wrist-worn activity monitors has rapidly increased in recent years, and these devices are being used by both fitness enthusiasts and in clinical populations. We, therefore, assessed the test–retest reliability of the Polar Vantage M (PVM) watch when measuring heart rate (HR) during various treadmill exercise intensities. Methods: HR was measured every 30 s (simultaneous electrocardiography (ECG) and PVM). Test–retest reliability was determined using an intraclass correlation coefficient (ICC) with 95% confidence intervals (CIs). Standard error of measurement (SEM) and smallest real difference (SRD) were used to determine measurement variability. Results: A total of 29 participants completed the trials. ICC values for PVM during stages 1, 2 and 5 demonstrated good to excellent test–retest reliability (0.78, 0.78 and 0.92; 95% CI (0.54–0.90, 0.54–0.9, 0.79–0.97)). For PVM during stages 0 (rest), 3 and 4, the ICC values indicated poor to good reliability (0.42, 0.68 and 0.58; 95% CI (−0.27–0.73, 0.32–0.85, 0.14–0.80)). Conclusion: This study identified that the test–retest reliability of the PVM was comparable at low and high exercise intensities; however, it revealed a poor to good test–retest reliability at moderate intensities. The PVM should not be used in a clinical setting where monitoring of an accurate HR is crucial to the patients’ safety.

Download Full-text

Test-retest reliability and minimal detectable change of the Balance Evaluation Systems Test and its two abbreviated versions in persons with mild to moderate spinocerebellar ataxia: A pilot study

Neurorehabilitation ◽

10.3233/nre-203154 ◽

2020 ◽

Vol 47 (4) ◽

pp. 479-486

Author(s):

Yuki Kondo ◽

Kyota Bando ◽

Yosuke Ariake ◽

Wakana Katsuta ◽

Kyoko Todoroki ◽

...

Keyword(s):

Spinocerebellar Ataxia ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Minimal Detectable Change ◽

Detectable Change ◽

Retest Reliability ◽

Evaluation Systems ◽

Intraclass Correlation Coefficients ◽

Interclass Correlation ◽

Test Retest Reliability

BACKGROUND: The reliability of the evaluation of the Balance Evaluation Systems Test (BESTest) and its two abbreviated versions are confirmed for balance characteristics and reliability. However, they are not utilized in cases of spinocerebellar ataxia (SCA). OBJECTIVE: We aimed to examine the test-retest reliability and minimal detectable change (MDC) of the BESTest and its abbreviated versions in persons with mild to moderate spinocerebellar ataxia. METHODS: The BESTest was performed in 20 persons with SCA at baseline and one month later. The scores of the abbreviated version of the BESTest were determined from the BESTest scores. The interclass correlation coefficient (1,1) was used as a measure of relative reliability. Furthermore, we calculated the MDC in the BESTest and its abbreviated versions. RESULTS: The intraclass correlation coefficients (1,1) and MDC at 95% confidence intervals were 0.92, 8.7(8.1%), 0.91, 4.1(14.5%), and 0.81, 5.2(21.6%) for the Balance, Mini-Balance, and Brief-Balance Evaluation Systems Tests, respectively. CONCLUSIONS: The BESTest and its abbreviated versions had high test-retest reliability. The MDC values of the BESTest could enable clinicians and researchers to interpret changes in the balance of patients with SCA more precisely.

Download Full-text

Test-Retest Reliability of the StepWatch Activity Monitor Outputs in Healthy Adults

Journal of Physical Activity and Health ◽

10.1123/jpah.7.5.671 ◽

2010 ◽

Vol 7 (5) ◽

pp. 671-676 ◽

Cited By ~ 27

Author(s):

Suzie Mudge ◽

Denise Taylor ◽

Oliver Chang ◽

Rosita Wong

Keyword(s):

Activity Index ◽

Intraclass Correlation ◽

Objective Measure ◽

Activity Monitor ◽

Healthy Adults ◽

Peak Activity ◽

Good Test ◽

Retest Reliability ◽

Step Rate ◽

Test Retest Reliability

Background:Activity Monitors give an objective measure of usual walking performance. This study aimed to examine the test-retest reliability of the StepWatch Activity Monitor outputs (mean steps/day; peak activity index; sustained activity indices of 1, 5, 20, 30, 60 minutes; steps at high, medium, and low stepping rates).Methods:Thirty healthy adults age 18 to 49 years wore the StepWatch for 2 3-day periods at least 1 week apart.Results:The intraclass correlation coefficients of the StepWatch outputs ranged from 0.44 to 0.91 over 3 days. The coefficient of variation ranged from 3.0% to 51.3% over the monitoring periods, with higher variation shown for shorter monitoring periods. The most reliable 5 outputs had 95% limits of agreement between 3-day periods that were less than 40%. These were mean steps/day (±39.1%), highest step rate in 1 (±17.3%) and 5 (±37.4%) minutes, peak activity index (±25.6%), and percentage of inactive time (±9.52%).Conclusions:Mean steps/day, highest step rate in 1 and 5 minutes, peak activity index, and percentage of inactive time have good test-retest reliability over a 3-day monitoring period, with lower reliability shown by the other StepWatch outputs. Monitoring over 1 or 2 days is less reliable.

Download Full-text

The Modified Gait Efficacy Scale: Establishing the Psychometric Properties in Older Adults

Physical Therapy ◽

10.2522/ptj.20110053 ◽

2012 ◽

Vol 92 (2) ◽

pp. 318-328 ◽

Cited By ~ 41

Author(s):

Alaina M. Newell ◽

Jessie M. VanSwearingen ◽

Elizabeth Hile ◽

Jennifer S. Brach

Keyword(s):

Older Adults ◽

Correlation Coefficient ◽

Internal Consistency ◽

Intraclass Correlation ◽

Community Dwelling ◽

Self Report ◽

Retest Reliability ◽

And Performance ◽

Test Retest Reliability ◽

Community Dwelling Older Adults

BackgroundPerceived ability or confidence plays an important role in determining function and behavior. The modified Gait Efficacy Scale (mGES) is a 10-item self-report measure used to assess walking confidence under challenging everyday circumstances.ObjectiveThe purpose of this study was to determine the reliability, internal consistency, and validity of the mGES as a measure of gait in older adults.DesignThis was a cross-sectional study.MethodsParticipants were 102 community-dwelling older adults (mean [±SD] age=78.6±6.1 years) who were independent in ambulation with or without an assistive device. Participants were assessed using the mGES and measures of confidence and fear, measures of function and disability, and performance-based measures of mobility. In a subsample (n=26), the mGES was administered twice within a 1-month period to establish test-retest reliability through the intraclass correlation coefficient (ICC [2,1]). The standard error of measure (SEM) was determined from the ICC and standard deviation. The Cronbach α value was calculated to determine internal consistency. To establish the validity of the mGES, the Spearman rank order correlation coefficient was used to examine the association with measures of confidence, fear, gait, and physical function and disability.ResultsThe mGES demonstrated test-retest reliability within the 1-month period (ICC=.93, 95% confidence interval=.85, .97). The SEM of the mGES was 5.23. The mGES was internally consistent across the 10 items (Cronbach α=.94). The mGES was related to measures of confidence and fear (r=.54–.88), function and disability (Late-Life Function and Disability Instrument, r=.32–.88), and performance-based mobility (r=.38–.64).LimitationsThis study examined only community-dwelling older adults. The results, therefore, should not be generalized to other patient populations.ConclusionThe mGES is a reliable and valid measure of confidence in walking among community-dwelling older adults.

Download Full-text

Reliability of Subjective Pain Ratings and Nociceptive Flexion Reflex Responses as Measures of Conditioned Pain Modulation

Pain Research and Management ◽

10.1155/2014/698246 ◽

2014 ◽

Vol 19 (2) ◽

pp. 93-96 ◽

Cited By ~ 22

Author(s):

Carlo Jurth ◽

Benno Rehberg ◽

Falk von Dincklage

Keyword(s):

Intraclass Correlation ◽

Pain Modulation ◽

Hot Water ◽

Conditioned Pain Modulation ◽

Good Test ◽

Retest Reliability ◽

Reflex Responses ◽

Pain Ratings ◽

Subjective Pain ◽

Test Retest Reliability

BACKGROUND: The endogenous modulation of pain can be assessed through conditioned pain modulation (CPM), which can be quantified using subjective pain ratings or nociceptive flexion reflexes. However, to date, the test-retest reliability has only been investigated for subjective pain ratings.OBJECTIVE: To compare the test-retest reliability of CPM-induced changes, measured using subjective pain ratings and nociceptive flexion reflexes, to provide a reliable scoring parameter for future studies.METHOD: A total of 40 healthy volunteers each received painful electrical stimuli to the sural nerve to elicit nociceptive flexion reflexes. Reflex sizes and subjective pain ratings were recorded before and during the immersion of the contralateral hand in hot water to induce CPM as well as innocuous water as control. Measurements were repeated in a retest 28 days later.RESULTS: Intraclass correlation coefficients showed good test-retest reliabilities of CPM during the hot water stimulus for both scoring parameters. Subjective pain ratings also correlated between test and retest during the control stimulus.CONCLUSIONS: Subjective pain ratings and nociceptive flexion reflexes show comparable test-retest reliabilities, but they reflect different components of CPM. While subjective pain ratings appear to incorporate cognitive influences to a larger degree, reflex responses appear to reflect spinal nociception more purely.

Download Full-text