scholarly journals Practice Effects, Test–Retest Reliability, and Minimal Detectable Change of the Ruff 2 and 7 Selective Attention Test in Patients with Schizophrenia

2021 ◽  
Vol 18 (18) ◽  
pp. 9440
Author(s):  
Posen Lee ◽  
Ping-Chia Li ◽  
Chin-Hsuan Liu ◽  
Hung-Yu Lin ◽  
Chien-Yu Huang ◽  
...  
Keyword(s):  
Selective Attention ◽  
Automatic Detection ◽  
Practice Effect ◽  
Minimal Detectable Change ◽  
Detection Accuracy ◽  
Detectable Change ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Minimum Detectable Change ◽  
Test Retest Reliability

Background: The Ruff 2 and 7 Selective Attention Test (RSAT) is designed to measure selective attention. It tests automatic detection speed (ADS), automatic detection errors (ADE), automatic detection accuracy (ADA), controlled search speed (CSS), controlled search errors (CSE), and controlled search accuracy (CSA). The purpose of this study was to examine the test–retest reliability, practice effect, and minimum detectable change (MDC) of the RSAT in patients with schizophrenia. Methods: A total of 101 patients with schizophrenia completed the RSAT twice at a 4-week interval. The intra-class correlation coefficient (ICC), paired t test, and effect size were used to examine the test–retest reliability and practice effect. The standard error of measurement (SEM) and MDC were calculated. Results: The difference scores between the two assessments were significant in all the indexes. The absolute effect sizes were 0.14 to 0.30. The ICCs of the RSAT ranged from 0.69 to 0.91. The MDC% in the indexes of ADS, ADA, and CSA of the RSAT were <30%. Conclusions: The RSAT is reliable for assessing selective attention in patients with schizophrenia. The RSAT has good to excellent test–retest reliability, a trivial to small practice effect, and indexes of ADS, ADA, and CSA, representing acceptable random measurement error.

scholarly journals Test–retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Fluid Intelligence ◽  
Stable Condition ◽  
Practice Effect ◽  
Minimal Detectable Change ◽  
Nonverbal Intelligence ◽  
Fourth Edition ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1 and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = − 0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good. Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

scholarly journals Test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition in patients with schizophrenia.

2020 ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Fluid Intelligence ◽  
Stable Condition ◽  
Practice Effect ◽  
Minimal Detectable Change ◽  
Nonverbal Intelligence ◽  
Fourth Edition ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background: Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia.Methods: A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4.Results: The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1% and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = -0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p<.001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good.Conclusions: These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

scholarly journals Test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition in patients with schizophrenia.

2020 ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Fluid Intelligence ◽  
Stable Condition ◽  
Practice Effect ◽  
Minimal Detectable Change ◽  
Nonverbal Intelligence ◽  
Fourth Edition ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometric sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia.Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4.Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1% and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = -0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good.Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patient with schizophrenia.

scholarly journals Test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition in patients with schizophrenia.

2020 ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Fluid Intelligence ◽  
Stable Condition ◽  
Practice Effect ◽  
Minimal Detectable Change ◽  
Nonverbal Intelligence ◽  
Fourth Edition ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background: Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods: A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results: The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1% and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = -0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p=.011 with the T-SDMT and r = 0.61, p<.001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good.Conclusions: These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

scholarly journals Minimal Detectable Change of the Timed “Up & Go” Test and the Dynamic Gait Index in People With Parkinson Disease

2011 ◽  
Vol 91 (1) ◽  
pp. 114-121 ◽  
Author(s):  
Sheau-Ling Huang ◽  
Ching-Lin Hsieh ◽  
Ruey-Meei Wu ◽  
Chun-Hwei Tai ◽  
Chin-Hsien Lin ◽  
...  
Keyword(s):  
Measurement Error ◽  
Intraclass Correlation ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Random Measurement ◽  
Test Retest Reliability ◽  
Dynamic Gait Index ◽  
Dynamic Gait

Background The minimal detectable change (MDC) is the smallest amount of difference in individual scores that represents true change (beyond random measurement error). The MDCs of the Timed “Up & Go” Test (TUG) and the Dynamic Gait Index (DGI) in people with Parkinson disease (PD) are largely unknown, limiting the interpretability of the change scores of both measures. Objective The purpose of this study was to estimate the MDCs of the TUG and the DGI in people with PD. Design This investigation was a prospective cohort study. Methods Seventy-two participants were recruited from special clinics for movement disorders at a university hospital. Their mean age was 67.5 years, and 61% were men. All participants completed the TUG and the DGI assessments twice, about 14 days apart. The MDC was calculated from the standard error of measurement. The percentage MDC (MDC%) was calculated as the MDC divided by the mean of all scores for the sample. Furthermore, the intraclass correlation coefficient was used to examine the reproducibility between testing sessions (test-retest reliability). Results The respective MDC and MDC% of the TUG were 3.5 seconds and 29.8, and those of the DGI were 2.9 points and 13.3. The test-retest reliability values for the TUG and the DGI were high; the intraclass correlation coefficients were .80 and .84, respectively. Limitations The study sample was a convenience sample, and the participants had mild to moderately severe PD. Conclusions The results showed that the TUG and the DGI have generally acceptable random measurement error and test-retest reliability. These findings should help clinicians and researchers determine whether a change in an individual patient with PD is a true change.

Test–Retest Reliability of the Mini-BESTest in People With Mild to Moderate Multiple Sclerosis

2021 ◽  
Author(s):  
A Wallin ◽  
M Kierkegaard ◽  
E Franzén ◽  
S Johansson
Keyword(s):  
Multiple Sclerosis ◽  
Measurement Errors ◽  
Balance Control ◽  
Intraclass Correlation ◽  
Repeated Measurements ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Limits Of Agreement ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objective The mini-BESTest is a balance measure for assessment of the underlying physiological systems for balance control in adults. Evaluations of test–retest reliability of the mini-BESTest in larger samples of people with multiple sclerosis (MS) are lacking. The purpose of this study was to investigate test–retest reliability of the mini-BESTest total and section sum scores and individual items in people with mild to moderate overall MS disability. Methods This study used a test–retest design in a movement laboratory setting. Fifty-four people with mild to moderate overall MS disability according to the Expanded Disability Status scale (EDSS) were included, with 28 in the mild subgroup (EDSS 2.0–3.5) and 26 in the moderate subgroup (EDSS 4.0–5.5). Test–retest reliability of the mini-BESTest was evaluated by repeated measurements taken 1 week apart. Reliability and measurement error were analyzed. Results Test–retest reliability for the total scores were considered good to excellent, with intraclass correlation coefficients of .88 for the whole sample, .83 for the mild MS subgroup, and .80 for the moderate MS subgroup. Measurement errors were small, with standard error of measurement and minimal detectable change of 1.3 and 3.5, respectively, in mild MS, and 1.7 and 4.7, respectively, in moderate MS. The limits of agreement were − 3.4 and 4.6. Test–retest reliability for the section scores were fair to good or excellent; weighted kappa values ranged from .62 to .83. All items but 1 showed fair to good or excellent test–retest reliability, and percentage agreement ranged from 61% to 100%. Conclusions The mini-BESTest demonstrated good to excellent test–retest reliability and small measurement errors and is recommended for use in people with mild to moderate MS. Impact Knowledge of limits of agreement and minimal detectable change contribute to interpretability of the mini-BESTest total score. The findings of this study enhance the clinical usefulness of the test for evaluation of balance control and for designing individually customized balance training with high precision and accuracy in people with MS.

scholarly journals 72 Test-Retest Reliability and Minimal Detectable Change for Postural Sway by using Sway Meter in Elderly Subjects

2019 ◽  
Vol 48 (Supplement_4) ◽  
pp. iv18-iv27 ◽  
Author(s):  
Kitima Rongsawad ◽  
Laddawon Worawan ◽  
Karnsiree Jirarojprapa ◽  
Sararat Kaewkham ◽  
Sarawut Khattiwong
Keyword(s):  
Clinical Relevance ◽  
Postural Stability ◽  
Postural Sway ◽  
Intraclass Correlation ◽  
Elderly Subjects ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Simple Method ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Introduction Static postural stability is the ability to maintain the posture with minimum sway. Increasing postural sway during standing in different sensory conditions is associated with aging due to decline in sensory and motor functions. Sway area measured by using sway meter is usually simple method for assessing postural stability in elderly subjects. Like many biological measurements, sway area has an intrinsic variability that affects their test-retest reliability and responsiveness of postural stability assessment. The minimal detectable change (MDC) is ability to detect smallest change beyond measurement error that reflects a reliable change. Therefore, the MDC value could provide information of clinical relevance on postural stability. The aims of this study were to determine test-retest reliability and MDC of sway area obtained from sway meter in elderly subjects. Methods Twelve healthy elderly subjects aged 60 years and above were participated in this study. The test and retest repeatability of postural sway measurements were performed twice with a 1-hour interval. For each subject was assess postural sway using Lord’s sway meter during standing on 4 sensory conditions for 30 seconds of each condition. The test-retest reliability of sway area was calculated using intraclass correlation coefficient. The MDC for each sway area was calculated to quantify clinical relevance. Results The test-retest reliability of sway area revealed good to excellent reliability ranged from 0.85 to 0.94. Standard error of measurement (SEM) and MDC ranged from 75 to 205 mm2 and 209 to 568 mm2, respectively. Discussion and Conclusion Our findings reveal that sway area in different sensory conditions could be used in assessment of postural stability in elderly subjects. SEM and MDC of sway area increased when subjects were asked to close their eyes and on foam surface. The sway meter is a reliable tool for assessing postural stability in clinical setting.

Cross-cultural adaptation, validity, and reliability of the Neck OutcOme Score (NOOS-Ar) among the Saudi Arabian populace

2020 ◽  
pp. 1-10
Author(s):  
Mazen Alqahtani
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Everyday Activity ◽  
Retest Reliability ◽  
Outcome Score ◽  
Convergent Construct Validity ◽  
Test Retest Reliability

BACKGROUND: To date the Neck OutcOme Score (NOOS) was not cross-culturally adapted, validated or available in the Arabic language, although it was available in other languages. OBJECTIVE: To translate and cross-culturally adapt the Arabic version of the Neck OutcOme Score (NOOS-Ar) and study its psychometric properties. METHODS: A sample of 146 subjects with chronic neck pain filled in the NOOS-Ar questionnaire to determine the Cronbach’s alpha (α) for internal consistency, test-retest reliability by intraclass correlation coefficients(2,1) [ICC(2,1)], inter-item correlation, measurement error by coefficient of variance and minimal detectable change, ceiling and floor effects, convergent construct validity with visual analog scale (VAS) by Spearman’s rank correlation coefficient (ρ) and factor analysis to calculate and determine its psychometric properties. RESULTS: Excellent internal consistency (Cronbach’s α> 0.9) and test-retest reliability [ICC(2,1)> 0.9] were observed in NOOS-Ar. None of the five subscales of the NOOS-Ar showed a floor or ceiling effect. The coefficient of variance was generally high, but the minimal detectable change was within the acceptable range (< 30%). The ‘everyday activity and pain’ and ‘symptoms’ subscales of the NOOS-Ar, showed a moderate correlation with VAS. CONCLUSION: The NOOS-Ar is highly reliable and has a moderate to good degree of convergent construct validity with VAS with no floor or ceiling effects.

Sign in / Sign up

Export Citation Format

Share Document