scholarly journals Test–retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1 and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = − 0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good. Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

2020 ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  

Abstract Background: Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia.Methods: A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4.Results: The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1% and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = -0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p<.001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good.Conclusions: These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.


2020 ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometric sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia.Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4.Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1% and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = -0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good.Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patient with schizophrenia.


2020 ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  

Abstract Background: Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods: A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results: The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1% and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = -0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p=.011 with the T-SDMT and r = 0.61, p<.001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good.Conclusions: These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.


Author(s):  
Posen Lee ◽  
Ping-Chia Li ◽  
Chin-Hsuan Liu ◽  
Hung-Yu Lin ◽  
Chien-Yu Huang ◽  
...  

Background: The Ruff 2 and 7 Selective Attention Test (RSAT) is designed to measure selective attention. It tests automatic detection speed (ADS), automatic detection errors (ADE), automatic detection accuracy (ADA), controlled search speed (CSS), controlled search errors (CSE), and controlled search accuracy (CSA). The purpose of this study was to examine the test–retest reliability, practice effect, and minimum detectable change (MDC) of the RSAT in patients with schizophrenia. Methods: A total of 101 patients with schizophrenia completed the RSAT twice at a 4-week interval. The intra-class correlation coefficient (ICC), paired t test, and effect size were used to examine the test–retest reliability and practice effect. The standard error of measurement (SEM) and MDC were calculated. Results: The difference scores between the two assessments were significant in all the indexes. The absolute effect sizes were 0.14 to 0.30. The ICCs of the RSAT ranged from 0.69 to 0.91. The MDC% in the indexes of ADS, ADA, and CSA of the RSAT were <30%. Conclusions: The RSAT is reliable for assessing selective attention in patients with schizophrenia. The RSAT has good to excellent test–retest reliability, a trivial to small practice effect, and indexes of ADS, ADA, and CSA, representing acceptable random measurement error.


2011 ◽  
Vol 91 (1) ◽  
pp. 114-121 ◽  
Author(s):  
Sheau-Ling Huang ◽  
Ching-Lin Hsieh ◽  
Ruey-Meei Wu ◽  
Chun-Hwei Tai ◽  
Chin-Hsien Lin ◽  
...  

Background The minimal detectable change (MDC) is the smallest amount of difference in individual scores that represents true change (beyond random measurement error). The MDCs of the Timed “Up & Go” Test (TUG) and the Dynamic Gait Index (DGI) in people with Parkinson disease (PD) are largely unknown, limiting the interpretability of the change scores of both measures. Objective The purpose of this study was to estimate the MDCs of the TUG and the DGI in people with PD. Design This investigation was a prospective cohort study. Methods Seventy-two participants were recruited from special clinics for movement disorders at a university hospital. Their mean age was 67.5 years, and 61% were men. All participants completed the TUG and the DGI assessments twice, about 14 days apart. The MDC was calculated from the standard error of measurement. The percentage MDC (MDC%) was calculated as the MDC divided by the mean of all scores for the sample. Furthermore, the intraclass correlation coefficient was used to examine the reproducibility between testing sessions (test-retest reliability). Results The respective MDC and MDC% of the TUG were 3.5 seconds and 29.8, and those of the DGI were 2.9 points and 13.3. The test-retest reliability values for the TUG and the DGI were high; the intraclass correlation coefficients were .80 and .84, respectively. Limitations The study sample was a convenience sample, and the participants had mild to moderately severe PD. Conclusions The results showed that the TUG and the DGI have generally acceptable random measurement error and test-retest reliability. These findings should help clinicians and researchers determine whether a change in an individual patient with PD is a true change.


2021 ◽  
Vol 17 (4) ◽  
pp. 344-351
Author(s):  
Yukyeong Jung ◽  
Jae Ho Han ◽  
Seokyu Choi ◽  
Jae Hee Lee

Purpose: This study aimed to measure the test-retest reliability of the Korean Matrix sentence-in-noise test in a sound-field testing condition.Methods: Fifty-five listeners with normal hearing participated. The sound-field speech-in-noise test was administered with a front loudspeaker by presenting noise at a fixed level (65 dB SPL) while adaptively adjusting the sentence level based on the listener’s response. The speech reception thresholds (SRTs) corresponding to 50% sentence-in-noise intelligibility were obtained using speech-shaped noise (SSN), International Collegium of Rehabilitative Audiology (ICRA) noise, and International Speech Test Signal (ISTS) noise. For the test-retest reliability, each subject was tested twice in a 2-week interval. The test-retest reliabilities were judged by the intraclass correlation coefficient (ICC), the minimal detectable change (MDC) values, and Bland-Altman plots.Results: The test-retest reliabilities of the Korean Matrix sentence test were good (ICC, 0.84~0.86) across SSN, ICRA, ISTS noises. The MDC was 0.92 dB SNR for SSN and 2.83 and 2.98 dB SNR for ICRA and ISTS, indicating the random measurement error varied across the types of noise.Conclusion: The Korean Matrix sentence-in-noise test can be used as a reliable tool to assess speech-in-noise intelligibility in sound-field testing condition. Further study across various sessions would strengthen the present finding.


2021 ◽  
Vol 14 (1) ◽  
Author(s):  
Juan Pablo Martinez-Cano ◽  
Daniel Vernaza-Obando ◽  
Julián Chica ◽  
Andrés Mauricio Castro

Abstract Objective The aim of this study was to translate to Spanish the patellofemoral pain and osteoarthritis subscale of the knee injury and osteoarthritis outcome score (KOOS-PF) and validate this Spanish version of a disease-specific patient-reported outcome measure (PROM) for patellofemoral pain. Results The KOOS-PF was translated to Spanish and sixty patients with patellofemoral pain and/or osteoarthritis accepted to complete the questionnaire. 1-week later 58 patients answered the questions again for the test–retest reliability validation and finally 55 patients completed 1-month later for the responsiveness assessment. The Spanish version showed very good internal consistency (Cronbach’s alpha: 0.93) and test–retest reliability (intraclass correlation coefficient: 0.82). Responsiveness was confirmed, showing a strong correlation with the global rating of change (GROC) score (r 0.64). The minimal detectable change was 11.1 points, the minimal important change was 17.2 points, and there were no floor or ceiling effects for the score.


2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.


2021 ◽  
Author(s):  
A Wallin ◽  
M Kierkegaard ◽  
E Franzén ◽  
S Johansson

Abstract Objective The mini-BESTest is a balance measure for assessment of the underlying physiological systems for balance control in adults. Evaluations of test–retest reliability of the mini-BESTest in larger samples of people with multiple sclerosis (MS) are lacking. The purpose of this study was to investigate test–retest reliability of the mini-BESTest total and section sum scores and individual items in people with mild to moderate overall MS disability. Methods This study used a test–retest design in a movement laboratory setting. Fifty-four people with mild to moderate overall MS disability according to the Expanded Disability Status scale (EDSS) were included, with 28 in the mild subgroup (EDSS 2.0–3.5) and 26 in the moderate subgroup (EDSS 4.0–5.5). Test–retest reliability of the mini-BESTest was evaluated by repeated measurements taken 1 week apart. Reliability and measurement error were analyzed. Results Test–retest reliability for the total scores were considered good to excellent, with intraclass correlation coefficients of .88 for the whole sample, .83 for the mild MS subgroup, and .80 for the moderate MS subgroup. Measurement errors were small, with standard error of measurement and minimal detectable change of 1.3 and 3.5, respectively, in mild MS, and 1.7 and 4.7, respectively, in moderate MS. The limits of agreement were − 3.4 and 4.6. Test–retest reliability for the section scores were fair to good or excellent; weighted kappa values ranged from .62 to .83. All items but 1 showed fair to good or excellent test–retest reliability, and percentage agreement ranged from 61% to 100%. Conclusions The mini-BESTest demonstrated good to excellent test–retest reliability and small measurement errors and is recommended for use in people with mild to moderate MS. Impact Knowledge of limits of agreement and minimal detectable change contribute to interpretability of the mini-BESTest total score. The findings of this study enhance the clinical usefulness of the test for evaluation of balance control and for designing individually customized balance training with high precision and accuracy in people with MS.


Sign in / Sign up

Export Citation Format

Share Document