scholarly journals A-241 Five Point Test: Reliability, Validity, and Test Performance in Cognitively Intact Adults

2020 ◽  
Vol 35 (6) ◽  
pp. 1036-1036
Author(s):  
Chaudhary Z ◽  
Hubley A
Keyword(s):  
Test Performance ◽  
Convergent Validity ◽  
Block Design ◽  
Short Interval ◽  
Test Reliability ◽  
Retest Reliability ◽  
Point Test ◽  
Test Retest Reliability ◽  
Cognitively Intact ◽  
Neuropsychological Variables

Abstract Objective Reliability and validity evidence related to the Five Point Test (FPT) scores is severely limited. The primary purpose of this study was to examine psychometric evidence related to two commonly used FPT scores (number of unique designs (UD), percentage of repetitions (PR)) using one-week test–retest reliability, correlations with demographic and neuropsychological variables, and convergent validity in line with a regression-based explanation-focused view of validity. Methods The sample consisted of 86 cognitively intact, non-depressed adult men and women ages 21–82 years (M = 52.7, SD = 17.7) with 7–21 years of education (M = 14.2, SD = 3.13) recruited from the general community and tested individually. Results UD ranged from 8–60 (M = 35.4) and PR ranged from 0–45% (M = 6.9%). Test–retest coefficients were .83 for UD but only .43 for PR. Age was significantly correlated with UD (r = −.59) and PR (r = .23). Education was significantly correlated with UD (r = .26) but not PR (r = −.10). There were no gender differences. UD showed significant bivariate correlations with WAIS-III Block Design, Trail-Making Test (TMT) A, TMT-B, Bicycle Drawing Test, and FAS Verbal Fluency but, together in a regression, only age and TMT-B remained significant. PR scores did not correlate significantly with any neuropsychological variables. Conclusion UD showed strong test–retest reliability. UD performance tends to be poorer with older age and less education. The meaning and interpretation of UD performance using a regression-based explanation-focused view of validity will be discussed. PR reliability is poor even over a short interval and attenuates subsequent statistical findings. Use of PR is not recommended in research or practice.

scholarly journals Test–retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Kuan-Wei Chen ◽  
Ya-Chen Lee ◽  
Tzu-Ying Yu ◽  
Li-Jung Cheng ◽  
Chien-Yu Chao ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Fluid Intelligence ◽  
Stable Condition ◽  
Practice Effect ◽  
Minimal Detectable Change ◽  
Nonverbal Intelligence ◽  
Fourth Edition ◽  
Random Measurement Error ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1 and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = − 0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good. Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Therapeutic Interventions ◽  
Treatment Burden ◽  
Validity And Reliability ◽  
Stroke Patients ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

The Minnesota Manual Dexterity Test: Reliability, Validity and Reference Values Studies with Healthy Elderly People

1997 ◽  
Vol 64 (5) ◽  
pp. 270-276 ◽  
Author(s):  
Johanne Desrosiers ◽  
Annie Rochette ◽  
Réjean Hébert ◽  
Gina Bravo
Keyword(s):  
Elderly People ◽  
Reference Values ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Manual Dexterity ◽  
Test Reliability ◽  
Retest Reliability ◽  
Healthy Elderly ◽  
Block Test ◽  
Test Retest Reliability

Several dexterity tests have been developed, including the Minnesota Rate of Manipulation Test (MRMT) and a new version, the Minnesota Manual Dexterity Test (MMDT). The objectives of the study were: a) to verify the test-retest reliability of the MMDT; b) to compare the MRMT and the MMDT; c) to study the concurrent validity of the MMDT; and d) to establish reference values for elderly people with the MMDT. Two hundred and forty-seven community-living healthy elderly were evaluated with the MMDT, and two other dexterity tests, the Box and Block Test (BBT) and the Purdue Pegboard (PP). Thirty-five of them were evaluated twice with the MMDT and 44 were evaluated with both the MMDT and MRMT. The results show that the test-retest reliability of the MMDT is acceptable to high (intraclass correlation coefficients of 0.79 to 0.87, depending on the subtest) and the validity of the test is demonstrated by significant correlations between the MMDT, the BBT and the PP (0.63 to 0.67). There is a high correlation (0.85 to 0.95) between the MMDT and the MMRT in spite of different results. The reference values will help occupational therapists to differentiate better between real dexterity difficulties and those that may be attributed to normal aging.

Validation of the NARCOMS Registry: pain assessment

2005 ◽  
Vol 11 (3) ◽  
pp. 338-342 ◽  
Author(s):  
Ruth Ann Marrie ◽  
Gary Cutter ◽  
Tuula Tyry ◽  
Olympia Hadjimichael ◽  
Timothy Vollmer
Keyword(s):  
Multiple Sclerosis ◽  
Convergent Validity ◽  
Disease Duration ◽  
Self Report ◽  
Research Committee ◽  
Retest Reliability ◽  
The North ◽  
Disability Status ◽  
Pain Question ◽  
Test Retest Reliability

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

scholarly journals Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Psychometric Evaluation ◽  
Counseling Competencies ◽  
Counselors In Training ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

scholarly journals Test-Retest Reliability, Convergent Validity and Practice Effects of the RBANS in a Memory Clinic Setting: A Pilot Study

2013 ◽  
Vol 02 (04) ◽  
pp. 11-16 ◽  
Author(s):  
Yanhong Dong ◽  
Claire L. Thompson ◽  
Shi Huey Joanne Tan ◽  
Leon Ben Swie Lim ◽  
Wanshin Pang ◽  
...  
Keyword(s):  
Pilot Study ◽  
Convergent Validity ◽  
Practice Effects ◽  
Memory Clinic ◽  
Retest Reliability ◽  
Clinic Setting ◽  
Test Retest Reliability

scholarly journals The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

2021 ◽  
Vol 18 (23) ◽  
pp. 12507
Author(s):  
Lavinia De Chiara ◽  
Cristina Mazza ◽  
Eleonora Ricci ◽  
Alexia Emilia Koukopoulos ◽  
Georgios D. Kotzalidis ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Predictive Power ◽  
Discriminant Validity ◽  
Late Pregnancy ◽  
Italian Version ◽  
Retest Reliability ◽  
Dsm 5 ◽  
Insomnia Symptom ◽  
Symptom Questionnaire ◽  
Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

scholarly journals European Portuguese Version of the Clinical Frailty Scale: Translation, Cultural Adaptation and Validation Study

2021 ◽  
Vol 34 (13) ◽  
Author(s):  
Mário Pereira Pinto ◽  
Sónia Martins ◽  
Edgar Mesquita ◽  
Lia Fernandes
Keyword(s):  
Sensitivity And Specificity ◽  
Validation Study ◽  
Convergent Validity ◽  
Outpatient Clinics ◽  
Clinical Frailty Scale ◽  
Retest Reliability ◽  
European Portuguese ◽  
Tilburg Frailty Indicator ◽  
Test Retest Reliability ◽  
Frailty Indicator

Introduction: This study aims to describe the translation and adaptation of the European Portuguese Clinical Frailty Scale and assess its convergent validity and test-retest reliability.Material and Methods: This validation study included a sample of elderly people admitted in two convalescence units from the National Network of Integrated Continuous Care in Northern Portugal and followed in two outpatient clinics of social solidarity institutions. Convergent validity of the scale was evaluated, against Tilburg Frailty Indicator. Test-retest reliability, sensitivity and specificity were assessed.Results: Overall, 51 patients were included (mean age = 78 years old). The Clinical Frailty Scale identified 43.1% patients with frailty. Kappa values for test-retest reliability (non-frail/frail) was 1.00. The intraclass correlation coefficient for the 9-point total scale was 0.999. A correlation between Clinical Frailty Scale and Tilburg Frailty Indicator was also found (rs = 0.683; p < 0.001). The Cohen’s kappa coefficient was 0.423 in the agreement analysis between these scales. The results for sensitivity and specificity defined that 62.0% of patients were true positives and 81.8% true negatives. The scale accuracy determined by the receiver operating characteristics curve analysis was 0.782.Discussion: This scale showed an excellent test-retest reliability. Robust results on convergent validity were also achieved, with a moderate correlation and agreement with the Tilburg Frailty Indicator, showing good sensitivity and accuracy, as well as high specificity.Conclusion: This version has an excellent test-retest reliability and good convergent validity, and is both a reliable and valid test for application in clinical practice for assessing Portuguese elderly population admitted in convalescence units and outpatient clinics.

Examining the Technical Adequacy of the Social, Academic, and Emotional Behavior Risk Screener

2019 ◽  
Vol 46 (1) ◽  
pp. 67-75 ◽  
Author(s):  
Samuel F. Whitley ◽  
Yojanna Cuenca-Carlino
Keyword(s):  
Elementary School ◽  
Convergent Validity ◽  
Pearson Correlation ◽  
Ethnically Diverse ◽  
Criterion Validity ◽  
Emotional Behavior ◽  
Retest Reliability ◽  
Urban Elementary School ◽  
The Social ◽  
Test Retest Reliability

Many schools attempt to identify and service students at risk for poor mental health outcomes within a multi-tiered system of support (MTSS). Universal screening within a MTSS requires technically adequate tools. The Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) has been put forth as a technically adequate screener. Researchers have examined the factor structure, diagnostic accuracy, criterion validity, and internal consistency of SAEBRS data. However, previous research has not examined its temporal stability or replicated the criterion validity results with a racially/ethnically diverse urban elementary school sample. This study examined the test–retest reliability, convergent validity, and predictive validity of teacher-completed SAEBRS ratings with racially/ethnically diverse group students enrolled in first through fifth grade in an urban elementary school. Reliability analyses resulted in significant test–retest reliability coefficients across four weeks for all SAEBRS scales. Furthermore, nonsignificant paired samples t tests were observed with the exception of the third-grade Emotional subscale. Validity analyses yielded significant concurrent and predictive Pearson correlation coefficients between SAEBRS ratings, oral reading fluency, and office discipline referrals. Limitations and implications of the results are discussed.

Sign in / Sign up

Export Citation Format

Share Document