European Portuguese Version of the Clinical Frailty Scale: Translation, Cultural Adaptation and Validation Study

Introduction: This study aims to describe the translation and adaptation of the European Portuguese Clinical Frailty Scale and assess its convergent validity and test-retest reliability.Material and Methods: This validation study included a sample of elderly people admitted in two convalescence units from the National Network of Integrated Continuous Care in Northern Portugal and followed in two outpatient clinics of social solidarity institutions. Convergent validity of the scale was evaluated, against Tilburg Frailty Indicator. Test-retest reliability, sensitivity and specificity were assessed.Results: Overall, 51 patients were included (mean age = 78 years old). The Clinical Frailty Scale identified 43.1% patients with frailty. Kappa values for test-retest reliability (non-frail/frail) was 1.00. The intraclass correlation coefficient for the 9-point total scale was 0.999. A correlation between Clinical Frailty Scale and Tilburg Frailty Indicator was also found (rs = 0.683; p < 0.001). The Cohen’s kappa coefficient was 0.423 in the agreement analysis between these scales. The results for sensitivity and specificity defined that 62.0% of patients were true positives and 81.8% true negatives. The scale accuracy determined by the receiver operating characteristics curve analysis was 0.782.Discussion: This scale showed an excellent test-retest reliability. Robust results on convergent validity were also achieved, with a moderate correlation and agreement with the Tilburg Frailty Indicator, showing good sensitivity and accuracy, as well as high specificity.Conclusion: This version has an excellent test-retest reliability and good convergent validity, and is both a reliable and valid test for application in clinical practice for assessing Portuguese elderly population admitted in convalescence units and outpatient clinics.

Download Full-text

RELIABILITY AND VALIDITY OF HYPOTHETICAL SCENARIOS FOR ESTIMATING WILLINGNESS TO PAY (WTP) PER QUALITY ADJUSTED LIFE YEAR (QALY) IN INDONESIA SETTING

International Journal of Pharmacy and Pharmaceutical Sciences ◽

10.22159/ijpps.2017v9i12.22657 ◽

2017 ◽

Vol 9 (12) ◽

pp. 288

Author(s):

Susi Ari Kristina ◽

Dwi Endarti ◽

Tri Murti Andayani ◽

M. Rifqi Rokhman

Keyword(s):

Sensitivity And Specificity ◽

Convergent Validity ◽

Terminal Illness ◽

Validity And Reliability ◽

Treatment Scenario ◽

Predictive Values ◽

Retest Reliability ◽

Group Validity ◽

Significant Difference ◽

Test Retest Reliability

Objective: To estimate validity and reliability of WTP questionnaire which WTP value can be taken as an indication of the monetary value of health gains, which may carry information regarding the appropriate height of the cost-effectiveness threshold.Methods: Three hundred respondents, in Yogyakarta province, Indonesia, were interviewed during June 2017. We examine a value of WTP associated with the following scenarios: 1) improving moderate condition; 2) extending life during terminal illness, and 3) lifesaving. The interview ascertained maximum hypothetical WTP for one QALY using a dichotomous bidding format with an open-ended final question, along with questions about the socio-economic factors. Concerning validity, the WTP of the 3 versions of hypothetical scenarios were compared as known-group validity and analysis of the sensitivity and specificity was performed. Test-retest reliability and alpha Cronbach were employed to measure internal consistency.Results: Analysis generally confirmed the validity and reliability of the WTP hypothetical scenarios. In terms of known group validity, there was significant difference across two scenarios (treatment v. s lifesaving), but no significant difference between mean WTP for treatment and terminal illness was found. Mean WTP for terminal illness (38 Million IDR) and lifesaving scenario (16 Million IDR) was significantly higher than that of treatment scenario (14 Million IDR). The WTP instrument showed good convergent validity (r=0.784), when comparing correlation between WTP value and utility score. Estimation of scenario’s sensitivity and specificity in deriving expected WTP were 70.33 % and 38.98 %, respectively. The positive and negative predictive values were 64 % and 46 %. The test-retest reliability of WTP values indices excellent stability and reliability of the instrument with Spearman’s rank correlation coefficient of 0.816 (p<0.001)Conclusion: This study demonstrated that the WTP instrument is feasible and relatively reliable for measuring the WTP values in Indonesia. For wider application of the instrument, its validity should be investigated further. Meanwhile, adoption of WTP as an empirical evidence of societal values is encouraged.

Download Full-text

Self-Administered Instrument to Measure the Patient's Experience of Recovery After First-Episode Psychosis: Development and Validation of the Psychosis Recovery Inventory

Australian & New Zealand Journal of Psychiatry ◽

10.1080/j.1440-1614.2005.01609.x ◽

2005 ◽

Vol 39 (6) ◽

pp. 493-499 ◽

Cited By ~ 24

Author(s):

Eric Y.H. Chen ◽

Dennise K.P. Tam ◽

Josephine W.S. Wong ◽

C.W Law ◽

Cindy P.Y. Chiu

Keyword(s):

Internal Consistency ◽

Validation Study ◽

Convergent Validity ◽

Rating Scale ◽

First Episode Psychosis ◽

First Episode ◽

Recovery Stage ◽

Retest Reliability ◽

Episode Psychosis ◽

Test Retest Reliability

Objective: Patients who are recovering from a first-episode psychosis face specific and complex issues that are related to their illness and treatment experiences, such as the appraisal of the extent of their recoveryand the risk ofrelapse. Currently, no instrument provides a comprehensive assessment of these related attitudes. A novel self-administered rating scale for the measurement of key perceptions during the recovery stage after a firstepisode psychosis is presented. The Psychosis Recovery Inventory (PRI) is designed to specifically address a number of closely related issues that are faced by patients who are recovering from a first-episode psychosis. Method: The process of development of the PRI involved the generation of items from qualitative interviews, the construction and refinement of these items and a validation study. The longitudinal stability of the PRI items was assessed in a test–retest reliability study in which 20 patients completed the retest within 4 weeks. The internal consistency and convergent validity of the PRI were evaluated by a comparison of the PRI subscale scores and the Scale to Assess Unawareness of Mental Disorder and Drug Attitude Inventory scores in a sample of 48 first-episode psychosis patients. Results: The validation study shows that the PRI is an instrument with a good test–retest reliability, internal consistency and convergent validity. Conclusions: This pragmatic, low burden, self-administered scale can be applied in clinical and research settings to obtain reliable information on the attitudes of patients on a range of interrelated issues in the recovery stage that follows a first-episode psychosis.

Download Full-text

VALIDITY AND RELIABILITY OF THE POLISH VERSION OF THE TILBURG FRAILTY INDICATOR (TFI)

Journal of Frailty & Aging ◽

10.14283/jfa.2015.66 ◽

2015 ◽

pp. 1-6

Author(s):

I. UCHMANOWICZ ◽

B. JANKOWSKA-POLAŃSKA1, ◽

B. UCHMANOWICZ ◽

K. KOWALCZUK ◽

R.J.J. GOBBENS

Keyword(s):

Internal Consistency ◽

Community Dwelling ◽

Face Validity ◽

Cronbach’S Alpha ◽

Retest Reliability ◽

Cronbach's Alpha ◽

Tilburg Frailty Indicator ◽

Polish Version ◽

Test Retest Reliability ◽

Frailty Indicator

Background: In the last decade, studies on frailty have become increasingly frequent in the literature on aging, and also the number of available questionnaires regarding frailty has increased over the years. Therefore, the choice of which questionnaire to use is becoming more difficult. Objective: The aim of this study was to assess the psychometric properties of the Polish version of the Tilburg Frailty Indicator (TFI), an instrument that identifies frailty in the elderly population. Design: Setting, and Participants. The study was carried out in a community-based setting in Wrocław, Poland. Nurses and doctors (general practitioners) administered the TFI in primary care facilities. Participants included a sample of 212 community dwelling elderly aged 60 or older (mean age:70.6 SD≥7.16). Measurements: The validation (assessment of face validity, content validity) was carried out in accordance with the literature. The Tilburg Frailty Indicator (TFI) consists of two different parts. One part addresses the potential determinants of frailty and the other specifically addresses the components of frailty, covering its physical, psychological and social domains. Scale reliability was estimated using two methods: Cronbach’s alpha, measuring the scale’s internal consistency, and the test-retest method, determining the scale’s absolute stability. To assess test-retest reliability, the same group was re-interviewed by the same observer within 10-14 days of the first interview. Results: The test-retest reliability showed a high level of agreement for all items of the instrument, with values ranging from 96 to 100%. The Cronbach’s Alpha internal consistency was 0.74. Conclusion: The Polish version of the TFI proved to be a valid and reproducible tool for assessment of Frailty Syndrome for the Polish population. We would recommend to be used as the screening tool to assess frailty.

Download Full-text

Test–retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia

BMC Psychiatry ◽

10.1186/s12888-021-03041-4 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Kuan-Wei Chen ◽

Ya-Chen Lee ◽

Tzu-Ying Yu ◽

Li-Jung Cheng ◽

Chien-Yu Chao ◽

...

Keyword(s):

Convergent Validity ◽

Fluid Intelligence ◽

Stable Condition ◽

Practice Effect ◽

Minimal Detectable Change ◽

Nonverbal Intelligence ◽

Fourth Edition ◽

Random Measurement Error ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1 and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = − 0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good. Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Validation of the NARCOMS Registry: pain assessment

Multiple Sclerosis Journal ◽

10.1191/1352458505ms1167oa ◽

2005 ◽

Vol 11 (3) ◽

pp. 338-342 ◽

Cited By ~ 28

Author(s):

Ruth Ann Marrie ◽

Gary Cutter ◽

Tuula Tyry ◽

Olympia Hadjimichael ◽

Timothy Vollmer

Keyword(s):

Multiple Sclerosis ◽

Convergent Validity ◽

Disease Duration ◽

Self Report ◽

Research Committee ◽

Retest Reliability ◽

The North ◽

Disability Status ◽

Pain Question ◽

Test Retest Reliability

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

Download Full-text

Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

Frontiers in Psychology ◽

10.3389/fpsyg.2021.688539 ◽

2021 ◽

Vol 12 ◽

Author(s):

Wei Xia ◽

William Ho Cheung Li ◽

Tingna Liang ◽

Yuanhui Luo ◽

Laurie Long Kwan Ho ◽

...

Keyword(s):

Concurrent Validity ◽

Convergent Validity ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Psychometric Evaluation ◽

Counseling Competencies ◽

Counselors In Training ◽

Rater Reliability ◽

Retest Reliability ◽

Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

Download Full-text

Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study (Preprint)

10.2196/preprints.18160 ◽

2020 ◽

Author(s):

Pim van Oirschot ◽

Marco Heerings ◽

Karine Wendrich ◽

Bram den Teuling ◽

Marijn B Martens ◽

...

Keyword(s):

Multiple Sclerosis ◽

Construct Validity ◽

Validation Study ◽

Intraclass Correlation ◽

Study Participant ◽

Smartphone App ◽

Retest Reliability ◽

Matched Group ◽

Test Retest Reliability ◽

Study Participants

BACKGROUND The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS. OBJECTIVE The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT). METHODS We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the “HC matched” group) and 58 subjects had a less intense assessment schedule to determine reference values (the “HC normative” group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT. RESULTS The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS. CONCLUSIONS The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Download Full-text

Test-Retest Reliability, Convergent Validity and Practice Effects of the RBANS in a Memory Clinic Setting: A Pilot Study

Open Journal of Medical Psychology ◽

10.4236/ojmp.2013.24b003 ◽

2013 ◽

Vol 02 (04) ◽

pp. 11-16 ◽

Cited By ~ 8

Author(s):

Yanhong Dong ◽

Claire L. Thompson ◽

Shi Huey Joanne Tan ◽

Leon Ben Swie Lim ◽

Wanshin Pang ◽

...

Keyword(s):

Pilot Study ◽

Convergent Validity ◽

Practice Effects ◽

Memory Clinic ◽

Retest Reliability ◽

Clinic Setting ◽

Test Retest Reliability

Download Full-text

The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182312507 ◽

2021 ◽

Vol 18 (23) ◽

pp. 12507

Author(s):

Lavinia De Chiara ◽

Cristina Mazza ◽

Eleonora Ricci ◽

Alexia Emilia Koukopoulos ◽

Georgios D. Kotzalidis ◽

...

Keyword(s):

Convergent Validity ◽

Predictive Power ◽

Discriminant Validity ◽

Late Pregnancy ◽

Italian Version ◽

Retest Reliability ◽

Dsm 5 ◽

Insomnia Symptom ◽

Symptom Questionnaire ◽

Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

Download Full-text