Measuring personal recovery in a low-intensity community mental healthcare setting: validation of the Dutch version of the individual recovery outcomes counter (I.ROC)

Abstract Background Measuring progress in treatment is essential for systematic evaluation by service users and their care providers. In low-intensity community mental healthcare, a questionnaire to measure progress in treatment should be aimed at personal recovery and should require little effort to complete. Methods The Individual Recovery Outcome Counter (I.ROC) was translated from English into Dutch, and psychometric evaluations were performed. Data were collected on personal recovery (Recovery Assessment Scale), quality of life (Manchester Short Assessment of Quality of Life), and symptoms of mental illness and social functioning (Outcome Questionnaire, OQ-45) for assessing the validity of the I.ROC. Test–retest reliability was evaluated by calculating the Intraclass Correlation Coefficient and internal consistency was evaluated by calculating Cronbach’s alpha. Exploratory factor analysis was performed to determine construct validity. To assess convergent validity, the I.ROC was compared to relevant questionnaires by calculating Pearson correlation coefficients. To evaluate discriminant validity, I.ROC scores of certain subgroups were compared using either a t-test or analysis of variance. Results There were 764 participants in this study who mostly completed more than one I.ROC (total n = 2,863). The I.ROC aimed to measure the concept of personal recovery as a whole, which was confirmed by a factor analysis. The test–retest reliability was satisfactory (Intraclass Correlation Coefficient is 0.856), as were the internal consistency (Cronbachs Alpha is 0.921) and the convergent validity. Sensitivity to change was small, but comparable to that of the OQ-45. Conclusions The Dutch version of the I.ROC appears to have satisfactory psychometric properties to warrant its use in daily practice. Discriminant validity and sensitivity to change need further research.

Download Full-text

Angioedema quality of life questionnaire (AE-QoL) - interpretability and sensitivity to change

Health and Quality of Life Outcomes ◽

10.1186/s12955-019-1229-3 ◽

2019 ◽

Vol 17 (1) ◽

Cited By ~ 5

Author(s):

Kanokvalai Kulthanan ◽

Leena Chularojanamontri ◽

Chuda Rujitharanawong ◽

Puncharas Weerasubpong ◽

Marcus Maurer ◽

...

Keyword(s):

Quality Of Life ◽

Convergent Validity ◽

Characteristic Curve ◽

Intraclass Correlation ◽

Life Questionnaire ◽

Sensitivity To Change ◽

Validity And Reliability ◽

Distribution Method ◽

Patient Reported

Abstract Background The Angioedema Quality of Life (AE-QoL) is the first patient reported outcome measure developed for the assessment of quality of life (QoL) impairment in patients with recurrent angioedema (RAE). This study aimed to evaluate the clinimetric properties of the AE-QoL in Thai patients and to establish categories of QoL impairment assessed by the AE-QoL. Methods The validated Thai version of the Dermatology Life Quality Index (DLQI) and Patient Global Assessment of Quality of Life (PGA-QoL) were used to comparatively evaluate the Thai version of AE-QoL. Spearman correlations between the Thai AE-QoL and two other standard measurements (DLQI and PGA-QoL) were investigated to determine convergent validity. The Thai DLQI and PGA-QoL were used to categorize patients according to their QoL. Known-group validity of the Thai AE-QoL was later analyzed. The reliability of the Thai AE-QoL was investigated using Cronbach’s alpha and intraclass correlation. Three different approaches including the distribution method, receiver operating characteristic curve analysis, and the anchor based-method were used for the interpretability. Results A total of 86 patients with RAE with a median age of 38.0 ± 15.1 years (range 18–76) were enrolled. Of those, 76 patients (88%) had RAE with concomitant wheals, and 10 patients (11.6%) had RAE only. The AE-QoL assessed RAE-mediated QoL impairment with high convergent validity and known-groups validity, high internal consistency and test-retest reliability, and good sensitivity to change. Although the AE-QoL did not differentiate between patients with moderate and large effect as measured by PGA-QoL or DLQI in this study, AE-QoL total values of 0–23, 24 to 38, and ≥ 39 could define patients with “no effect”, “small effect”, and “moderate to large effect” of RAE on their QoL, respectively. Conclusions This study supports the validity and reliability of the Thai version of the AE-QoL, which is a very different language from the original version. Categories allow to classify the effect of RAE on patients’ QoL as “none”, “small”, and “moderate to large”. Further studies are needed to confirm the applicability of AE-QoL in other Asian populations”.

Download Full-text

Validation of Indian Adaptation of Burn Outcomes Questionnaire—Hindi Version (I-BOQ-HV) for Pediatric Subgroup 5 to 18 Years

Journal of Burn Care & Research ◽

10.1093/jbcr/iraa182 ◽

2020 ◽

Author(s):

Praveen Kumar Arumugam ◽

Piyush K Thayal

Keyword(s):

Quality Of Life ◽

Economic Impact ◽

Discriminant Validity ◽

Indian Population ◽

Intraclass Correlation ◽

Life Assessment ◽

Outcome Questionnaire ◽

Test Retest Reliability ◽

Indian Adaptation

Abstract The American Burn Association/Shriners Hospitals for Children Burn Outcomes Questionnaire (BOQ) is burn-specific quality of life assessment questionnaire for children. In this study, we modified the questionnaire to suit the Indian population and also translated it to Hindi. Three questions were modified according to its Indian context. One new question was added to the “Transfers and mobility” domain; a new domain “Economic impact” with two questions was added to study the economic impact on families. Twenty-five patients of age 5 to 18 years were included in the study. The Indian adaptation of Burn Outcome Questionnaire—Hindi Version 5 to 18 years (I-BOQ-HV 5–18 years) was found to be feasible in the Indian population. The internal consistency of the modified scale was good with all except one domain with Cronbach’s alpha greater than 0.7. Test–retest reliability was done with intraclass correlation which was good, with values of greater than 0.7 for all domains. Pearson’s correlation coefficient showed good discriminant validity between the domains. Factor analysis using principle component analysis with orthogonal rotation resulted in 10 of the 12 components with good factor loadings. The I-BOQ-HV 5 to 18 years has been shown to reliably predict quality of life of children with burns in India.

Download Full-text

CODEM Instrument

GeroPsych ◽

10.1024/1662-9647/a000100 ◽

2014 ◽

Vol 27 (1) ◽

pp. 23-31 ◽

Cited By ~ 4

Author(s):

Anne Kuemmel (This author contributed eq ◽

Julia Haberstroh (This author contributed ◽

Johannes Pantel

Keyword(s):

Convergent Validity ◽

Interrater Reliability ◽

Discriminant Validity ◽

Assessment Tool ◽

Intraclass Correlation ◽

Well Being ◽

Communication Behavior ◽

People With Dementia ◽

Pearson's R ◽

Pearson’S R

Communication and communication behaviors in situational contexts are essential conditions for well-being and quality of life in people with dementia. Measuring methods, however, are limited. The CODEM instrument, a standardized observational communication behavior assessment tool, was developed and evaluated on the basis of the current state of research in dementia care and social-communicative behavior. Initially, interrater reliability was examined by means of videoratings (N = 10 people with dementia). Thereupon, six caregivers in six German nursing homes observed 69 residents suffering from dementia and used CODEM to rate their communication behavior. The interrater reliability of CODEM was excellent (mean κ = .79; intraclass correlation = .91). Statistical analysis indicated that CODEM had excellent internal consistency (Cronbach’s α = .95). CODEM also showed excellent convergent validity (Pearson’s R = .88) as well as discriminant validity (Pearson’s R = .63). Confirmatory factor analysis verified the two-factor solution of verbal/content aspects and nonverbal/relationship aspects. With regard to the severity of the disease, the content and relational aspects of communication exhibited different trends. CODEM proved to be a reliable, valid, and sensitive assessment tool for examining communication behavior in the field of dementia. CODEM also provides researchers a feasible examination tool for measuring effects of psychosocial intervention studies that strive to improve communication behavior and well-being in dementia.

Download Full-text

Development of the Fear of Intimacy Components Questionnaire (FICQ)

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000238 ◽

2015 ◽

Vol 31 (4) ◽

pp. 302-309 ◽

Cited By ~ 3

Author(s):

Maria Pedro Sobral ◽

Maria Emília Costa

Keyword(s):

Convergent Validity ◽

Discriminant Validity ◽

Two Dimensions ◽

Dimensional Structure ◽

Future Research ◽

Fear Of Intimacy ◽

Confirmatory Factor Analyses ◽

New Instrument ◽

Confirmatory Factor ◽

Test Retest Reliability

Abstract. We developed a new instrument designed to measure fear of intimacy in romantic relationships. We suggest assessing fear of intimacy through two dimensions: self-revelation and dependence. The Fear of Intimacy Components Questionnaire (FICQ) was validated across three studies in which a 10-item solution systematically emerged. Consistently with a two component perspective, a two-factor solution fitted data the best: fear of losing the self (FLS) and fear of losing the other (FLO). Qualitative analyses verified content validity. Exploratory and confirmatory factor analyses tested the factor structure. Multigroup analyses supported the structural invariance across gender, age, and relationship status. Both factors showed adequate discriminant validity and internal consistency, and good 3-week period test-retest reliability. Associations between the FICQ and insecure attachment orientations demonstrated convergent validity. The association between the FICQ and relationship satisfaction above and beyond a preexisting measure offered criterion validity. By going beyond traditional self-revelation-focused conception of fear of intimacy, that is, by proposing a bi-dimensional structure to fear of intimacy, we believe that this new measure will contribute to future research on fear of intimacy.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Reliability and Validaty of St George Respiratory Questionnaire (SGRQ) into Indonesian Version

International Journal of Public Health Science (IJPHS) ◽

10.11591/ijphs.v3i3.4691 ◽

2014 ◽

Vol 3 (3) ◽

pp. 179

Author(s):

Adnan Adnan ◽

Dyah Aryani Perwitasari ◽

Ully Adhie Mulyani

Keyword(s):

Quality Of Life ◽

Factor Analysis ◽

Convergent Validity ◽

Discriminant Validity ◽

Special Instrument ◽

Convergent And Discriminant Validity ◽

Group Validity ◽

Section Design ◽

St George's Respiratory Questionnaire

Tuberculosis (TB) is one of the disease as the highest contributor to the disease burden in Indonesia. Tuberculosis can affect the patients’ quality of life, such as psychological, physical, and social functioning. St. George's Respiratory Questionnaire (SGRQ) is a special instrument which was widely used to measure the patients’ quality of life with respiratory disease. The objective of this study was to validate the Indonesian version of the SGRQ as instrument to collect data. A descriptive cross section design with 61 subjects was conducted at the Pulmonary Clinics and Primary Health Centers in the region of Yogyakarta within 3 months. The validation process included the known group validity, convergent and discriminant validity and factor analysis. There were 14 items question numbers which did not meet the criteria for convergent validity and 9 items which did not meet the criteria for discriminant validity. Known group validity analysis on gender showed that of the three domains of SGRQ, the activity domain gave statistically significant result. The factor analysis showed the result of Kaiser Meyer Olkin analysis (KMO) was less than 0.5. With a few modifications, the Indonesian version of SGRQ is valid and reliable for measuring quality of life in tuberculosis patients.

Download Full-text

Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

Frontiers in Psychology ◽

10.3389/fpsyg.2021.688539 ◽

2021 ◽

Vol 12 ◽

Author(s):

Wei Xia ◽

William Ho Cheung Li ◽

Tingna Liang ◽

Yuanhui Luo ◽

Laurie Long Kwan Ho ◽

...

Keyword(s):

Concurrent Validity ◽

Convergent Validity ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Psychometric Evaluation ◽

Counseling Competencies ◽

Counselors In Training ◽

Rater Reliability ◽

Retest Reliability ◽

Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

Download Full-text

The Relevance of Insomnia in the Diagnosis of Perinatal Depression: Validation of the Italian Version of the Insomnia Symptom Questionnaire

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182312507 ◽

2021 ◽

Vol 18 (23) ◽

pp. 12507

Author(s):

Lavinia De Chiara ◽

Cristina Mazza ◽

Eleonora Ricci ◽

Alexia Emilia Koukopoulos ◽

Georgios D. Kotzalidis ◽

...

Keyword(s):

Convergent Validity ◽

Predictive Power ◽

Discriminant Validity ◽

Late Pregnancy ◽

Italian Version ◽

Retest Reliability ◽

Dsm 5 ◽

Insomnia Symptom ◽

Symptom Questionnaire ◽

Test Retest Reliability

Background. Sleep disorders are common in perinatal women and may underlie or trigger anxiety and depression. We aimed to translate and validate and evaluate the psychometric properties of the Italian version of the Insomnia Symptom Questionnaire (ISQ), in a sample of women during late pregnancy and 6-months postpartum according to the DSM-5 criteria. Methods. The ISQ was administered to 292 women prenatally along with other measures of sleep quality, depression, and anxiety, to examine its construct and convergent validity. Women were readministered the ISQ six months postdelivery to assess test–retest reliability. Women were divided into DSM-5 No-Insomnia (N = 253) and Insomnia (N = 39) groups. Results. The insomnia group had received more psychopharmacotherapy, had more psychiatric family history, increased rates of medically assisted reproduction, of past perinatal psychiatric disorders, and scored higher on almost all TEMPS-A dimensions, on the EPDS, HCL-32, PSQI, and on ISQ prenatally and postnatally. ISQ scores correlated with all scales, indicating adequate convergent and discriminant validity; furthermore, it showed antenatal–postnatal test–retest reliability, 97.5% diagnostic accuracy, 79.5% sensitivity, 94.9% specificity, 70.5% positive predictive power, and 92.8% negative predictive power. Conclusions. The ISQ is useful, valid, and reliable for assessing perinatal insomnia in Italian women. The Italian version showed equivalent properties to the original version.

Download Full-text

Psychometric proprieties of a color-shape version of the switch task

Neurology ◽

10.1212/01.wnl.0000550626.58880.01 ◽

2018 ◽

Vol 91 (23 Supplement 1) ◽

pp. S4.1-S4

Author(s):

Veronik Sicard ◽

Alexe Simard ◽

Robert Davis Moore ◽

Gabriel Lavoie ◽

Dave Ellemberg

Keyword(s):

Task Switching ◽

Convergent Validity ◽

Switch Cost ◽

Intraclass Correlation ◽

Theoretical Models ◽

Health Concern ◽

Switch Costs ◽

Main Effect ◽

Test Retest Reliability ◽

The Impact

The impact of concussions on an individual's cognitive functioning has become a growing health concern over the past several years; however, the search for sensitive tests persists. The task-switching paradigm is known to be sensitive to various medical conditions, including concussion. Accordingly, we developed 2 versions of the color-shape switch task. Three different costs are computed from the raw scores: global switch cost, which is thought to be a measure of global cognitive control; local switch cost, which is believed to be a measure of cognitive flexibility; and working memory cost. The aim of this study was to evaluate psychometric characteristics of these costs. An ANOVA revealed a main effect of sex on local latency switch cost, with females exhibiting longer latencies than males, p = 0.05. No main effect of sex was observed on any other switch costs. Moreover, no main effect of experimenter or version of the task was observed. Local switch cost was significantly correlated with trails 4 and 5 of the Comprehensive Trail Making Test (rs > 0.21, ps < 0.04). No other significant correlation between costs and established neuropsychological tests was observed, indicating low convergent validity. The intraclass correlation coefficient estimates ranged from 0.23 to 0.77, suggesting low-to-moderate 1-week test-retest reliability. Results indicated a low switch costs; convergent validity. Moreover, results show that the traditionally computed switch costs are less reliable than the primary outcomes (i.e., reaction time and accuracy). Researchers and clinicians should rely on primary variables from the task-switching paradigm rather than computing the traditional switch costs to increase the psychometric properties of the tasks which is critical to advances in theoretical models of executive functions and evaluations of clinical populations.

Download Full-text

Validation of the Indonesian version of the graded chronic pain scale 2.0 in pain-related temporomandibular disorders

Medical Journal of Indonesia ◽

10.13181/mji.oa.191790 ◽

2020 ◽

Vol 29 (1) ◽

pp. 42-6

Author(s):

Ira Tanti ◽

Vivi Vidya Waty Wira ◽

Yenni Pragustine ◽

Laura Susanti Himawan ◽

Nina Ariani

Keyword(s):

Chronic Pain ◽

Internal Consistency ◽

Temporomandibular Disorders ◽

Convergent Validity ◽

Discriminant Validity ◽

Assessment Tool ◽

Intraclass Correlation ◽

Pain Scale ◽

Disability Score ◽

Positive Correlation

BACKGROUND Pain associated with oral problems is one of the most frequent chronic pain of temporomandibular disorders (TMDs). This study was conducted to analyze the psychometric properties of the Indonesian version of the graded chronic pain scale 2.0 (GCPS-ID) in Indonesian patients with TMDs. METHODS The English version of the GCPS version 2.0 was translated and back-translated according to international guidelines. This study conducted from June to December 2016 at the Dental Hospital, Faculty of Dentistry, Universitas Indonesia, and the participants were 202 TMDs patients who had never undergone temporomandibular joint surgery or suffered facial pain for more than 6 months. The evaluation of the GCPS-ID included the internal consistency test, test-retest reliability, and construct validity tests. RESULTS The GCPS-ID had a high internal consistency (Cronbach’s alpha = 0.896). The intraclass correlation coefficient of the pain intensity and the disability score were 0.789 and 0.706, respectively. The convergent validity demonstrated a moderately positive correlation between the GCPS-ID and the Indonesian version of oral health impact profile for TMD for pain (r = 0.595; p<0.001) and disability (r = 0.488; p<0.001). The discriminant validity between GCPS-ID and the subjective patient’s quality of life revealed a weak positive correlation (r = 0.195; p = 0.191). CONCLUSIONS GCPS-ID is a reliable and valid assessment tool for evaluating TMD pain in Indonesia.

Download Full-text