scholarly journals Psychometric properties of the Mental Health Recovery Star

2012 ◽  
Vol 201 (1) ◽  
pp. 65-70 ◽  
Author(s):  
Helen Killaspy ◽  
Sarah White ◽  
Tatiana L. Taylor ◽  
Michael King

BackgroundThe Mental Health Recovery Star (MHRS) is a popular outcome measure rated collaboratively by staff and service users, but its psychometric properties are unknown.AimsTo assess the MHRS's acceptability, reliability and convergent validity.MethodA total of 172 services users and 120 staff from in-patient and community services participated. Interrater reliability of staff-only ratings and test–retest reliability of staff-only and collaborative ratings were assessed using intraclass correlation coefficients (ICCs). Convergent validity between MHRS ratings and standardised measures of social functioning and recovery was assessed using Pearson correlation. The influence of collaboration on ratings was assessed using descriptive statistics and ICCs.ResultsThe MHRS was relatively quick and easy to use and had good test–retest reliability, but interrater reliability was inadequate. Collaborative ratings were slightly higher than staff-only ratings. Convergent validity suggests it assesses social function more than recovery.ConclusionsThe MHRS cannot be recommended as a routine clinical outcome tool but may facilitate collaborative care planning.

2021 ◽  
Author(s):  
Selin Bayram ◽  
Deran Oskay ◽  
Nurten Gizem Tore ◽  
Fulden Sari ◽  
Devrim Can Saraç ◽  
...  

ABSTRACT Objectives The 6-minute stepper test (6MST) is a submaximal test that requires little space to assess exercise capacity compared to the 6-minute walk test (6MWT). The study aims to investigate the test-retest reliability and convergent validity of 6MST and to compare physiological responses, dyspnea, fatigue perception with 6MST and 6MWT in patients with ankylosing spondylitis (AS). Methods To test the convergent validity of 6MST, 65 patients performed both 6MWT and 6MST on the first day and correlation between two tests were assessed with Pearson correlation test. In order to investigate the test-retest reliability of the 6MST, thirty-two of the 65 patients performed 6MST one week later and intraclass correlation coefficients (ICC) were calculated. Dyspnea and fatigue perception were analyzed with using Wilcoxon signed-rank test, physiological responses were analyzed using paired sample t-test. Results Excellent test-retest reliability was observed for 6MST (ICC: 0.988). There was a significant correlation between 6MST and 6MWT (r: 0.725, p<0.001). Dyspnea and leg fatigue perception were significantly higher in 6MST (p<0.05). Physiological responses and fatigue perception were similar in both 6MST and 6MWT (p>0.05). Conclusion This study demonstrated that the 6MST is reliable and valid method to evaluate exercise capacity in patients with AS. 6MST can be used to evaluate exercise capacity of patients with AS.


SAGE Open ◽  
2020 ◽  
Vol 10 (2) ◽  
pp. 215824402092287
Author(s):  
Bangyi Yan ◽  
Shiguang Ni ◽  
Xi Wang ◽  
Jin Liu ◽  
Qianjing Zhang ◽  
...  

The English version of the Independent Television Commission-Sense of Presence Inventory (ITC-SOPI), which was developed in 2001 to measure how involved or present participants are when experiencing different media, has substantial psychometric evidence. This study was used to translate and validate the ITC-SOPI in interactive virtual environments among the Chinese population. We used the forward-backward translation procedure. An expert panel reviewed the translated ITC-SOPI until the Chinese version of the ITC-SOPI was finalized. A total of 210 participants (133 males and 77 females), with a mean age of 23.05 years ( SD = 3.56, range = 17–47), completed the Chinese ITC-SOPI. The following psychometric properties were examined: factor structure, internal consistency, test–retest reliability, and convergent validity. Confirmatory factor analysis (CFA) showed a good fit (χ2 /df = 1.70, Tucker–Lewis Index [TLI] = 0.91, comparative fit index [CFI] = 0.92, root mean square error of approximation [RMSEA] = 0.058) of the four-factor model (spatial presence, engagement, ecological validity, and negative effects). For each factor, the Chinese ITC-SOPI had high internal consistency (Cronbach’s α ranging from 0.75 to 0.87) and test–retest reliability (intraclass correlation coefficient ranging from 0.82 to 0.91). Significant correlations were identified between all factors and the Interpersonal Reactivity Index-C (IRI-C) and the Generalized Anxiety Disorder-7 (GAD-7). The Chinese ITC-SOPI had good psychometric properties, suggesting that it is a reliable and valid tool for evaluating media users’ sense of presence in a Chinese-speaking context.


2021 ◽  
Author(s):  
Fereshte Momeni ◽  
Mobina Hoseinpour Moqadam ◽  
Mohammadreza Davoudi ◽  
Nooshindokht MobarakAbadi ◽  
Samaneh Hosseinzadeh

Abstract Background: Recently, 36-item COVID Stress Scales (CSS) was designed for assessing anxiety and stress related to COVID-19 outbreak. The present study aimed to evaluate the psychometric properties of the Persian version of CSS in the Iranian population.Methods: A total of 393 participants volunteered to cooperate in the present study via an online survey. They completed a collection of scales, including the CSS, COVID-19 Phobia Scale (C19P-S), and Brief Symptom Inventory (BSI). The CSS reliability was determined by calculating Cronbach alpha and test-retest reliability. The validity assessed by Pearson correlation among the CSS and its subscales with C19P-S and BSI. Exploratory Factor Analysis (EFA) and Confirmatory factor analysis (CFA) was used to evaluate the structure of CSS. All analysis assessed by SPSS-26 software.Results: Results showed that 45.3% of the participant’s age were in 18-25 years. Moreover, 72.8 % of the participants were female. Also, Cronbach’s alpha for all subscale was between0.83 to 0.92. The test-retest reliability coefficient of CSS was 0.87. The correlation between the CSS, BSI and C19P-S showed that CSS has suitable convergent validity. CFA and EFA showed that the 5-factor of CSS is the best model. Conclusion: To conclude, Persian version of CSS has suitable psychometric properties for utilizing in Iranian population.


2020 ◽  
Author(s):  
Karolina Vlckova ◽  
Eva Hoschlova ◽  
Eva Chroustova ◽  
Martin Loucka

Abstract Background: Outcome measurement is an essential part of the evaluation of palliative care and the measurements need to be reliable, valid and adapted to the culture in which they are used. The Integrated Palliative Outcome Scale (IPOS) is a widely used tool for assessing personal-level outcomes in palliative care. The aim of this study was to provide Czech version of IPOS and asses its psychometric properties. Methods: Patients receiving palliative care in hospice or hospitals completed the IPOS. The reliability of Czech IPOS was tested with Cronbach alpha (for internal consistency), the intraclass correlation coefficient for total IPOS score and weighted Kappa (for test-retest reliability of individual items). Factor analysis was used for elucidating the construct (Exploratory Factor Analysis). Convergent validity was tested with correlation analysis (Spearman correlation) in a part of the sample, who completed also the Edmonton Symptom Assessment System (ESAS) and the Palliative Performance Scale (PPS). Results: The sample consisted of 140 patients (mean age 72; 90 women; 81 % oncological disease). The Cronbach alpha was 0.789; intraclass correlation was 0.88. The correlations of IPOS with ESAS was R= 0.4 and PPS R= -0.2. Exploratory factor analysis revealed a 2-factor solution on our data. The first factor covers emotional and information needs and the second factor covers physical symptoms. Conclusion: Czech IPOS has very good reliability regarding both internal consistency and test-retest reliability. Together with an item analysis results, we can conclude that the Czech adaptation of the tool was successful. The convergent validity needs to be assessed on the larger sample and the proposed 2-factor internal structure of the questionnaire has to be confirmed by using CFA.


2020 ◽  
Author(s):  
Karolina Vlckova ◽  
Eva Hoschlova ◽  
Eva Chroustova ◽  
Martin Loucka

Abstract Background: Outcome measurement is an essential part of the evaluation of palliative care and the measurements need to be reliable, valid and adapted to the culture in which they are used. The Integrated Palliative Outcome Scale (IPOS) is a widely used tool for assessing personal-level outcomes in palliative care. The aim of this study was to provide Czech version of IPOS and asses its psychometric properties. Methods: Patients receiving palliative care in hospice or hospitals completed the IPOS. The reliability of Czech IPOS was tested with Cronbach alpha (for internal consistency), the intraclass correlation coefficient for total IPOS score and weighted Kappa (for test-retest reliability of individual items). Factor analysis was used for elucidating the construct (Exploratory Factor Analysis). Convergent validity was tested with correlation analysis (Spearman correlation) in a part of the sample, who completed also the Edmonton Symptom Assessment System (ESAS) and the Palliative Performance Scale (PPS). Results: The sample consisted of 140 patients (mean age 72; 90 women; 81 % oncological disease). The Cronbach alpha was 0.789; intraclass correlation was 0.88. The correlations of IPOS with ESAS was R= 0.4 and PPS R= -0.2. Exploratory factor analysis revealed a 2-factor solution on our data. The first factor covers emotional and information needs and the second factor covers physical symptoms. Conclusion: Czech IPOS has very good reliability regarding both internal consistency and test-retest reliability. Together with an item analysis results, we can conclude that the Czech adaptation of the tool was successful. The convergent validity needs to be assessed on the larger sample and the proposed 2-factor internal structure of the questionnaire has to be confirmed by using CFA.


2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.


2020 ◽  
Vol 66 (4) ◽  
pp. 411-418
Author(s):  
Srividya N Iyer ◽  
Megan A Pope ◽  
Gerald Jordan ◽  
Greeshma Mohan ◽  
Heleen Loohuis ◽  
...  

Objectives: Views on who bears how much responsibility for supporting individuals with mental health problems may vary across stakeholders (patients, families, clinicians) and cultures. Perceptions about responsibility may influence the extent to which stakeholders get involved in treatment. Our objective was to report on the development, psychometric properties and usability of a first-ever tool of this construct. Methods: We created a visual weighting disk called ‘ShareDisk’, measuring perceived extent of responsibility for supporting persons with mental health problems. It was administered (twice, 2 weeks apart) to patients, family members and clinicians in Chennai, India ( N = 30, 30 and 15, respectively) and Montreal, Canada ( N = 30, 32 and 15, respectively). Feedback regarding its usability was also collected. Results: The English, French and Tamil versions of the ShareDisk demonstrated high test–retest reliability ( rs = .69–.98) and were deemed easy to understand and use. Conclusion: The ShareDisk is a promising measure of a hitherto unmeasured construct that is easily deployable in settings varying in language and literacy levels. Its clinical utility lies in clarifying stakeholder roles. It can help researchers investigate how stakeholders’ roles are perceived and how these perceptions may be shaped by and shape the organization and experience of healthcare across settings.


2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.


2020 ◽  
Author(s):  
Julia Velten ◽  
Gerrit Hirschfeld ◽  
Milena Meyers ◽  
Jürgen Margraf

Background: The Sexual Interest and Desire Inventory Female (SIDI-F) is a clinician-administered scale that allows for a comprehensive assessment of symptoms related to Hypoactive Sexual Desire Dysfunction (HSDD). As self-report questionnaires may facilitate less socially desirable responding and as time and resources are scarce in many clinical and research settings, a self-report version was developed (SIDI-F-SR). Aim: To investigate the agreement between the SIDI-F and a self-report version (SIDI-F-SR) and assess psychometric properties of the SIDI-F-SR. Methods: A total of 170 women (Mage=36.61, SD=10.61, range=20-69) with HSDD provided data on the SIDI-F, administered by a clinical psychologist via telephone, and the SIDI-F-SR, delivered as an Internet-based questionnaire. A subset of 19 women answered the SIDI-F-SR twice over a period of 14 weeks. Outcomes: Intraclass correlation as well as predictors of absolute agreement between SIDI-F and SIDI-F-SR, as well as internal consistency, test-retest reliability, and criterion-related validity of the SIDI-F-SR were examined. Results: There was high agreement between SIDI-F and SIDI-F-SR (ICC=.86). On average, women scored about one point higher in the self-report vs. the clinician-administered scale. Agreement was higher in young women and those with severe symptoms. Internal consistency of the SIDI-F-SR was acceptable (α=.76) and comparable to the SIDI-F (α=.74). When corrections for the restriction of range were applied, internal consistency of the SIDI-F-SR increased to .91. Test-retest-reliability was good (r=.74). Criterion-related validity was low but comparable between SIDI-F and SIDI-F-SR.


2019 ◽  
Vol 46 (1) ◽  
pp. 67-75 ◽  
Author(s):  
Samuel F. Whitley ◽  
Yojanna Cuenca-Carlino

Many schools attempt to identify and service students at risk for poor mental health outcomes within a multi-tiered system of support (MTSS). Universal screening within a MTSS requires technically adequate tools. The Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) has been put forth as a technically adequate screener. Researchers have examined the factor structure, diagnostic accuracy, criterion validity, and internal consistency of SAEBRS data. However, previous research has not examined its temporal stability or replicated the criterion validity results with a racially/ethnically diverse urban elementary school sample. This study examined the test–retest reliability, convergent validity, and predictive validity of teacher-completed SAEBRS ratings with racially/ethnically diverse group students enrolled in first through fifth grade in an urban elementary school. Reliability analyses resulted in significant test–retest reliability coefficients across four weeks for all SAEBRS scales. Furthermore, nonsignificant paired samples t tests were observed with the exception of the third-grade Emotional subscale. Validity analyses yielded significant concurrent and predictive Pearson correlation coefficients between SAEBRS ratings, oral reading fluency, and office discipline referrals. Limitations and implications of the results are discussed.


Sign in / Sign up

Export Citation Format

Share Document