scholarly journals Assessing the reliability and validity of an outcomes star

2020 ◽  
Vol 15 (3) ◽  
pp. 109-122
Author(s):  
Daryl Sweet ◽  
Karen Winter ◽  
Laura Neeson ◽  
Paul Connolly
Keyword(s):  
Process Evaluation ◽  
Concurrent Validity ◽  
Reliability And Validity ◽  
Internal Validity ◽  
Principal Component ◽  
Cronbach’S Alpha ◽  
Internal Reliability ◽  
Content Type ◽  
Cronbach's Alpha ◽  
The Family

Purpose This paper aims to assess the reliability, validity and use of the Family Star Plus, one of several Outcomes Stars increasingly used as part of outcomes-based accountability approaches in the delivery of family support services. The Family Star Plus measures progress towards effective parenting but a lack of evidence exists on its psychometric properties and suitability for use as an outcomes tool. Design/methodology/approach Based on data from 1,255 families receiving a pilot support service, Cronbach’s alpha was used to assess the internal reliability of the 10-item scale, while principal component analysis (PCA) examined the number of constructs in the tool. Using matched data from evaluation of 80 families, correlations between the Family Star Plus and psychometrically validated tools were used to assess concurrent validity. Findings from a process evaluation explore practical issues around use of the tool. Findings Cronbach’s alpha indicated sufficient internal reliability of the Family Star Plus; however, the PCA raised questions concerning the internal validity the Star. Correlations between the Star and validated tools were not strong enough to support concurrent validity of the Star. Process evaluation findings highlight inconsistencies in Family Star Plus data capture, which may explain these differences. Practical implications Further work is required before the Family Star Plus can be considered for use as an outcome measure. Originality/value To the best of authors’ knowledge, this is the first peer-reviewed analysis of the psychometric qualities of the Family Star Plus.

scholarly journals Translation and validation of the traditional Chinese NLN educational practices questionnaire, simulation design scale and student satisfaction and self-confidence in learning

2020 ◽  
Vol 10 (8) ◽  
pp. 47
Author(s):  
Baljit Kaur Gill
Keyword(s):  
Student Satisfaction ◽  
Factor Structure ◽  
Reliability And Validity ◽  
Simulation Design ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Internal Reliability ◽  
Good Reliability ◽  
Cronbach's Alpha ◽  
Simulation Evaluation

Background and objective: Globally, the use of clinical simulation has been incorporated in different nursing programs. It is important to evaluate simulation using reliable and valid instruments. Using the same instrument helps to evaluate simulation under the same criteria both nationally and internationally. The National League of Nursing developed three simulation scales which is widely used in different countries and demonstrates a good reliability and validity. Nevertheless, it is only available in English. The aim of the study was to translate the original NLN simulation evaluation scales into Traditional Chinese and evaluate its psychometric properties.Methods: Beaton and colleague’s (2000) cross-cultural adaptation guidelines was adopted. Cronbach’s alpha coefficient (α) and Corrected item-total correlation was used to determine the internal reliability. Haccoun’s single group technique was used to assess the equivalent of the scale in the original and the translated version. Lastly, Exploratory Factor Analysis (EFA) was used to determine the factor structure and Intra-Class Correlation Coefficient (ICC) to test the stability of translated scale.Results: Nine simulation experts from Hong Kong, Mainland China, Singapore and Taiwan confirmed translation of the NLN scales (EPQ-C, SDS-C, SSCL-C). Cronbach’s alpha of all subscales and overall scales were acceptable (0.72-0.89). The intra-language, inter-language and temporal inter-language cross correlations between the original and translated scales were correlated (p < 0.01). ICC of the translated scales ranges from good to excellent (0.78-0.91). Lastly, EFA also demonstrated the items were theoretically coherent (≥ 0.40) and have the same factor structure as the original English version.Conclusions: Traditional Chinese NLN simulation evaluation scales demonstrated strong validity and reliability.

TABS: The Development and Testing of a Nicotine and Tobacco Use Research Tool

2020 ◽  
Vol 28 (2) ◽  
pp. 419-433
Author(s):  
Shai Lev ◽  
Strianie Shaina Louis ◽  
Rosemary Collier ◽  
Geraldine R. Britton
Keyword(s):  
Factor Analysis ◽  
Process Evaluation ◽  
Tobacco Use ◽  
Rapid Assessment ◽  
Reliability And Validity ◽  
Face Validity ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Campus Policy ◽  
And Behavior

Background and PurposeTobacco use is declining but the use of electronic nicotine delivery systems (ENDS) has increased in young populations. The Interdisciplinary Tobacco Use Research Program (ITURP) developed a survey assessing tobacco and ENDS use, and a tobacco-free campus policy. This project analyzes the reliability and validity of the Tobacco Attitude and Behavior Survey (TABS).MethodsContent and face validity, factor analysis, Cronbach's Alpha, and a process evaluation were assessed.ResultsFactor analysis revealed four constructs. Cronbach's alpha was .70. Process evaluation revealed that students involvement in TABS allowed rapid assessment of changes in ENDS use, and to modify questions based on student feedback.ConclusionReliability and validity are adequate for a new tool.

Development and Validation of a Multidimensional Instrument: Assessing Barriers to Dietary Practices

2020 ◽  
Vol 28 (2) ◽  
pp. E98-E138
Author(s):  
Enia Zigbuo-Wenzler ◽  
Gayenell S. Magwood ◽  
Martina Mueller ◽  
Angela Fraser
Keyword(s):  
Internal Validity ◽  
Principal Component ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Dietary Practices ◽  
Expert Review ◽  
Cronbach's Alpha ◽  
Component Solution ◽  
Health And Nutrition ◽  
Development And Validation

Background and PurposePoor dietary practices are linked to many chronic diseases. The purpose of this validation study was to develop a psychometrically sound instrument that can be administered by health practitioners to measure dietary barriers.MethodsThe Dietary Health Status (DHS) instrument, designed to measure dietary barriers is comprised of items in the National Health and Nutrition Examination Survey-What We Eat in America datasets. Content validity was established for DHS using an expert review process. Principal component analysis (PCA) was then used to assess validity and reliability as determined by Cronbach's alpha values.ResultsThe PCA supported a 10-component solution, explaining 61% of the total variance. Cronbach's alpha was .67 for the entire instrument, ranging from .55 to .87 for the 10 subscales.ConclusionResults suggest the instrument had sufficient construct and internal validity. This exploratory study is an important first step in validating the DHS instrument.

scholarly journals The Translation and Validation of The Smartphone Use Questionnaire (SUQ) Into The Malay Language

2021 ◽  
Vol 16 (2) ◽  
pp. 227-236
Author(s):  
Suzaily Wahab ◽  
Keyword(s):  
Factor Analysis ◽  
Psychometric Testing ◽  
Principal Component ◽  
Original Study ◽  
Face Validity ◽  
Cronbach’S Alpha ◽  
Internal Reliability ◽  
Language Version ◽  
Cronbach's Alpha ◽  
Smartphone Use

Interruptions caused by frequent smartphone use steals attention away from daily activities, bringing serious implications onto an individual’s health, safety and education. Smartphone Use Questionnaire (SUQ) is a 20-item questionnaire developed to assess the pattern of smartphone use and its effect on attention. This study was done to translate and validate the Malay-language version of the SUQ and to measure the psychometric properties of the Malay-version SUQ to justify its use in Malaysia. A forward and back-translation was done by four individuals, who were three physicians and one linguist. Content and face validity was done involving three experts who were a linguist, psychiatrist and epidemiologist. Psychometric testing was conducted on a sample of 195 individuals proficient in the Malay language. A construct validity test was performed using factor analysis and the internal reliability was tested by calculating for the Cronbach’s Alpha. The age range of the sample was 13-59 years, most of which were female and of the Malay race. Using principal component analysis with direct oblimin rotation, the factor analysis extracted two components similar to the original study: General Use and Absent-Minded Use. However, question number 20 was grouped into General Use component, whereas in the original study it was under the Absent- Minded Use component. The Cronbach’s Alpha for the obtained components was 0.884 and 0.927, respectively. This study found that the Malay-version SUQ was a valid and reliable instrument for use in Malaysia in assessing inattention associated with smartphone use.

scholarly journals Team-Based Learning Student Assessment Instrument (TBL-SAI) for measuring the effectiveness of TBL in a Saudi Medical School: Psychometric Analysis and differences by academic years

2019 ◽  
Author(s):  
Mutasim E Ibrahim
Keyword(s):  
Medical Students ◽  
Medical School ◽  
Student Assessment ◽  
Reliability And Validity ◽  
Principal Component ◽  
Factor Loading ◽  
Assessment Instrument ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Team Based Learning

Abstract Background Increasing the use of Team Based Learning (TBL) in health profession education reinforce the need to develop a proper instrument for measuring the applicability of this method. This study aimed to examine the psychometric properties of TBL-SAI and the mean score of instrument subscales by the different academic year of the students. Methods Across-sectional study was conducted at the University of Bisha, College of Medicine (UBCOM), Saudi Arabia. Medical students from second to fourth were included in the study. Participants were completed the TBL-SAI items to measure three subscales of accountability, preference for a lecture or TBL and satisfaction. Cronbach’s alpha, factor analysis, were checked the reliability and validity of the instrument. A principal component analysis (PCA) with varimax rotation was conducted on each subscale. ANOVA analyzed the TBL effectiveness related to the different years of medical school. Results Cronbach’s alpha was 0.798 and factor loading was greater than 0.40 for all the items, indicating the reliability and validity of the scale. In a PCA, accountability items generated two factors with loading >0.40, except items one and four. All preference and satisfaction items have factors loading > 0.40. Fourth-year students’ obtained significant highest mean scores for accountability (p=0.0.49), preferences (p=0.001) and satisfaction (p<0.001) compared to third and second years students. Conclusions TBL-SAI is a sound tool to measure the favor of TBL among medical students. Longitudinal studies are recommended to bring a clear picture of the effectiveness of TBL in UBCOM.

scholarly journals Validation of a Thai version of the Hope Scale among patients with acute myocardial infarction

2021 ◽  
Author(s):  
Ampika Inyoo ◽  
Rapin Polsook
Keyword(s):  
Myocardial Infarction ◽  
Acute Myocardial Infarction ◽  
Reliability And Validity ◽  
Principal Component ◽  
Simple Random Sampling ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Back Translation ◽  
Life Threatening

Background: Hope is essential for patients with acute myocardial infarction, which is often regarded as an active coping for those with life-threatening diseases. Higher hope consistently is related to better health outcomes. However, the instrument for assessing hope has not been previously tested among Thai patients. Objective: This study aimed to assess the validity and reliability of the Hope Scale among Thai patients with acute myocardial infarction patients. Methods: This was an instrument validation study conducted from March to December 2020. A total of 213 patients with acute myocardial infarction were included and selected using a simple random sampling. The back-translation method was used to translate an English version to a Thai version of the scale. Principal Component Analysis (PCA) and Cronbach’s alpha were used for construct validity and reliability. Results: The findings showed that the Cronbach’s alpha of the Thai version of the Hope Scale was acceptable (.75), and the scale consists of four factors, which explained 63.36 % of the total variance. Communalities in each factor ranged from .45 to .84. Overall, the appearance of the factor structures was reasonable and understandable. Conclusion: The reliability and validity of the Thai version of the Hope Scale were suitable for the measurement of hope in Thai patients. This scale can be used by nurses and others to assess hope in Thai patients with acute myocardial infarction. Funding: This study received funding from the 90th anniversary of Chulalongkorn University Fund (Ratchadaphiseksomphot Endowment Fund), Chulalongkorn University, Bangkok, Thailand (GCUGR1125633058M).

Psychometric Evaluation of the Wang Pregnancy Stress Scale: Revised for Taiwanese Women

2015 ◽  
Vol 23 (3) ◽  
pp. 409-424 ◽  
Author(s):  
Janet F. Wang ◽  
Anthony A. Billings
Keyword(s):  
Pregnant Women ◽  
High Reliability ◽  
Reliability And Validity ◽  
Psychometric Evaluation ◽  
Internal Consistency Reliability ◽  
Cronbach’S Alpha ◽  
Internal Reliability ◽  
Stress Scale ◽  
Cronbach's Alpha ◽  
Taiwanese Women

Background and Purpose: Develop and assess psychometric properties of the Wang Pregnancy Stress Scale for measuring stress among pregnant women in Taiwan. Methods: Data were collected in 3 obstetric and gynecological clinics in Taiwan; 485 pregnant women participated in this study. We used exploratory factor analysis and internal consistency reliability was measured using Cronbach’s alpha. Results: A 4-factor structure emerged for the Wang Pregnancy Stress Scale. The internal reliability of the scale as measured by Cronbach’s alpha was .898, with standardized alpha .905. Conclusions: The Wang Pregnancy Stress Scale has high reliability and validity in measuring pregnancy stress that would allow nurses or health care workers to measure women’s stress levels during pregnancy. Nurses can use the assessed pregnancy stress to alter intervention of care for their pregnant clients.

The Reynolds Adolescent Depression Scale in New Zealand Adolescents

2005 ◽  
Vol 39 (3) ◽  
pp. 136-140 ◽  
Author(s):  
Lyndon Walker ◽  
Sally Merry ◽  
Peter D. Watson ◽  
Elizabeth Robinson ◽  
Sue Crengle ◽  
...  
Keyword(s):  
New Zealand ◽  
Ethnic Groups ◽  
Convergent Validity ◽  
Adolescent Depression ◽  
Depression Scale ◽  
Reliability And Validity ◽  
Cronbach’S Alpha ◽  
School Students ◽  
Internal Reliability ◽  
Cronbach's Alpha

Objective: To examine aspects of the reliability and validity of the Reynolds Adolescent Depression Scale (RADS) in measuring depression in New Zealand adolescents of all major ethnic groups. Method: A sample of 9699 randomly selected New Zealand secondary school students participated in the Youth2000 Health and Wellbeing Survey which included the RADS. Data from this survey have been used to assess some aspects of the reliability and validity of the RADS in the New Zealand context across different ethnic groups. Cronbach's alpha, itemtotal score correlations, correlation to other questions and a factor analysis were done in order to examine the internal reliability, content validity, convergent validity and construct validity of the data and compare to the original Reynolds validation study. Results: Tests of the scale resulted in scores over 0.90 on Cronbach's alpha and high itemtotal score correlations, with a median correlation of 0.62 and 25 of the 30 correlations measuring more than 0.5. The scores were found to have similar factor structure to the original scale and the correlations to other depression related questions indicate acceptable concurrent validity. Conclusions: On all of the tests conducted, the RADS was found to have acceptable reliability and validity for New Zealand adolescents across the major different ethnic groups, indicating that it is a valid and appropriate instrument to use with New Zealand adolescents.

Reliability and validity of the Spanish (Spain) version of the consultation and relational empathy measure in primary care

2020 ◽  
Author(s):  
Loreto García del Barrio ◽  
Cristina Rodríguez-Díez ◽  
Raquel Martín-Lanas ◽  
Patricio Costa ◽  
Manual J Costa ◽  
...  
Keyword(s):  
Primary Care ◽  
Primary Care Physicians ◽  
Reliability And Validity ◽  
Cronbach’S Alpha ◽  
Internal Reliability ◽  
Cronbach's Alpha ◽  
Back Translation ◽  
The One ◽  
Physician Empathy ◽  
Care Measure

Abstract Background Empathy is an essential competence in the medical field. There are no validated patient-rated empathy measures in Spanish (Spain). The Consultation and Relational Empathy (CARE) measure is a widely used patient-rated measure of physician empathy. Objective To analyse the reliability and validity of the Spanish (Spain) version of the CARE measure in primary care. Methods After translation, back translation and pilot testing, a convenient sample of 369 patients recruited through 21 primary care physicians in five primary care centres in Pamplona (Navarre, Spain) completed the Spanish (Spain) CARE (Sp-CARE) measure. The number of ‘does not apply’ or blank responses was calculated to assess acceptability. We analysed internal reliability by means of Cronbach’s alpha and ordinal alpha and homogeneity with corrected item-total correlations. The construct validity was examined by confirmatory factor analysis (CFA) and concurrent validity by Spearman’s correlation. Results We observed high acceptability; only 37 (1%) responses were marked ‘does not apply’ and only 3 (0.08%) were left blank. Cronbach’s alpha and ordinal alpha for the Sp-CARE measure were 0.953 and 0.970, respectively, and all corrected item-total correlations exceeded the accepted cut of 0.30, demonstrating high internal reliability and homogeneity. CFA corroborated the one-factor structure proposed in the original version. The Sp-CARE measure total score was significantly correlated with overall patient satisfaction (Spearman’s rho 0.45, P &lt; 0.001). Conclusion The results support the reliability and validity of the Sp-CARE measure as a patient-rated empathy measure in the primary care setting.

scholarly journals Validation of revised patient measures of safety: PMOS-30 and PMOS-10

BMJ Open ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. e031355
Author(s):  
Gemma Louch ◽  
Caroline Reynolds ◽  
Sally Moore ◽  
Claire Marsh ◽  
Jane Heyhoe ◽  
...  
Keyword(s):  
Data Analysis ◽  
Psychometric Properties ◽  
Reliability And Validity ◽  
Secondary Data ◽  
Secondary Data Analysis ◽  
Face Validity ◽  
Primary Data ◽  
Cronbach’S Alpha ◽  
Internal Reliability ◽  
Cronbach's Alpha

ObjectivesThere is growing evidence that patients can provide feedback on the safety of their care. The 44-item Patient Measure of Safety (PMOS) was developed for this purpose. While valid and reliable, the length of this questionnaire makes it potentially challenging for routine use. Our study aimed to produce revised, shortened versions of PMOS (PMOS-30 and PMOS-10), which retained the psychometric properties of the longer version.ParticipantsTo produce a shortened diagnostic measure, we analysed data from 2002 patients who completed PMOS-44, and examined the reliability of the revised measure (PMOS-30) in a sample of 751 patients. To produce a brief standalone measure, we again analysed data from 2002 patients who completed PMOS-44, and tested the reliability and validity of the brief standalone measure (PMOS-10) in a sample of 165 patients.MethodsThe process of shortening the questionnaire involved a combination of secondary data analysis (eg, Standard Deviation and inter-item correlations) and a consensus group exercise to produce PMOS-30 and examine face validity. Analysis of PMOS-30 data examined reliability (eg, Cronbach’s alpha). Further secondary data analysis (ie, corrected item-total correlations) produced PMOS-10, and primary data collection assessed its reliability and validity (eg, Cronbach’s alpha, analysis of variance).ResultsFourteen items were removed to produce PMOS-30 and the percentage of negatively worded items was reduced from 57% to 33%. PMOS-30 demonstrated good internal reliability (α=0.89). The 10 items with the highest corrected item-total correlations across both PMOS-44 and PMOS-30 composed PMOS-10. PMOS-10 had good internal reliability (α=0.79), demonstrated convergent validity; however, discriminant validity was not established.ConclusionsTwo revised, shortened versions of the original PMOS-44 (PMOS-30 and PMOS-10) were produced to capture patient feedback about safety in hospital. The measures demonstrated good reliability and validity, and preserved the psychometric properties of the original measure.

Sign in / Sign up

Export Citation Format

Share Document