scholarly journals Measurement of Sustainment of Prevention Programs and Initiatives: The Sustainment Measurement System Scale

2020 ◽  
Author(s):  
Lawrence A. Palinkas ◽  
Chih-Ping Chou ◽  
Suzanne E. Spear ◽  
Sapna J. Mendon ◽  
Juan A. Villamar ◽  
...  
Keyword(s):  
Measurement System ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Prevention Programs ◽  
Program Outcomes ◽  
Good Reliability ◽  
Community Needs ◽  
Convergent And Discriminant Validity ◽  
Community Based Programs ◽  
Evaluation Feedback

Abstract Background: Enhancing the sustainability of evidence-based prevention programs for mental and behavioral health requires tools for measuring both sustainability determinants and sustainment outcomes. The aim of this study was to develop the Sustainment Measurement System Scale (SMSS) and to assess its reliability and construct validity for measuring both determinants and outcomes of efforts to sustain prevention programs and initiatives. Methods: A 42-item scale comprised of items identified from qualitative data collected from 45 representatives of 10 programs and 8 SAMHSA program officers was administered to 186 representatives of 145 programs funded by 7 SAMHSA prevention grant initiatives. Cronbach’s alphas were used to determine inter-item reliability. Convergent validity was assessed by comparisons of a global measure of sustainment with current SAMHSA-funding status and continued operation in the same form. Discriminant validity was assessed by comparisons of sustainability determinants with whether or not the program had undergone adaptations. Results: Confirmatory Factor Analysis provided support for a 35-item model fit to the data. Cronbach’s alpha was .84 for the sustainment outcome construct and ranged from .70 to .93 for the sustainability determinants constructs. All of the determinant constructs were significantly associated with sustainment outcome individual and global measures for the entire sample (p < 0.01 to 0.001) and for community-based programs and programs with a substance abuse focus (p < 0.05 to 0.001). Convergent validity was supported by significant associations between the global sustainment measure and current SAMHSA funding status and continued operation in the same form (p < 0.001). Four of the sustainability determinant constructs (responsive to community needs; coalitions, partnerships and networks; organizational staff capability; and evaluation, feedback and program outcomes) were also significantly associated with current SAMHSA funding status (p < 0.5 to 0.01). With the exception of organizational staff capability, all sustainability determinants were unrelated to program adaptation as predicted. Conclusions: The SMSS demonstrated good reliability and convergent and discriminant validity in assessing likelihood of sustainment of SAMHSA funded prevention programs and initiatives. The measure demonstrates potential in identifying predictors of program sustainment and as a tool for enhancing the likelihood of successful sustainment through ongoing evaluation and feedback.

scholarly journals Measurement of Sustainment of Prevention Programs and Initiatives: The Sustainment Measurement System Scale

2020 ◽  
Author(s):  
Lawrence A. Palinkas ◽  
Chih-Ping Chou ◽  
Suzanne E. Spear ◽  
Sapna J. Mendon ◽  
Juan A. Villamar ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Measurement System ◽  
Discriminant Validity ◽  
Prevention Programs ◽  
Good Reliability ◽  
Determinant Factors ◽  
Convergent And Discriminant Validity ◽  
Confirmatory Factor ◽  
Principal Axis Factor Analysis ◽  
Item Scale

Abstract Background A large knowledge gap exists regarding the measurement of sustainability of evidence-based prevention programs for mental and behavioral health. This paper describes an instrument that is a component of the Sustainment Measurement System (SMS), designed to assess both determinants and outcomes of efforts to sustain prevention programs and initiatives. Methods A 42-item scale was administered to 186 representatives of 145 programs funded by 7 SAMHSA prevention grant initiatives. Scale items were identified from qualitative data collected from 45 representatives of 10 programs and 8 SAMHSA program officers and organized into 9 categories of sustainment determinants and sustainment outcomes. Factor structure identified from principal axis factor analysis and elimination of items with CFA coefficients less than .300 resulted in a 35-item scale with 8 determinant factors and 1 outcome factor. Results Confirmatory Factor Analysis provided support for a 35-item model fit to the data. The SMSS demonstrated good inter-item reliability and all determinant factors were significantly associated with sustainment outcome individual and global measures. Conclusions The SMSS is easy to use and demonstrates good reliability and convergent and discriminant validity in assessing likelihood of sustainment of SAMHSA funded prevention programs and initiatives upon termination of original funding. The measure demonstrates potential in identifying predictors of program sustainment and as a tool for enhancing the likelihood of successful sustainment through ongoing evaluation and feedback.

An Initial Investigation of the Use of Comparative Referents to Assess Social Anxiety

2018 ◽  
Vol 34 (6) ◽  
pp. 367-375 ◽  
Author(s):  
Laura D. Seligman ◽  
Erin F. Swedish ◽  
Jason P. Rose ◽  
Jessica M. Baker
Keyword(s):  
Social Anxiety ◽  
Discriminant Validity ◽  
Self Report ◽  
Injunctive Norms ◽  
Good Reliability ◽  
Convergent And Discriminant Validity ◽  
Excellent Internal Consistency ◽  
Social Quality Of Life ◽  
Comparison Measures

Abstract. The current study examined the validity of two self-report measures of social anxiety constructed using social comparative referent points. It was hypothesized that these comparison measures would be both reliable and valid. Results indicated that two different comparative versions – one invoking injunctive norms and another invoking descriptive norms – showed good reliability, excellent internal consistency, and acceptable convergent and discriminant validity. The comparative measures also predicted positive functioning, some aspects of social quality of life, and social anxiety as measured by an independent self-report. These findings suggest that adding a comparative reference point to instructions on social anxiety measures may aid in the assessment of social anxiety.

A Validation Study of the Adolescent Risk-taking Questionnaire

2000 ◽  
Vol 17 (3) ◽  
pp. 143-154 ◽  
Author(s):  
Eleonora Gullone ◽  
Jacqueline Paul ◽  
Susan M. Moore
Keyword(s):  
Juvenile Justice ◽  
Risk Taking ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Past Research ◽  
Parent Attachment ◽  
Male Adolescents ◽  
Risk Beliefs ◽  
Convergent And Discriminant Validity ◽  
Adolescent Risk

AbstractThe Adolescent Risk-taking Questionnaire (ARQ) was developed to comprehensively assess adolescent risk-taking beliefs and behaviours. Research has shown that it is a reliable instrument with strong construct validity. The current study investigated the convergent and discriminant validity of the ARQ by comparing responses of a sample of 52 male adolescents from a juvenile justice centre and 211 school-attending male adolescents. Consistent with past research, the juvenile justice centre youth reported significantly higher levels of depression and less optimal levels of parent attachment compared to school-attending youth. Convergent validity of the ARQ was demonstrated through significant relationships between attachment and risk-taking. Specifically, those adolescents with less optimal parent attachment were more likely to engage in risk-taking behaviour and were less likely to perceive the behaviours included in the ARQ as risky compared to those with more optimal levels of parent attachment. Discriminant validity of the ARQ was demonstrated through significant differences between the two groups on risk beliefs and behaviours. Responses on the ARQ indicated that youth from the juvenile justice centre were significantly more likely to engage in risky behaviours, if given the opportunity, than school-based youth. They also perceived the behaviours to be less risky. It was concluded that the ARQ has good convergent and discriminant validity.

scholarly journals Reliability and Validaty of St George Respiratory Questionnaire (SGRQ) into Indonesian Version

2014 ◽  
Vol 3 (3) ◽  
pp. 179
Author(s):  
Adnan Adnan ◽  
Dyah Aryani Perwitasari ◽  
Ully Adhie Mulyani
Keyword(s):  
Quality Of Life ◽  
Factor Analysis ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Special Instrument ◽  
Convergent And Discriminant Validity ◽  
Group Validity ◽  
Section Design ◽  
St George's Respiratory Questionnaire

Tuberculosis (TB) is one of the disease as the highest contributor to the disease burden in Indonesia. Tuberculosis can affect the patients’ quality of life, such as psychological, physical, and social functioning. St. George's Respiratory Questionnaire (SGRQ) is a special instrument which was widely used to measure the patients’ quality of life with respiratory disease. The objective of this study was to validate the Indonesian version of the SGRQ as instrument to collect data. A descriptive cross section design with 61 subjects was conducted at the Pulmonary Clinics and Primary Health Centers in the region of Yogyakarta within 3 months. The validation process included the known group validity, convergent and discriminant validity and factor analysis. There were 14 items question numbers which did not meet the criteria for convergent validity and 9 items which did not meet the criteria for discriminant validity. Known group validity analysis on gender showed that of the three domains of SGRQ, the activity domain gave statistically significant result. The factor analysis showed the result of Kaiser Meyer Olkin analysis (KMO) was less than 0.5. With a few modifications, the Indonesian version of SGRQ is valid and reliable for measuring quality of life in tuberculosis patients.

scholarly journals Psychometric Performance of Resilience Scale for Chinese Adolescent (RSCA) for Undergraduates in Guangdong, China

2021 ◽  
Vol 6 (2) ◽  
pp. 86-93
Author(s):  
Hou Yongmei ◽  
Wang Yiyang
Keyword(s):  
Success Rate ◽  
Principal Components ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Floor Effect ◽  
Psychometric Performance ◽  
Convergent And Discriminant Validity ◽  
Resilience Scale ◽  
Chinese Adolescent ◽  
Variance Contribution

To analyze the psychometric performance of Resilience Scale for Chinese Adolescent (RSCA) for undergraduates in Guangdong. Stratified random sampling method was used to select 1628 undergraduates from 7 colleges in Guangdong. RSCA and Academic Burnout Scale for Chinese Undergraduates (ABSCU) were used to investigate them. Cronbach's αcoefficient and split-half reliability were used to analyze the internal consistency of RSCA. Convergent validity, discriminant validity, factor analysis and criterion validity were used to evaluate its validity. Celling and floor effect were used to analyze its sensitivity. Cronbach's α coefficient of the total questionniar, 2 domains and 5 factors were0.72-0.86, which met the requirements of the group comparison. Spearman-Brown split-half coefficient of the total questionniar, 2 domains and 5 factors were 0.71-0.89. The calibration success rate of convergent and discriminant validity of 5 factors were all 100%. The calibration success rate of convergent and discriminant validity of 2 domains were all above 86.7%. Five principal components obtained from 27 items, witha cumulative variance contribution rate of48.79% and two principal components obtained from 5 factors, withacumulative variance contribution rateof 65.23%,which basically metthe theoretical conception of RSCA. The total score of RSCA significantly predicted the total score of ABSCU (Radj2=0.158, P<0.001). The total score, scores of 2 domains and 5 factors of RSCA were all normal distribution, without any celling or floor effect. The psychometric performance of RSCA for undergraduates in Guangdong were valid and reliable.

scholarly journals Convergent and Discriminant Validity of Personality Inventory for DSM-5-BF in a Primary Care Sample

2019 ◽  
Vol 33 (6) ◽  
pp. 846-856 ◽  
Author(s):  
John H. Porcerelli ◽  
Christopher J. Hopwood ◽  
John R. Jones
Keyword(s):  
Primary Care ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Screening Tool ◽  
Personality Inventory ◽  
Dsm 5 ◽  
Primary Care Settings ◽  
Convergent And Discriminant Validity ◽  
Growing Body ◽  
Psychiatric Screening

A growing body of research supports the validity of the Personality Inventory for DSM-5 (PID-5) in evaluating community and psychiatric samples. Although maladaptive personality also has significant relevance in primary care settings, research on the PID-5 in primary care samples is limited. In this study, the authors examined the intercorrelations, convergent validity, and discriminant validity of the brief form of the PID-5 (PID-5-BF) in 100 primary care outpatients. Results are consistent with findings in other samples in suggesting that PID-5 domains are moderately intercorrelated and associated with a variety of mental health variables. Smaller associations with physical health variables support the discriminant validity of the instrument. Overall, results suggest that the PID-5-BF can provide a useful psychiatric screening tool in primary care settings.

Leniency Effects on Convergent and Discriminant Validity for Grouped Questionnaire Items: A Further Investigation

1981 ◽  
Vol 41 (4) ◽  
pp. 1093-1099 ◽  
Author(s):  
Chester A. Schriesheim
Keyword(s):  
Correlation Matrix ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Leader Behavior ◽  
Matrix Analysis ◽  
Discount Store ◽  
Convergent And Discriminant Validity ◽  
Questionnaire Validity ◽  
Behavior Description ◽  
The Impact

Two previous investigations revealed that grouping (rather than randomizing) questionnaire items measuring similar constructs (in subsections) resulted in impaired discriminant validity (Schrie-sheim and DeNisi, 1980) and that grouping also strengthened the impact of leniency response bias (Schriesheim, 1981). This study reanalyzed the data of the two earlier investigations to determine whether the impairment of the discriminant validity of the grouped questionnaire items might be due to spurious correlations attributable to leniency. The responses of thirty discount store employees to a questionnaire containing grouped items measuring leniency in leader behavior descriptions (Schriesheim, 1980) and four similar constructs from the Leader Behavior Description Questionnaire (Stogdill, 1963) and Four-Factor Theory Questionnaire (Taylor and Bowers, 1972) were examined for convergent and discriminant validity by using a traditional zero-order multitrait-multimethod correlation matrix analysis (Campbell and Fiske, 1959) and by statistically controlling the effect of spurious correlation attributable to leniency (by computing a first-order partial multitrait-multimethod correlation matrix, controlling for leniency as measured by the leniency scale). It was found that controlling for leniency resulted in a slight decrement in convergent validity, but that discriminant validity was substantially improved. Implications for questionnaire validity and further research are discussed.

scholarly journals Psychometric Qualities Evaluation of the Interdependent Happiness Scale across Malaysia, Philippines, and India

2021 ◽  
Vol 19 (1) ◽  
pp. 187
Author(s):  
Chee-Seng Tan ◽  
Shue-Ling Chong ◽  
Argel Bondoc Masanda ◽  
Sanju George
Keyword(s):  
Convergent Validity ◽  
Discriminant Validity ◽  
Self Report ◽  
Three Dimensions ◽  
Order Structure ◽  
Cultural Backgrounds ◽  
Good Reliability ◽  
Three Samples ◽  
Cultural Usability ◽  
Interdependent Happiness

The nine-item Interdependent Happiness Scale (IHS; Hitokoto & Uchida, 2015) is a self-report of interpersonal happiness that focuses on three dimensions: relationship-oriented happiness, quiescent happiness, and ordinary happiness. Few studies have evaluated the psychometric properties of the IHS in diverse cultural backgrounds and the findings are inconsistent. This study investigated whether the IHS has sound psychometric qualities in three Asian countries. University students from Malaysia (n = 263), Philippines (n = 239), and India (n = 310) answered the IHS and self-rated creativity scale. Confirmatory factor analysis on each sample supported the nine-item second-order model with error covariances. The overall IHS score showed good reliability in all samples. The subscales, however, had mixed results except for the Indian sample. Similarly, the convergent validity test showed mixed results while discriminant validity is supported in all samples except for the quiescent happiness subscale in the Indian sample. Concurrent validity was established across three samples by showing a positive relationship with creativity score. The results highlight that the higher-order structure of the IHS is consistently supported in different cultural contexts. However, some of the items are perceived differently and require further improvement in enhancing the cross-cultural usability of the IHS to measure socially-oriented happiness.

scholarly journals Convergent and discriminant validity of psychiatric symptoms reported in The Norwegian Mother and Child Cohort Study at age 3 years with independent clinical assessment in the Longitudinal ADHD Cohort Study

2014 ◽  
Vol 24 (1-2) ◽  
Author(s):  
Guido Biele ◽  
Pål Zeiner ◽  
Heidi Aase
Keyword(s):  
Cohort Study ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Separation Anxiety ◽  
Psychiatric Symptoms ◽  
Epidemiological Studies ◽  
Future Research ◽  
Convergent And Discriminant Validity ◽  
Mother And Child ◽  
Parent Questionnaires

Epidemiological studies often use parent questionnaires to assess children's development and mental health. To date, few studies have investigated the validity of parent questionnaires with standardized clinical assessments as criterion. The current study examines discriminant and convergent validity of parent questionnaires for symptoms of Attention Deficit Hyperactivity Disorder (ADHD), Oppositional Defiance Disorder (ODD), and Conduct Disorder (CD) as well as symptoms of Separation Anxiety employed in the Norwegian Mother and Child Cohort Study by using structured clinical interviews performed 5 months later in the Longitudinal ADHD Cohort Study as a criterion. The comparison of confirmatory factor analysis models and examination of factor correlations indicate convergent and discriminant validity of MoBa parent questionnaires for preschool children, especially for the assessment of ADHD and ODD/CD. Future research should attempt to further improve parent questionnaires, examine their validity in representative samples, and explicitly test their utility for screening.

scholarly journals Convergent and Discriminant Validity of the Barthel Index and the EQ-5D-3L When Used on Older People in a Rehabilitation Setting

2021 ◽  
Vol 18 (19) ◽  
pp. 10314
Author(s):  
Billingsley Kaambwa ◽  
Norma B. Bulamu ◽  
Christine Mpundu-Kaambwa ◽  
Raymond Oppong
Keyword(s):  
Older People ◽  
Physical Functioning ◽  
Barthel Index ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Convergent And Discriminant Validity ◽  
Empirical Performance ◽  
Status Measure ◽  
Scatter Plots ◽  
Spearman’S Correlation

This study compares the empirical performance of a commonly used functional-status measure, the Barthel Index (BI), to that of a widely used generic preference-based instrument, the EuroQoL-5-Dimensions 3 Level (EQ-5D-3L), in older people. Data from older people receiving rehabilitation services were used to test the validity of the BI and EQ-5D-3L. Convergent validity was investigated using Spearman’s correlation, exploratory factor analysis (EFA), scatter plots, Krippendorff’s alpha and modified Bland-Altman plots. Discriminant validity was examined using Kruskal Wallis tests, ceiling effects and EFA. A total of 1690 participants were included in the analysis. The BI total and EQ-5D-3L utility scores showed moderate correlation (r = 0.51; Krippendorff’s alpha = 0.52). Kendall’s Tau-B correlations between BI items and EQ-5D-3L dimensions measuring the same construct were weak to moderate (0.05 ≤ absolute r ≤ 0.54). In the EFA, some BI items cross-loaded onto the same factors as EQ-5D-3L dimensions, suggesting that the instruments were interrelated. The BI, however, focuses more on physical functioning, while the EQ-5D-3L measures broader wellbeing concepts. Both instruments showed good discriminant validity and would therefore be equally valuable for measuring subgroup differences. Researchers should consider using the BI in rehabilitation to capture more physical functioning-specific constructs not measured by the EQ-5D-3L.

Sign in / Sign up

Export Citation Format

Share Document