scholarly journals Measurement of Sustainment of Prevention Programs and Initiatives: The Sustainment Measurement System Scale

2020 ◽  
Author(s):  
Lawrence A. Palinkas ◽  
Chih-Ping Chou ◽  
Suzanne E. Spear ◽  
Sapna J. Mendon ◽  
Juan A. Villamar ◽  
...  

Abstract Background A large knowledge gap exists regarding the measurement of sustainability of evidence-based prevention programs for mental and behavioral health. This paper describes an instrument that is a component of the Sustainment Measurement System (SMS), designed to assess both determinants and outcomes of efforts to sustain prevention programs and initiatives. Methods A 42-item scale was administered to 186 representatives of 145 programs funded by 7 SAMHSA prevention grant initiatives. Scale items were identified from qualitative data collected from 45 representatives of 10 programs and 8 SAMHSA program officers and organized into 9 categories of sustainment determinants and sustainment outcomes. Factor structure identified from principal axis factor analysis and elimination of items with CFA coefficients less than .300 resulted in a 35-item scale with 8 determinant factors and 1 outcome factor. Results Confirmatory Factor Analysis provided support for a 35-item model fit to the data. The SMSS demonstrated good inter-item reliability and all determinant factors were significantly associated with sustainment outcome individual and global measures. Conclusions The SMSS is easy to use and demonstrates good reliability and convergent and discriminant validity in assessing likelihood of sustainment of SAMHSA funded prevention programs and initiatives upon termination of original funding. The measure demonstrates potential in identifying predictors of program sustainment and as a tool for enhancing the likelihood of successful sustainment through ongoing evaluation and feedback.

2020 ◽  
Author(s):  
Rachele Benjamin ◽  
Steven Heine

The uncanny valley is a topic for engineers, animators, and experimental psychologist, yet uncanniness is without a clear definition. Across 3 studies, we developed a 16-item scale measuring uncanny feelings, finding that uncanniness is discriminable from other emotions. In Study 1, we conducted an exploratory factor analysis of uncanny feelings. In Study 2, we measured the convergent and discriminant validity of our 16-item scale, establishing that participants who watched an uncanny video responded with more uncanny feelings than those who watched a disgusting, fearful, or neutral video. In Study 3, we conducted a high-powered confirmatory factor analysis to assess the reliability of the 2-factor model on a new sample. These studies contribute to the psychological and interdisciplinary understanding of this strange, eerie phenomenon of being confronted with what looms just beyond our understanding.


2020 ◽  
Author(s):  
Lawrence A. Palinkas ◽  
Chih-Ping Chou ◽  
Suzanne E. Spear ◽  
Sapna J. Mendon ◽  
Juan A. Villamar ◽  
...  

Abstract Background: Enhancing the sustainability of evidence-based prevention programs for mental and behavioral health requires tools for measuring both sustainability determinants and sustainment outcomes. The aim of this study was to develop the Sustainment Measurement System Scale (SMSS) and to assess its reliability and construct validity for measuring both determinants and outcomes of efforts to sustain prevention programs and initiatives. Methods: A 42-item scale comprised of items identified from qualitative data collected from 45 representatives of 10 programs and 8 SAMHSA program officers was administered to 186 representatives of 145 programs funded by 7 SAMHSA prevention grant initiatives. Cronbach’s alphas were used to determine inter-item reliability. Convergent validity was assessed by comparisons of a global measure of sustainment with current SAMHSA-funding status and continued operation in the same form. Discriminant validity was assessed by comparisons of sustainability determinants with whether or not the program had undergone adaptations. Results: Confirmatory Factor Analysis provided support for a 35-item model fit to the data. Cronbach’s alpha was .84 for the sustainment outcome construct and ranged from .70 to .93 for the sustainability determinants constructs. All of the determinant constructs were significantly associated with sustainment outcome individual and global measures for the entire sample (p < 0.01 to 0.001) and for community-based programs and programs with a substance abuse focus (p < 0.05 to 0.001). Convergent validity was supported by significant associations between the global sustainment measure and current SAMHSA funding status and continued operation in the same form (p < 0.001). Four of the sustainability determinant constructs (responsive to community needs; coalitions, partnerships and networks; organizational staff capability; and evaluation, feedback and program outcomes) were also significantly associated with current SAMHSA funding status (p < 0.5 to 0.01). With the exception of organizational staff capability, all sustainability determinants were unrelated to program adaptation as predicted. Conclusions: The SMSS demonstrated good reliability and convergent and discriminant validity in assessing likelihood of sustainment of SAMHSA funded prevention programs and initiatives. The measure demonstrates potential in identifying predictors of program sustainment and as a tool for enhancing the likelihood of successful sustainment through ongoing evaluation and feedback.


Author(s):  
Karla Gallo-Giunzioni ◽  
María Prieto-Ursúa ◽  
Cristina Fernández-Belinchón ◽  
Octavio Luque-Reca

Given the scarcity of instruments in Spanish to measure forgiveness, two studies were conducted in this population to obtain validity evidence of the Heartland Forgiveness Scale (HFS), an instrument that measures dispositional forgiveness of self, others, and situations. In the first study, 203 students (65% women) participated. After ensuring the linguistic adequacy and clarity of the wording of the items, a lack of congruence was found between the factors obtained in the exploratory factor analysis and the original theoretical structure of the HFS. A sample of 512 participants (63.9% women) attended the second study. This study aimed to analyze the construct validity of the HFS using confirmatory factor analysis through structural equation modelling and to explore convergent, discriminant, and criterion validity. Of the different factorial configurations tested (including the original), only a scale reduction to eight items, grouped into three factors, showed an appropriate fit. The HFS eight-item version also showed acceptable internal consistency, adequate convergent and discriminant validity, and criterion validity with respect to related variables. These findings suggest that the eight-item version of the HFS may be a valid and reliable tool for assessing forgiveness for self, others, and situations in Spanish adults.


1994 ◽  
Vol 78 (2) ◽  
pp. 488-490 ◽  
Author(s):  
M. Afzalur Rahim ◽  
Clement Psenicka

Confirmatory factor analysis with LISREL 7 of data from 578 organizational members on the 29 items of the Rahim Leader Power Inventory provided support for the convergent and discriminant validities of the instrument measuring the bases of leaders' power and their invariance across organizational levels.


2017 ◽  
Vol 31 (3) ◽  
pp. 233-246
Author(s):  
Youngshin Song ◽  
Moonhee Gang ◽  
Misook Jung

Purpose: The purpose of this study was to assess the psychometric properties of the Barriers or Facilitators to Using Research in Practice (BARRIERS) scale for use in Korea. Methods: A cross-sectional study design was used with 364 nurses working in clinical settings. Item analysis was conducted and convergent and discriminant validity were evaluated using confirmatory factor analysis. Internal consistency reliability was evaluated using Cronbach’s alpha coefficients. Results: Confirmatory factor analysis revealed a 4-factor structure with 25 items that explained 62.9% of the variance. Convergent and discriminant validity were confirmed as examining the factor loading, average variance extracted, and composite reliability. The values of factor loading for 25 items were having higher estimate than criterion and the average variance extracted value for 4 factors ranged from .575 to .667. The Cronbach’s alpha was .90 for the 25 items. Conclusion: The Korean version of the 25-item BARRIERS scale was a reliable and valid scale to measure barriers to research use in Korean health care settings. Based on this psychometric evaluation, research barriers and its associated factors will be investigated using the Korean version of the BARRIERS scale in further study.


2020 ◽  
Vol 16 (4) ◽  
pp. 15-22
Author(s):  
Yilmaz Akgunduz ◽  
◽  
Ovunc Bardakoglu ◽  
Yesim Koba ◽  
◽  
...  

This study investigates the motivational factors underlying participation in trade fairs, and their effects on participant satisfaction and behavioural intentions. Data were collected through a questionnaire to 608 participants, selected by convenience sampling, at the International Natural Stone and Technologies Fair (MARBLE), held on 22-25 March 2017 in İzmir, Turkey. Confirmatory factor analysis (CFA) was used to verify the convergent and discriminant validity of the scales while multiple regression analyses were used to test the research hypotheses. The results indicate that the trade fair participants were motivated by commercial attractiveness, financial attractiveness, information search, and city attractiveness. Participant satisfaction was significantly influenced by commercial attractiveness, financial attractiveness, and information search while behavioural intentions were determined by city attractiveness and information search.


BMJ Open ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. e039566
Author(s):  
Jinglou Qu ◽  
Yaxin Zhu ◽  
Liyuan Cui ◽  
Libin Yang ◽  
Yanni Lai ◽  
...  

ObjectivesThe purpose of this research was to evaluate the psychometric properties of the TeamSTEPPS Teamwork Perception Questionnaire (T-TPQ) among the Chinese residents.DesignCross-sectional study.SettingA clinical hospital of the China Medical University in Liaoning Province, China.ParticipantsA total of 664 residents were enrolled in this research. The valid response rate was 83.0% (664 of 800 residents).Main outcome measuresInternal consistency and test–retest reliability were used to assess the reliability of the questionnaire. The construct validity of the Chinese T-TPQ was evaluated by confirmatory factor analysis. Furthermore, the concurrent, convergent and discriminant validity were analysed.ResultsCronbach’s α coefficient of the T-TPQ in Chinese language was 0.923. Except for the communication dimension (0.649), the Cronbach’s α coefficient of all dimensions were satisfactory. The T-TPQ and its five dimensions reported a good test–retest reliability (0.740–0.881, p<0.01). Moreover, the results of the confirmatory factor analysis demonstrated that the construct validity of the Chinese T-TPQ was satisfactory. All dimensions significantly correlated with the Hospital Survey on Patient Safety Culture (HSOPSC) teamwork within units dimension and the Safety Attitudes Questionnaire (SAQ) teamwork climate dimension (p<0.01), and the questionnaire showed satisfactory convergent and discriminant validity.ConclusionsThe T-TPQ in Chinese language demonstrated good psychometric characteristics and was a reliable and valid questionnaire to measure the Chinese health professionals’ perception of teamwork. Thus, the Chinese version of the T-TPQ could be applied in teamwork training programmes and medical education research.


2021 ◽  
Vol 13 (2) ◽  
pp. 20
Author(s):  
Saeed Abdullah AL-Dossary

The flourishing Scale (FS) is a measure of overall life well-being. The aim of the study was to assess the psychometric properties and measurement invariance of the Arabic version of the FS in the Saudi Arabian context. Data was collected from two samples: 969 students at two universities and 299 full-time employees working in multiple sectors. Internal consistency of the FS was examined by calculating Cronbach&rsquo;s alpha coefficient to test relaibility. To evaluate convergent and discriminant validity, the FS was compared with other measures of well-being, happiness, and depression. In order to examine the factor structure and the measurement invariance of the FS across study samples, confirmatory factor analysis and multi-group confirmatory factor analysis were performed. The FS showed good internal reliability as well as convergent and discriminant validity. Results also provided support for a one-factor and an invariant structure of the FS. Taken together, these results suggest that the FS Arabic version is a reliable and valid measure for the Arabic cultural context.


2017 ◽  
Vol 19 (2) ◽  
pp. 455-476 ◽  
Author(s):  
Uttara Jangbahadur ◽  
Vandna Sharma

The aim of this study is to identify the factors of employee development (ED) and to validate those identified set of factors using confirmatory factor analysis (CFA). Data were collected personally from employees of manufacturing industries. Factor analysis was carried out to explore the factors and CFA was carried out to check the reliability, validity and the model fitness. The scale had a high degree of reliability and validity and ensured the presence of both convergent and discriminant validity. The scale developed in this study is based on only four factors of ED as identified by different authors. In future, other factors, such as knowledge management and management development programmes, can also be included in the study. The instrument developed in the study for ED provides a basis for most of the academicians and the researchers to empirically test the relationship between ED, individual performance and organizational effectiveness, which has become an important area of interest among the researchers in recent years. The study is based on identifying the measures/factors of ED and validate those factors.


Sign in / Sign up

Export Citation Format

Share Document