Alliance With an Unguided Smartphone App: Validation of the Digital Working Alliance Inventory

Assessment ◽  
2021 ◽  
pp. 107319112110153
Author(s):  
Simon B. Goldberg ◽  
Scott A. Baldwin ◽  
Kevin M. Riordan ◽  
John Torous ◽  
Cortland J. Dahl ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Psychological Distress ◽  
Working Alliance ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Working Alliance Inventory ◽  
Trial Testing ◽  
Test Retest Reliability

The working alliance may be relevant in unguided smartphone-based interventions, but no validated measure exists. We evaluated the psychometric properties of the six-item Digital Working Alliance Inventory (DWAI) using a cross-sectional survey of meditation app users ( n = 290) and the intervention arm of a randomized trial testing a smartphone-based meditation app ( n = 314). Exploratory factor analysis suggested a single-factor solution which was replicated using longitudinal confirmatory factor analysis. The DWAI showed adequate internal consistency and test–retest reliability. Discriminant validity was supported by a lack of association with social desirability, psychological distress, and preference for a waitlist condition. Convergent validity was supported by positive associations with perceived app effectiveness and preference for an app condition. Supporting predictive validity, DWAI scores positively predicted self-reported and objective app utilization. When assessed at Weeks 3 or 4 of the intervention, but not earlier, DWAI scores predicted pre–post reductions in psychological distress.

Validation of a Brief Form of the Supervisory Working Alliance Inventory

2019 ◽  
Vol 63 (2) ◽  
pp. 115-124 ◽  
Author(s):  
Scott A. Sabella ◽  
Jared C. Schultz ◽  
Trenton J. Landon
Keyword(s):  
Working Alliance ◽  
Convergent Validity ◽  
Secondary Data ◽  
National Sample ◽  
Full Scale ◽  
Rehabilitation Counselors ◽  
Supervisory Working Alliance ◽  
Cross Sectional ◽  
Electronic Survey ◽  
Working Alliance Inventory

The Supervisory Working Alliance Inventory–Trainee Form (SWAI-T) is among the most frequently used instruments for measuring the quality of supervisor–supervisee relationships within counselor supervision. Although the full-scale SWAI-T instrument has proven utility, there are instances when a shorter form may be useful for research and field applications. The current study used secondary data from a pair of cross-sectional studies to test the utility of a brief form of the SWAI-T in a two-step process: (a) reduction of the SWAI-T based on item analyses from an electronic survey of 87 rehabilitation counselors working in a Western state vocational rehabilitation agency and (b) an initial validation study of the instrument using electronic survey responses from a national sample of 228 rehabilitation counselors working in private rehabilitation. The resultant 5-item scale showed evidence of high internal consistency, convergent validity, and minimal differences in psychometric properties relative to the full-scale instrument. An abbreviated supervisory working alliance scale offers practical advantages for select research purposes and for continuous evaluation of supervisory relationships in field environments.

scholarly journals Psychometric Properties of the Stress Control Mindset Measure in University Students from Australia and the UK

2019 ◽  
Author(s):  
Jacob J Keech ◽  
Sheina Orbell ◽  
Martin S Hagger ◽  
Frances O'Callaghan ◽  
Kyra Hamilton
Keyword(s):  
Psychometric Properties ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Performance Outcomes ◽  
Future Research ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Stress Control ◽  
Health And Wellbeing ◽  
And Performance

Introduction: Beliefs about the consequences of stress, stress mindsets, are associated with health and performance outcomes under stress. This article reports the development and examination of the psychometric properties of a measure of stress mindset: The Stress Control Mindset Measure (SCMM). The measure is consistent with theory on mindsets about self-attributes and conceptualizes stress mindset as the extent to which individuals endorse beliefs that stress can be enhancing. Methods: The study adopted a correlational cross-sectional survey design in two student samples. Undergraduate students from an Australian university (Sample 1, N = 218) and a UK university (Sample 2, N = 214) completed the SCMM and measures of health and wellbeing outcomes. Results: Confirmatory factor analyses supported a four-factor structure and strict measurement invariance across samples (ΔCFI < .01). Reliability, convergent validity, discriminant validity, and concurrent validity of the overall SCMM was supported in both samples. Incremental validity was supported for most outcomes, accounting for significantly more variance (between 2.2% and 5.9%) in health and wellbeing outcomes than an existing measure. Conclusions: Current data provide preliminary support for the SCMM as a reliable and valid measure with good psychometric properties and theoretically consistent relations with health outcomes under stress. Findings provide initial evidence supporting the potential utility of the SCMM in future research examining relations between stress mindsets and health and performance outcomes.

scholarly journals Reliability and Structural and Construct Validity of the Functional Strength Measurement in Children Aged 4 to 10 Years

2016 ◽  
Vol 96 (6) ◽  
pp. 888-897 ◽  
Author(s):  
Wendy F.M. Aertssen ◽  
Gillian D. Ferguson ◽  
Bouwien C.M. Smits-Engelsman
Keyword(s):  
Factor Analysis ◽  
Muscle Strength ◽  
Construct Validity ◽  
Exploratory Factor Analysis ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Structural Validity ◽  
Strength Measurement ◽  
Retest Reliability ◽  
Test Retest Reliability

Background Adequate muscle strength, power, and endurance are important in children's daily activities and sports. Various instruments have been developed for the assessment of muscle function; each measures different aspects. The Functional Strength Measurement (FSM) was developed to measure performance in activities in which strength is required. Objective The study objective was to establish the test-retest reliability and structural and construct validity of the FSM. Design A cross-sectional descriptive study was conducted. Methods The performance of 474 children with typical development on the FSM was examined. Test-retest reliability (n=47) was calculated with the intraclass correlation coefficient (2.1A) for agreement. Structural validity was examined with exploratory factor analysis, and internal consistency was established with the Cronbach alpha. Construct validity was determined by calculating correlations between FSM scores and scores obtained with a handheld dynamometer (HHD) (n=252) (convergent validity) and between FSM scores and scores on the Movement Assessment Battery for Children–2 (MABC-2) (n=77) (discriminant validity). Results The test-retest reliability of the FSM total score ranged from .91 to .94. The structural validity revealed one dimension, containing all 8 FSM items. The Cronbach alpha was .74. The convergent validity with the HHD ranged from .42 to .74. The discriminant validity with MABC-2 items revealed correlations that were generally lower than .39, and most of the correlations were not significant. Exploratory factor analysis of a combined data set (FSM, HHD, and MABC-2; n=77) revealed 2 factors: muscle strength/power and muscle endurance with an agility component. Limitations Discriminant validity was measured only in children aged 4 to 6 years. Conclusions The FSM, a norm-referenced test for measuring functional strength in children aged 4 to 10 years, has good test-retest reliability and good construct validity.

scholarly journals Psychometric properties of the Chinese version of the TeamSTEPPS teamwork perceptions questionnaire to measure teamwork perceptions of Chinese residents: a cross-sectional study

BMJ Open ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. e039566
Author(s):  
Jinglou Qu ◽  
Yaxin Zhu ◽  
Liyuan Cui ◽  
Libin Yang ◽  
Yanni Lai ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Discriminant Validity ◽  
Chinese Language ◽  
Cross Sectional Study ◽  
Sectional Study ◽  
Cross Sectional ◽  
Convergent And Discriminant Validity ◽  
Confirmatory Factor ◽  
Test Retest Reliability

ObjectivesThe purpose of this research was to evaluate the psychometric properties of the TeamSTEPPS Teamwork Perception Questionnaire (T-TPQ) among the Chinese residents.DesignCross-sectional study.SettingA clinical hospital of the China Medical University in Liaoning Province, China.ParticipantsA total of 664 residents were enrolled in this research. The valid response rate was 83.0% (664 of 800 residents).Main outcome measuresInternal consistency and test–retest reliability were used to assess the reliability of the questionnaire. The construct validity of the Chinese T-TPQ was evaluated by confirmatory factor analysis. Furthermore, the concurrent, convergent and discriminant validity were analysed.ResultsCronbach’s α coefficient of the T-TPQ in Chinese language was 0.923. Except for the communication dimension (0.649), the Cronbach’s α coefficient of all dimensions were satisfactory. The T-TPQ and its five dimensions reported a good test–retest reliability (0.740–0.881, p<0.01). Moreover, the results of the confirmatory factor analysis demonstrated that the construct validity of the Chinese T-TPQ was satisfactory. All dimensions significantly correlated with the Hospital Survey on Patient Safety Culture (HSOPSC) teamwork within units dimension and the Safety Attitudes Questionnaire (SAQ) teamwork climate dimension (p<0.01), and the questionnaire showed satisfactory convergent and discriminant validity.ConclusionsThe T-TPQ in Chinese language demonstrated good psychometric characteristics and was a reliable and valid questionnaire to measure the Chinese health professionals’ perception of teamwork. Thus, the Chinese version of the T-TPQ could be applied in teamwork training programmes and medical education research.

scholarly journals Development and Validation of a Chinese Parental Health Literacy Questionnaire for Caregivers of Children from 0 to 3 Years Old

2019 ◽  
Author(s):  
Yan Zhang ◽  
Mu Li ◽  
Hong Jiang ◽  
Huijing Shi ◽  
Biao Xu ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Health Literacy ◽  
Confirmatory Factor Analysis ◽  
Internal Consistency ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Parental Health ◽  
Health Literacy Questionnaire ◽  
Confirmatory Factor ◽  
Test Retest Reliability

Abstract Background Given the limited information on parental health literacy measurements, the study aimed to develop and validate the Chinese Parental Health Literacy Questionnaire for caregivers of children under three years old. Methods We conducted a validity and reliability study through a cross-sectional survey and test-retest analysis respectively between March and April 2017. 807 caregivers of children under three years old were recruited, among which 101 caregivers completed the test-retest assessment with two weeks interval. The reliability was determined by internal consistency, spilt-half reliability and test-retest reliability. The construct validity was assessed by confirmatory factor analysis. Results The 39-question Chinese Parental Health Literacy Questionnaire was shown with high internal consistency (Cronbach’s α=0.89), spilt-half reliability (Spearman-Brown coefficient=0.92) and test-retest reliability (Pearson correlation coefficient=0.82). The confirmatory factor analysis showed that the construct of the questionnaire fitted well with the hypothetical model. The participants’ test scores of the Chinese Parental Health Literacy Questionnaire in a cross-sectional survey were positively associated with caregivers being mothers, more educated, of children with Shanghai Hukou, having only one child in the family, having higher family income. Conclusion The Chinese Parental Health Literacy Questionnaire demonstrated good reliability and validity, which could potentially be used as an effective evaluation instrument to assess parental health literacy.

scholarly journals The measurement model of geo-education among trainee teachers in Malaysia

2021 ◽  
Vol 10 (2) ◽  
pp. 714
Author(s):  
Mat Rahimi Yusof ◽  
Mohd Faiz Mohd Yaakob ◽  
Aliff Nawi ◽  
Hapini Awang ◽  
Dayang Rafidah Syariff M. Fuad ◽  
...  
Keyword(s):  
School Environment ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Significant Contribution ◽  
Measurement Model ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Trainee Teachers ◽  
Curricular Elements ◽  
Composite Reliability

<p>This study conducted to develop a measurement model for measuring Geo-Education in Malaysia context. This cross-sectional survey involved 245 trainee teachers in Universities and Institut Pendidikan Guru Malaysia (IPGM). The data collection was made through a set of questionnaires and analyzed using SEM-AMOS. There are four main elements measured, which are loading factors, convergent validity, discriminant validity, and composite reliability. The findings indicated that Geo-Education had a significant contribution to the proposed constructs, namely primer, issues, ecosystem, lifestyle, and cross-curricular elements. A model of Geo-Education was successfully developed in this study using these five constructs, namely primer, issues, ecosystem, lifestyle, and cross-curricular elements. This study also identified twenty-five behaviours of Geo-Education among the trainee teachers in Malaysia. The findings of this study are essential as a guideline for Malaysian teachers to implement the concept of Geo-Education in Malaysia. Additionally, the application of this subject as cross-curricular elements in the Malaysian curriculum is essential to ensure the success of the implementation of Education Sustainable Development (ESD) in the school environment.</p>

scholarly journals Development and Validation of a Chinese Parental Health Literacy Questionnaire for Caregivers of Children 0 to 3 Years Old

2019 ◽  
Author(s):  
Yan Zhang ◽  
Mu Li ◽  
Hong Jiang ◽  
Huijing Shi ◽  
Biao Xu ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Health Literacy ◽  
Confirmatory Factor Analysis ◽  
Internal Consistency ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Parental Health ◽  
Health Literacy Questionnaire ◽  
Confirmatory Factor ◽  
Test Retest Reliability

Abstract Background Given the limited information on parental health literacy measurements, the study aimed to develop and validate the Chinese Parental Health Literacy Questionnaire for caregivers of children 0 to 3 years old. Methods We conducted a validity and reliability study of the questionnaire through a cross-sectional survey and test-retest analysis respectively between March and April 2017. We recruited 807 caregivers of children 0 to 3 years old, among them 101 caregivers completed the test-retest assessment with two weeks interval. The reliability was determined by internal consistency, spilt-half reliability and test-retest reliability. The construct validity was assessed by confirmatory factor analysis. Results The 39-question Chinese Parental Health Literacy Questionnaire was demonstrated high internal consistency (Cronbach’s α=0.89), spilt-half reliability (Spearman-Brown coefficient=0.92) and test-retest reliability (Pearson correlation coefficient=0.82). The confirmatory factor analysis showed that the construct of the questionnaire fitted well with the hypothetical model. The participants’ test scores of the Chinese Parental Health Literacy Questionnaire in the cross-sectional survey were positively associated with caregivers being mothers, more educated, the children with Shanghai Hukou , having only one child in the family, and higher family income. Conclusion The Chinese Parental Health Literacy Questionnaire demonstrated good reliability and validity, which could potentially be used as an effective evaluation instrument to assess parental health literacy.

scholarly journals Japanese version of the Generic Conspiracist Beliefs Scale

2019 ◽  
Author(s):  
Yoshimasa Majima ◽  
Hiroko Nakamura
Keyword(s):  
Factor Analysis ◽  
Factor Structure ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Japanese Version ◽  
Structure Study ◽  
Psychological Constructs ◽  
Conspiracy Beliefs ◽  
Positive Correlations ◽  
Test Retest Reliability

The present research aimed to develop a Japanese version of the Generic Conspiracist Beliefs Scale (GCBS-J). In the first study, exploratory factor analysis with a split-half subsample (n = 300) proposed a two-factor structure separating the extraterrestrial belief from other conspiracy beliefs. Subsequent confirmatory factor analysis with the other split-half subsample (n = 300) confirmed the two-factor structure. Study 1 also established convergent validity by indicating strong positive correlations with other measures of conspiracist belief. The second study provided further evidence for convergent validity that indicates a positive correlation with related psychological constructs, such as paranormal beliefs. Study 2 also exhibited temporal test–retest reliability and the discriminant validity of the GCBS-J by indicating no association with an unrelated construct. These findings suggest that the GCBS-J is a useful tool for assessing generic conspiracist beliefs within Japanese samples.

scholarly journals Psychometric properties of the Bulgarian version of Hospital Survey on Patient Safety Culture

2020 ◽  
Vol 32 (6) ◽  
pp. 396-404
Author(s):  
Donka Keskinova ◽  
Rositsa Dimova ◽  
Rumyana Stoyanova
Keyword(s):  
Patient Safety ◽  
Psychometric Properties ◽  
Safety Culture ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Patient Safety Culture ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
Web Based ◽  
Global And Local

Abstract Objective To explore the psychometrics of the Bulgarian version of the Hospital Survey on Patient Safety Culture (B-HSOPSC) and its suitability for use in Bulgaria. Design A national web-based cross-sectional survey of the safety patient culture. Setting The hospitals’ staffs from 28 administrative areas in the country. Interventions Web-based self-administered questionnaire. Participants Physicians and non-physicians such as nurses, midwifes, etc., working at hospitals. Main Outcome Measures Confirmatory factor analysis (CFA) was performed to assess the psychometric properties of the original US structure. Assessment of construct validity included convergent validity, discriminant validity, and nomological validity of constructs. Results A total of 525 valid cases were included in the analysis. The results of CFA revealed acceptable values for absolute indices and lower for the incremental index, comparative fit index. Due to the very low convergence validity, the dimension ‘staffing’ was removed from the model. Additionally, one item was removed from another dimension. The B-HSOPSC included 11 dimensions and 37 items. Conclusions The B-HSOPSC had acceptable levels of global and local fits. Its safety culture dimensions were sufficiently distinguishable and correlated with outcome variables.

Sign in / Sign up

Export Citation Format

Share Document