Performance of Two Procedures for Assessing Discriminant Validity: Model Comparisons Versus Confidence Intervals

Author(s):  
George R. Franke
Methodology ◽  
2009 ◽  
Vol 5 (4) ◽  
pp. 137-144
Author(s):  
Jose Antonio Martínez García

In this paper, a new distance measure called the Discriminant distance (Dd), which overcomes some of the shortcomings of other distance measures and provides an easily understandable geometrical interpretation of distance between two variables, is evaluated. Dd summarizes the information provided by Pearson’s r and Cohens’ d statistics in a single coefficient. In addition, confidence intervals can also be computed. The Discriminant distance has values enclosed in a [0, 1) interval and it may be mainly used to study convergent and discriminant validity, or scale invariance, when using continuous variables. A web-based computer program is provided to facilitate its computation. Finally, conventions for interpreting Dd are discussed along with several limitations.


GeroPsych ◽  
2014 ◽  
Vol 27 (1) ◽  
pp. 23-31 ◽  
Author(s):  
Anne Kuemmel (This author contributed eq ◽  
Julia Haberstroh (This author contributed ◽  
Johannes Pantel

Communication and communication behaviors in situational contexts are essential conditions for well-being and quality of life in people with dementia. Measuring methods, however, are limited. The CODEM instrument, a standardized observational communication behavior assessment tool, was developed and evaluated on the basis of the current state of research in dementia care and social-communicative behavior. Initially, interrater reliability was examined by means of videoratings (N = 10 people with dementia). Thereupon, six caregivers in six German nursing homes observed 69 residents suffering from dementia and used CODEM to rate their communication behavior. The interrater reliability of CODEM was excellent (mean κ = .79; intraclass correlation = .91). Statistical analysis indicated that CODEM had excellent internal consistency (Cronbach’s α = .95). CODEM also showed excellent convergent validity (Pearson’s R = .88) as well as discriminant validity (Pearson’s R = .63). Confirmatory factor analysis verified the two-factor solution of verbal/content aspects and nonverbal/relationship aspects. With regard to the severity of the disease, the content and relational aspects of communication exhibited different trends. CODEM proved to be a reliable, valid, and sensitive assessment tool for examining communication behavior in the field of dementia. CODEM also provides researchers a feasible examination tool for measuring effects of psychosocial intervention studies that strive to improve communication behavior and well-being in dementia.


Author(s):  
Bertram Gawronski

Abstract. Drawing on recent criticism of the Implicit Association Test (IAT), the present study tested the convergent and discriminant validity of two prejudice-related IATs to corresponding explicit prejudice measures in a German student sample (N = 61). Confirming convergent validity, (a) an IAT designed to assess negative associations related to Turkish people was significantly related to the explicit endorsement of prejudiced beliefs about Turkish people, and (b) an IAT designed to assess negative associations related to East Asians was significantly related to explicit prejudice against East Asians. Moreover, confirming discriminant validity, (c) the Asian IAT was unrelated to the explicit endorsement of prejudiced beliefs about Turkish people, and (d) the Turkish IAT was unrelated to explicit prejudice against Asian people. These results further corroborate the assumption that the IAT is a valid method to assess the strength of evaluative associations in the domain of prejudice and stereotypes.


2020 ◽  
Vol 36 (5) ◽  
pp. 767-776
Author(s):  
U. Baran Metin ◽  
Toon W. Taris ◽  
Maria C. W. Peeters ◽  
Max Korpinen ◽  
Urška Smrke ◽  
...  

Abstract. Procrastination at work has been examined relatively scarcely, partly due to the lack of a globally validated and context-specific workplace procrastination scale. This study investigates the psychometric characteristics of the Procrastination at Work Scale (PAWS) among 1,028 office employees from seven countries, namely, Croatia, the Czech Republic, Finland, Slovenia, Turkey, Ukraine, and the United Kingdom. Specifically, it was aimed to test the measurement invariance of the PAWS and explore its discriminant validity by examining its relationships with work engagement and performance. Multi-group confirmatory factor analysis shows that the basic factor structure and item loadings of the PAWS are invariant across countries. Furthermore, the two subdimensions of procrastination at work exhibited different patterns of relationships with work engagement and performance. Whereas soldiering was negatively related to work engagement and task performance, cyberslacking was unrelated to engagement and performance. These results indicate further validity evidence for the PAWS and the psychometric characteristics show invariance across various countries/languages. Moreover, workplace procrastination, especially soldiering, is a problematic behavior that shows negative links with work engagement and performance.


2017 ◽  
Vol 38 (2) ◽  
pp. 83-93
Author(s):  
Jeffrey M. Cucina ◽  
Nicholas L. Vasilopoulos ◽  
Arwen H. DeCostanza

Abstract. Varimax rotated principal component scores (VRPCS) have previously been offered as a possible solution to the non-orthogonality of scores for the Big Five factors. However, few researchers have examined the reliability and validity of VRPCS. To address this gap, we use a lab study and a field study to investigate whether using VRPCS increase orthogonality, reliability, and criterion-related validity. Compared to the traditional unit-weighting scoring method, the use of VRPCS enhanced the reliability and discriminant validity of the Big Five factors, although there was little improvement in criterion-related validity. Results are discussed in terms of the benefit of using VRPCS instead of traditional unit-weighted sum scores.


2013 ◽  
Vol 29 (3) ◽  
pp. 213-219 ◽  
Author(s):  
Astrid Müller ◽  
Laurence Claes ◽  
Dirk Smits ◽  
Olaf Gefeller ◽  
Anja Hilbert ◽  
...  

This study evaluated the psychometric properties of the German version of the 21-item Exercise Dependence Scale (EDS-G), which was administered in a large representative German sample (N = 1,611). In order to examine convergent validity, we also asked participants to answer the Eating Disorder Examination-Questionnaire (EDE-Q). To investigate the discriminant validity, clients of fitness centers (N = 129), sport students (N = 85), and medical students (N = 129) filled out the EDS-G. In this German population-based sample, the seven-factor structure suggested by the original authors as well as a higher-order model (7 + 1 factor model) were supported. The total EDS-G scale showed an excellent internal reliability and was positively related to the EDE-Q total and subscale scores. The EDS-G scores differentiated between samples with varying degrees of exercise. In summary, the results indicate that the EDS-G is a psychometrically sound and potentially valid brief measure for the assessment of exercise dependence symptoms.


2010 ◽  
Vol 26 (1) ◽  
pp. 3-10 ◽  
Author(s):  
Nale Lehmann-Willenbrock ◽  
Simone Kauffeld

In research on trust in the organizational context, there is some agreement evolving that trust should be measured with respect to various foci. The Workplace Trust Survey (WTS) by Ferres (2002) provides reliable assessment of coworker, supervisor, and organizational trust. By means of a functionally equivalent translation, we developed a German version of the questionnaire (G-WTS) comprising 21 items. A total of 427 employees were surveyed with the G-WTS and questionnaires concerning several work-related attitudes and behaviors and 92 of these completed the survey twice. The hypothesized three-dimensional conceptualization of organizational trust was confirmed by confirmatory factor analysis. The G-WTS showed good internal consistency and retest reliability values. Concerning convergent validity, all of the three G-WTS dimensions positively predicted job satisfaction. In terms of discriminant validity, Coworker Trust enhanced group cohesion; Supervisor Trust fostered innovative behavior, while Organizational Trust was associated with affective commitment. Theoretical and practical contributions as well as opportunities for future research with the G-WTS are discussed.


2018 ◽  
Vol 34 (6) ◽  
pp. 367-375 ◽  
Author(s):  
Laura D. Seligman ◽  
Erin F. Swedish ◽  
Jason P. Rose ◽  
Jessica M. Baker

Abstract. The current study examined the validity of two self-report measures of social anxiety constructed using social comparative referent points. It was hypothesized that these comparison measures would be both reliable and valid. Results indicated that two different comparative versions – one invoking injunctive norms and another invoking descriptive norms – showed good reliability, excellent internal consistency, and acceptable convergent and discriminant validity. The comparative measures also predicted positive functioning, some aspects of social quality of life, and social anxiety as measured by an independent self-report. These findings suggest that adding a comparative reference point to instructions on social anxiety measures may aid in the assessment of social anxiety.


2007 ◽  
Vol 28 (4) ◽  
pp. 179-187 ◽  
Author(s):  
Andrew J. Cooper ◽  
Adam M. Perkins ◽  
Philip J. Corr

Abstract. Recent revisions to the reinforcement sensitivity theory (RST) of personality have highlighted the distinction between the emotions of fear and anxiety. These revisions have substantial implications for self-report measurement; in particular, they raise the question of whether separate traits of fear and anxiety exist and, if so, their interrelationship. To address this question, the current study used confirmatory factor analytic procedures to examine the convergent and discriminant validity of measures of trait anxiety, fear, and the behavioral inhibition system (BIS). We also examined measurement and structural invariance across gender in 167 males and 173 females who completed the Spielberger State-Trait Anxiety Inventory (STAI), the Carver and White BIS Scale, and the Fear Survey Schedule (FSS). The findings suggested that trait anxiety and the BIS scale are relatively distinct from Tissue Damage Fear (FSS). Further, the final model showed measurement and structural invariance across gender. The implications of the results for future self-report assessment in RST research are discussed.


Sign in / Sign up

Export Citation Format

Share Document