scholarly journals Invalid Claims About the Validity of Implicit Association Tests by Prisoners of the Implicit Social-Cognition Paradigm

2021 ◽  
Vol 16 (2) ◽  
pp. 435-442
Author(s):  
Ulrich Schimmack
Keyword(s):  
Social Cognition ◽  
Predictive Validity ◽  
Structural Equation ◽  
Racial Bias ◽  
Self Report ◽  
Equation Modeling ◽  
Implicit Association ◽  
Implicit Social Cognition ◽  
Association Tests ◽  
Psychometric Evidence

In a prior publication, I used structural equation modeling of multimethod data to examine the construct validity of Implicit Association Tests. The results showed no evidence that IATs measure implicit constructs (e.g., implicit self-esteem, implicit racial bias). This critique of IATs elicited several responses by implicit social-cognition researchers, who tried to defend the validity and usefulness of IATs. I carefully examine these arguments and show that they lack validity. IAT proponents consistently ignore or misrepresent facts that challenge the validity of IATs as measures of individual differences in implicit cognitions. One response suggests that IATs can be useful even if they merely measure the same constructs as self-report measures, but I find no support for the claim that IATs have practically significant incremental predictive validity. In conclusions, IATs are widely used without psychometric evidence of construct or predictive validity.

scholarly journals Re-assessing the incremental predictive validity of Implicit Association Tests

2019 ◽  
Author(s):  
Jordan Axt ◽  
Nick Buttrick ◽  
Charles R. Ebersole ◽  
Jacalyn Huband
Keyword(s):  
Linear Regression ◽  
Least Squares ◽  
Predictive Validity ◽  
Linear Regression Analysis ◽  
Self Report ◽  
Equation Modeling ◽  
Measurement Reliability ◽  
Implicit Association ◽  
The Impact ◽  
Incremental Predictive Validity

Indirect measures of attitudes or stereotypes, such as the Implicit Association Test (IAT), assess associations that are relatively automatic, unintentional, or uncontrollable. A primary argument for the IAT’s use is that it can predict relevant outcomes beyond parallel direct measures, such as self-report (a claim referred to as demonstrating incremental predictive validity). Prior work on this issue relied primarily on least squares linear regression analyses, which are unable to correct for measurement (un)reliability and may then seriously inflate false positive rates in claims of incremental predictive validity. Properly accounting for the impact of measurement reliability requires using Structural Equation Modeling (SEM). In a pre-registered analysis, we investigated 10 IATs and 250 outcomes variables ( N > 14,000), and found that 69.6% of outcomes were reliably correlated with the IAT. Among outcomes that were associated with both the IAT and self-report, the IAT showed incremental predictive validity in 58.6% of cases using least squares linear regression analysis and 59.2% of cases when using SEM, with the two analytic approaches reaching the same conclusion 91.4% of the time. Though the two analysis strategies largely converged, discrepancies were large enough to suggest a non trivial percentage of conclusions drawn from least squares linear regression will be erroneous. As only SEM properly accounts for measurement reliability, it should be adopted in future analyses. To facilitate that goal, we provide tools for researchers to complete SEM analyses on tests concerning the incremental predictive validity of the IAT.

scholarly journals Effects of Socio-Structural Variables in the Theory of Planned Behavior: A Mediation Model in Multiple Samples and Behaviors

2020 ◽  
Author(s):  
Martin S Hagger ◽  
Kyra Hamilton
Keyword(s):  
Social Cognition ◽  
Health Behavior ◽  
Theory Of Planned Behavior ◽  
Planned Behavior ◽  
Structural Equation ◽  
Education Level ◽  
Self Report ◽  
Equation Modeling ◽  
Perceived Behavioral Control ◽  
Structural Variables

Objective. Observed variation in health behavior may be attributable to socio-structural variables that represent inequality. We tested the hypothesis that variability related to socio-structural variables may be linked to variation in social cognition determinants of health behavior. A proposed model in which effects of socio-structural variables (age, education level, gender, income) on health behavior participation was mediated by social cognition constructs was tested. Design. Model effects were tested in correlational datasets (k=13) in different health behaviors, populations, and contexts. Samples included self-report measures of age, highest attained education level, gender, and net household income, and constructs from the theory of planned behavior (attitude, subjective norms, perceived behavioral control, intention). Ten samples provided follow-up self-reports of health behavior. Results. Path analyses supported sample-specific indirect effects of gender and age on health behavior with comparatively few income and education level effects. Meta-analytic structural equation modeling indicated consistent indirect and total effects of gender on intentions and health behavior through social cognition constructs, and a total effect of education level on behavior. Conclusion. Results provide support for the proposed mechanism by which socio-structural variables relate to health behavior. Replication in large representative samples and meta-analytic synthesis across multiple health behavior studies is warranted.

Implicit Association Test: Separating Transsituationally Stable and Variable Components of Attitudes toward Gay Men

2003 ◽  
Vol 50 (1) ◽  
pp. 33-48 ◽  
Author(s):  
Melanie C. Steffens ◽  
Axel Buchner
Keyword(s):  
Gay Men ◽  
Implicit Association Test ◽  
Structural Equation ◽  
Implicit Attitudes ◽  
Association Test ◽  
Situational Factors ◽  
Situational Factor ◽  
Equation Modeling ◽  
Implicit Attitude ◽  
Implicit Association

Implicit attitudes are conceived of as formed in childhood, suggesting extreme stability. At the same time, it has been shown that implicit attitudes are influenced by situational factors, suggesting variability by the moment. In the present article, using structural equation modeling, we decomposed implicit attitudes towards gay men into a person factor and a situational factor. The Implicit Association Test ( Greenwald, McGhee, & Schwartz, 1998 ), introduced as an instrument with which individual differences in implicit attitudes can be measured, was used. Measurement was repeated after one week (Experiment 1) or immediately (Experiment 2). Explicit attitudes towards gay men as assessed by way of questionnaires were positive and stable across situations. Implicit attitudes were relatively negative instead. Internal consistency of the implicit attitude assessment was exemplary. However, the within-situation consistency was accompanied by considerable unexplained between-situation variability. Consequently, it may not be adequate to interpret an individual implicit attitude measured at a given point in time as a person-related, trait-like factor.

scholarly journals Overcoming limitations of self-report: an assessment of fear of weight gain in anorexia nervosa and healthy controls using implicit association tests

2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Tiana Borgers ◽  
Nathalie Krüger ◽  
Silja Vocks ◽  
Jennifer J. Thomas ◽  
Franziska Plessow ◽  
...  
Keyword(s):  
Anorexia Nervosa ◽  
Weight Gain ◽  
Normal Weight ◽  
Self Report ◽  
Healthy Controls ◽  
Drive For Thinness ◽  
Implicit Association ◽  
Association Tests ◽  
Implicit Assessment ◽  
Fear Of Weight Gain

Abstract Background Fear of weight gain is a characteristic feature of anorexia nervosa (AN), and reducing this fear is often a main target of treatment. However, research shows that 20% of individuals with AN do not report fear of weight gain. Studies are needed that evaluate the centrality of fear of weight gain for AN with a method less susceptible to deception than self-report. Methods We approximated implicit fear of weight gain by measuring implicit drive for thinness using implicit association tests (IATs). We asked 64 participants (35 AN, 29 healthy controls [HCs]) to categorize statements as pro-dieting vs. non-dieting and true vs. false in a questionnaire-based IAT, and pictures of underweight vs. normal-weight models and positive vs. negative words in a picture-based IAT using two response keys. We tested for associations between implicit drive for thinness and explicitly reported psychopathology within AN as well as group differences between AN and HC groups. Results Correlation analyses within the AN group showed that higher implicit drive for thinness was associated with more pronounced eating disorder-specific psychopathology. Furthermore, the AN group showed a stronger implicit drive for thinness than HCs in both IATs. Conclusion The results highlight the relevance of considering fear of weight gain as a continuous construct. Our implicit assessment captures various degrees of fear of weight gain in AN, which might allow for more individually tailored interventions in the future.

scholarly journals Are perceptions of grandparenthood related to family and life satisfaction? A study with emerging adults

2021 ◽  
pp. 026540752098115
Author(s):  
Isabel Miguel ◽  
Alexandra M. Araújo ◽  
Sandra Fernandes ◽  
Luísa Carneiro ◽  
Paula Fernandes
Keyword(s):  
Life Satisfaction ◽  
Emerging Adults ◽  
Family Relationships ◽  
Structural Equation ◽  
Emerging Adult ◽  
Well Being ◽  
Family Satisfaction ◽  
Self Report ◽  
Equation Modeling ◽  
Adult Grandchildren

Given the crucial role that grandparents play in the upbringing and well-being of their grandchildren, research regarding the perceived importance of grandparents for their emerging adult grandchildren is of particular relevance. This study examined the relations between perceived grandparents’ roles and family and life satisfaction in Portuguese emerging adults. Participants (N = 387), aged 18–25, completed a structured self-report questionnaire. Findings of structural equation modeling showed that emerging adults’ perceptions of grandparental roles of counselor, enjoying the relationship, and indulgence are positively related to their family and life satisfaction. The mediation analysis showed that family satisfaction mediated the relation between perceptions of grandparents acting as counselors and the life satisfaction of emerging adult grandchildren. Implications of family relationships and grandparenting in the context of emerging adulthood are discussed.

On the Structure of Affect

2021 ◽  
Vol 229 (1) ◽  
pp. 24-37 ◽  
Author(s):  
Nadine Wedderhoff ◽  
Timo Gnambs ◽  
Oliver Wedderhoff ◽  
Tanja Burgard ◽  
Michael Bošnjak
Keyword(s):  
Structural Equation Modeling ◽  
Structural Equation ◽  
Factor Model ◽  
Self Report ◽  
Equation Modeling ◽  
Positive And Negative Affect ◽  
Correlation Matrices ◽  
The World ◽  
Best Fit ◽  
Cross National

Abstract. The Positive and Negative Affect Schedule (PANAS; Watson et al., 1988 ) is a popular self-report questionnaire that is administered all over the world. Though originally developed to measure two independent factors, different models have been proposed in the literature. Comparisons among alternative models as well as analyses concerning their robustness in cross-national research have left an inconclusive picture. Therefore, the present study evaluates the dimensionality of the PANAS and differences between English and translated versions of the PANAS using a meta-analytic structural equation modeling approach. Correlation matrices from 57 independent samples ( N = 54,043) were pooled across subsamples. For both English and non-English samples, a correlated two-factor model including correlated uniquenesses provided the best fit. However, measurement invariance analyses indicated differences in factor loadings between subsamples. Thus, cross-national application of the PANAS might only be justified if measurement equivalence was explicitly tested for the countries at hand.

Shared leadership and team creativity: a team level mixed-methods study

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Lei Xie ◽  
Soo Jeoung Han ◽  
Michael Beyerlein ◽  
Jiacheng Lu ◽  
Lillian Vukin ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Shared Leadership ◽  
Structural Equation ◽  
Research Question ◽  
Self Report ◽  
Equation Modeling ◽  
Team Creativity ◽  
Content Type ◽  
Video Recordings ◽  
Multi Level

Purpose This paper aims to conduct two studies to investigate shared leadership and team creativity (TC) in leaderless short-term project teams (STPTs). Design/methodology/approach To answer the research question, this paper used a multi-level mixed-methods design. This paper analyzed video recordings, transcripts of STPTs’ collaboration and self-report surveys from an international engineering competition. In Study 1, this paper attempted to connect relation-oriented shared leadership (ROSL) and task-oriented shared leadership (TOSL) with TC by coding video recordings. In Study 2, this paper further investigated the proposed positive relationship between shared leadership and TC by surveying a sample of 166 students in 51 teams. Findings In Study 1, this paper found that shared leadership covaries with TC following a similar behavioral pattern. In Study 2, multi-level structural equation modeling results suggested that both TOSL and ROSL are positively correlated with TC. Originality/value In this mixed-methods multi-level research, this paper found that when the team’s shared leadership increases, their TC activity becomes frequent. This paper confirmed the qualitative finding by quantitatively investigated the relationship between shared leadership and creativity at the team level.

Age-Related Effects on Interoceptive Accuracy, General Interoceptive Sensibility, and Specific Interoceptive Sensibility

2020 ◽  
Vol 27 (4) ◽  
pp. 154-170 ◽  
Author(s):  
L. Nusser ◽  
O. Pollatos ◽  
D. Zimprich
Keyword(s):  
Structural Equation ◽  
Empirical Support ◽  
Self Report ◽  
Three Dimensions ◽  
Equation Modeling ◽  
Adult Lifespan ◽  
Age Related ◽  
Physical Diseases ◽  
Interoceptive Accuracy ◽  
Subjective Belief

Abstract. Background: The current research into interoception distinguishes between interoceptive accuracy (IAcc), the accurate detection of internal sensations (e.g., heartbeats) as measured by performance on objective IAcc tasks, and interoceptive sensibility (IS), the subjective belief concerning one’s own experience of internal sensations as measured either through self-report questionnaires or through one’s confidence in the accuracy during an IAcc task. Aims: As the two measures of IS, however, are usually uncorrelated and show differential relationships to IAcc, we suggest different types of IS, a general IS and a specific IS. Further, based on a growing body of research linking IAcc and IS to physical and mental diseases, the development of interoception across the adult lifespan is of importance. Methods: Using Structural Equation Modeling the present paper investigates the relationships among IAcc assessed by a heartbeat counting task, and the two proposed dimensions of IS in 138 participants ( Mage = 42.67, SDage = 18.77). Furthermore, we examine age-related differences in IAcc, as well as in general and specific IS. Results: In terms of the relationship between the three dimensions, general and specific IS were weakly correlated and exhibited different relationships to IAcc. Further, we found different age effects on the three interoceptive dimensions. Whereas IAcc decreased with age, specific IS tend to increase with age, and general IS remained unaffected by age. Conclusion: The findings provide further empirical support for a dissociation between general and specific IS and raised important questions concerning the relation between interoceptive accuracy and the emergence of physical diseases in older age.

Data-based ethical decision making, lateral relations, and organizational commitment

2018 ◽  
Vol 40 (6) ◽  
pp. 946-963 ◽  
Author(s):  
Sean Robert Valentine ◽  
David Hollingworth ◽  
Patrick Schultz
Keyword(s):  
Decision Making ◽  
Organizational Commitment ◽  
Information Flow ◽  
Structural Equation ◽  
Ethical Decision ◽  
Ethical Decision Making ◽  
Ethical Issues ◽  
Self Report ◽  
Equation Modeling ◽  
Content Type

Purpose Focusing on ethical issues when making organizational decisions should encourage a variety of positive outcomes for companies and their employees. The purpose of this paper is to determine the degree to which data-based ethical decision making, lateral relations and organizational commitment are interrelated in organizations. Design/methodology/approach Data were collected from business professionals employed at multiple locations of a financial services firm operating in the USA. Mediation analysis (based on structural equation modeling) was used to test the proposed relationships. Findings Results indicated that employees’ perceptions of data-based ethical decision making were positively related to perceived lateral relations, and that perceived lateral relations were positively related to organizational commitment. Research limitations/implications Given that information was collected using only a self-report questionnaire, common method bias could be an issue. In addition, the study’s cross-sectional design limits conclusions about causality. Another limitation involves the study’s homogenous sample, which decreases the generalizability of the findings. Finally, variable responses could have been impacted by individual frames of reference and other perceptual differences. Practical implications Results suggest that information flow enhancements should support or be consistent with horizontal information flow enhancements, and that together these factors should increase employee commitment. Originality/value Given the dearth of existing research, this interdisciplinary investigation is important because it fills gaps in the management literature. This study is also important because the results could inform decisions regarding the use of data analysis in ethical decisions and lateral forms of organizational structuring to improve work attitudes.

Sign in / Sign up

Export Citation Format

Share Document