Ideological measurement in social and political psychology

As social psychology undergoes marked changes in its approach to research (e.g., open science practices, and addressing the replication crisis), it is important to undertake a full review of the tools and measures that we have at our disposal. In addition, the growing sense of political and ideological polarization in contemporary western democracies necessitates a coherent and internally consistent approach to studying politically and ideologically sensitive topics. This paper explores the measurement and study of such topics, and posits that claims about (a)symmetries between ideological partisans may be rooted in different measurement approaches. That is, studies (and researchers) who report widespread differences (asymmetries) between partisan liberals and conservatives typically adopt individual difference designs that examine trait-level constructs. In contrast, those who typically report similarities (symmetries) between these groups collect situationally derived data. A more consistent and ecologically valid approach to studying partisan engagement with political topics is advocated, focusing on situational responses to ideologically salient scenarios, rather than placing our focus on results from decontextualized self-report individual difference measures. Underpinning this review are three key assertions. First, that our ideological homogeneity as a field blinds us to hidden biases in our methods. Second, that the aforementioned (a)symmetry camps talk past each other by adopting different epistemological approaches. Third, that addressing these shortcomings can allow us to better conform to the Mertonian norms of communalism, universalism, disinterestedness, and organized skepticism. In doing so, we can revive our status as an open, accurate, and reproducible scientific field.