A Bias-Corrected Estimator for the Crosswise Model with Inattentive Respondents

The crosswise model is an increasingly popular survey technique to elicit candid answers from respondents on sensitive questions. Recent studies, however, point out that in the presence of inattentive respondents, the conventional estimator of the prevalence of a sensitive attribute is biased toward 0.5. To remedy this problem, we propose a simple design-based bias correction using an anchor question that has a sensitive item with known prevalence. We demonstrate that we can easily estimate and correct for the bias arising from inattentive respondents without measuring individual-level attentiveness. We also offer several useful extensions of our estimator, including a sensitivity analysis for the conventional estimator, a strategy for weighting, a framework for multivariate regressions in which a latent sensitive trait is used as an outcome or a predictor, and tools for power analysis and parameter selection. Our method can be easily implemented through our open-source software cWise.

Sensitive attitudes and adherence to recommendations during the COVID-19 pandemic: Comparing direct and indirect questioning techniques

During the COVID-19 pandemic, different behavioral measures were imposed to curb the spread of the virus. In a pre-registered study based on a quota-representative sample of adult Danish citizens (N = 1,031), we compared the prevalence estimates of self-reported handwashing, physical distancing, and attitudes towards the behavioral measures between people surveyed with a direct and an indirect questioning approach (i.e., the crosswise model). Moreover, we investigated two possible predictors for the sensitive attributes, namely (1) empathy for people vulnerable to the virus and (2) Honesty-Humility from the HEXACO Model of Personality. We also examined the interaction of both predictors with the questioning format. Results indicate that participants reported greater adherence to handwashing and physical distancing guidelines when asked directly rather than when asked indirectly. The overall attitudes regarding the behavioral measures did not differ between the questioning formats. Furthermore, empathy for people vulnerable to COVID-19 was negatively linked to nonadherence regarding handwashing and physical distancing, whereas Honesty-Humility was negatively linked to nonadherence regarding physical distancing.

Nothing but the truth? Effects of faking on the validity of the crosswise model

In self-reports, socially desirable responding threatens the validity of prevalence estimates for sensitive personal attitudes and behaviors. Indirect questioning techniques such as the crosswise model attempt to control for the influence of social desirability bias. The crosswise model has repeatedly been found to provide more valid prevalence estimates than direct questions. We investigated whether crosswise model estimates are also less susceptible to deliberate faking than direct questions. To this end, we investigated the effect of “fake good” instructions on responses to direct and crosswise model questions. In a sample of 1,946 university students, 12-month prevalence estimates for a sensitive road traffic behavior were higher and thus presumably more valid in the crosswise model than in a direct question. Moreover, “fake good” instructions severely impaired the validity of the direct questioning estimates, whereas the crosswise model estimates were unaffected by deliberate faking. Participants also reported higher levels of perceived confidentiality and a lower perceived ease of faking in the crosswise model compared to direct questions. Our results corroborate previous studies finding the crosswise model to be an effective tool for counteracting the detrimental effects of positive self-presentation in surveys on sensitive issues.

Functionality of the Crosswise Model for Assessing Sensitive or Transgressive Behavior: A Systematic Review and Meta-Analysis

Tools for reliable assessment of socially sensitive or transgressive behavior warrant constant development. Among them, the Crosswise Model (CM) has gained considerable attention. We systematically reviewed and meta-analyzed empirical applications of CM and addressed a gap for quality assessment of indirect estimation models. Guided by the PRISMA protocol, we identified 45 empirical studies from electronic database and reference searches. Thirty of these were comparative validation studies (CVS) comparing CM and direct question (DQ) estimates. Six prevalence studies exclusively used CM. One was a qualitative study. Behavior investigated were substance use and misuse (k = 13), academic misconduct (k = 8), and corruption, tax evasion, and theft (k = 7) among others. Majority of studies (k = 39) applied the “more is better” hypothesis. Thirty-five studies relied on birthday distribution and 22 of these used P = 0.25 for the non-sensitive item. Overall, 11 studies were assessed as high-, 31 as moderate-, and two as low quality (excluding the qualitative study). The effect of non-compliance was assessed in eight studies. From mixed CVS results, the meta-analysis indicates that CM outperforms DQ on the “more is better” validation criterion, and increasingly so with higher behavior sensitivity. However, little difference was observed between DQ and CM estimates for items with DQ prevalence estimate around 50%. Based on empirical evidence available to date, our study provides support for the superiority of CM to DQ in assessing sensitive/transgressive behavior. Despite some limitations, CM is a valuable and promising tool for population level investigation.

A Meta-analysis of Studies on the Performance of the Crosswise Model

This article provides a meta-analysis of studies using the crosswise model (CM) in estimating the prevalence of sensitive characteristics in different samples and populations. On a data set of 141 items published in 33 either articles or books, we compare the difference (Δ) between estimates based on the CM and a direct question (DQ). The overall effect size of Δ is 4.88; 95% CI [4.56, 5.21]. The results of a meta-regression indicate that Δ is smaller when general populations and nonprobability samples are considered. The population effect suggests an education effect: Differences between the CM and DQ estimates are more likely to occur when highly educated populations, such as students, are studied. Our findings raise concerns to what extent the CM is able to improve estimates of sensitive behavior in general population samples.

Functionality of the Crosswise Model for assessing sensitive or transgressive behavior: A systematic review and meta-analysis

Tools for reliable assessment of socially sensitive or transgressive behavior warrant constant development. Among them, the Crosswise Model (CM) has gained considerable attention. Therefore, we systematically reviewed and meta-analysed empirical applications of CM and addressed a gap for quality assessment of indirect estimation models. To our knowledge, the present study presents the first systematic review of the functionality of CM, and quality assessment of CM and indirect estimation models in general. Guided by the PRISMA protocol, we identified 35 empirical studies from electronic database and reference searches, of which 25 were comparative validation studies (CVS) with CM estimates and direct question (DQ). Results of the meta-analysis indicate that CM outperforms DQ on the “more is better” validation criterion, and increasingly so with more behavior sensitivity. However, little difference was observed between DQ and CM estimates for items with DQ prevalence around 50%. Based on empirical evidence available to date, our study provides support for the superiority of CM to DQ. Despite some limitations, CM is a valuable and promising tool for assessing sensitive or transgressive behavior.

Handle with Care: Implementation of the List Experiment and Crosswise Model in a Large-scale Survey on Academic Misconduct

This research analyzes the effectiveness of the list experiment and crosswise model in measuring self-plagiarism and data manipulation. Both methods were implemented in a large-scale survey of academics on social norms and academic misconduct. As the results lend little confidence about the effectiveness of the methods, researchers are best advised to avoid them or, at best, to handle them with care.

Do they really wash their hands? Prevalence estimates for personal hygiene behaviour during the COVID-19 pandemic based on indirect questions

Background During the COVID-19 pandemic, billions of people have to change their behaviours to slow down the spreading of the virus. Protective measures include self-isolation, social (physical) distancing and compliance with personal hygiene rules, particularly regular and thorough hand washing. Prevalence estimates for the compliance with the COVID-19 measures are often based on direct self-reports. However, during a health crisis there is strong public pressure to comply with health and safety regulations so that people’s responding in direct self-reports may be seriously compromised by social desirability. Methods In an online survey, an indirect questioning technique was used to test whether the prevalence of hygiene practices may be lower than in conventional surveys when confidentiality of responding is guaranteed. The Extended Crosswise Model is an indirect questioning technique that guarantees the confidentiality of responding. To the degree that direct self-reports are biased by social desirability, prevalence estimates of hygiene practices such as thorough hand washing based on the Extended Crosswise Model should be lower than those based on direct self-reports. Results We analysed data of 1434 participants. In the direct questioning group 94.5% of the participants claimed to practice proper hand hygiene; in the indirect questioning group a significantly lower estimate of only 78.1% was observed. Conclusions These results indicate that estimates of the degree of commitment to measures designed to counter the spread of the disease may be significantly inflated by social desirability in direct self-reports. Indirect questioning techniques with higher levels of confidentiality seem helpful in obtaining more realistic estimates of the degree to which people follow the recommended personal hygiene measures. More realistic estimates of compliance can help to inform and to adjust public information campaigns on COVID-19 hygiene recommendations.

Do they really wash their hands? Prevalence estimates for personal hygiene behaviour during the COVID-19 pandemic based on indirect questions

Background: During the COVID-19 pandemic, billions of people have to change their behaviours to slow down the spreading of the virus. Protective measures include self-isolation, social (physical) distancing and compliance with personal hygiene rules, particularly regular and thorough hand washing. Prevalence estimates for the compliance with the COVID-19 measures are often based on direct self-reports. However, during a health crisis there is strong public pressure to comply with health and safety regulations so that people’s responding in direct self-reports may be seriously compromised by social desirability.Methods: In an online survey, an indirect questioning technique was used to test whether the prevalence of hygiene practices may be lower than in conventional surveys when confidentiality of responding is guaranteed. The Extended Crosswise Model is an indirect questioning technique that guarantees the confidentiality of responding. To the degree that direct self-reports are biased by social desirability, prevalence estimates of hygiene practices such as thorough hand washing based on the Extended Crosswise Model should be lower than those based on direct self-reports.Results: We analysed data of 1,434 participants. In the direct questioning group 94.5 % of the participants claimed to practice proper hand hygiene; in the indirect questioning group a significantly lower estimate of only 78.1 % was observed.Conclusions: These results indicate that estimates of the degree of commitment to measures designed to counter the spread of the disease may be significantly inflated by social desirability in direct self-reports. Indirect questioning techniques with higher levels of confidentiality seem helpful in obtaining more realistic estimates of the degree to which people follow the recommended personal hygiene measures. More realistic estimates of compliance can help to inform and to adjust public information campaigns on COVID-19 hygiene recommendations.