Infrequent Identity Signals, Multiple Correspondence, and Detection Risks in Audit Correspondence Studies

Audit correspondence studies are field experiments that test for discriminatory behavior in active markets. Researchers measure discrimination by comparing how responsive individuals (“audited units”) are to correspondences from different types of people. This article elaborates on the tradeoffs researchers face between sending audited units only one correspondence and sending them multiple correspondences, especially when including less common identity signals in the correspondences. We argue that when researchers use audit correspondence studies to measure discrimination against individuals that infrequently interact with audited units, they raise the risk that these audited units become aware they are being studied or otherwise act differently. We also argue that sending multiple pieces of correspondence can increase detection risk. We present the result of an audit correspondence study that demonstrates how detection can occur for these reasons, leading to significantly attenuated (biased toward zero) estimates of discrimination.

Local and Transnational Identity, Positionality and Knowledge Production in Africa and the African Diaspora

How does shared identity between researcher and the researched influence trust-building for data generation and knowledge production? We reflect on this question based on two separate studies conducted by African-based researchers in sociology and political science in Nigeria. We advanced two interrelated positions. The first underscores the limits of national belonging as shorthand for insiderness, while the second argues that when shared national/group identity is tensioned other intersecting positions and relations take prominence. We also show that the researched challenge and resist unequal power relations through interview refusal or by evading issues that the researcher considers important, but the participant perceives as intrusive. We shed light on the vagaries, overlaps, and similarities in the dynamics of belonging and positionality in researching Africans in and outside Africa as home-based researchers. Our contribution advances the understanding of field dynamics in the production of local and cross-border knowledge on Africa/Africans.

Scratch the Scratch-off: Testing Prepaid and Conditional Incentives With Postcard and Letter Invitations in a Web-push Design With an Address-based Sample

We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive types (prepaid cash, prepaid giftcodes, and conditional giftcodes). Invitations were sent to a sample of 17,808 addresses in Boston, Massachusetts, recruiting for a new online panel study of city residents. We report response rates and costs for each condition. Findings suggest that letters achieve higher response rates than postcards and are more cost effective overall. We also find that conditional incentives achieve higher response rates and are more cost effective, although conflating factors do not permit clear inferences. Notably, the novel scratch-off postcard condition achieved the lowest response rate and the highest costs per completed survey.

A Web-based Event History Calendar Approach for Measuring Contraceptive Use Behavior

Event history calendars (EHCs) are frequently used in social measurement to capture important information about the time ordering of events in people’s lives and enable inference about the relationships of the events with other outcomes of interest. To date, EHCs have primarily been designed for face-to-face or telephone survey interviewing, and few calendar tools have been developed for more private, self-administered modes of data collection. Web surveys offer benefits in terms of both self-administration, which can reduce social desirability bias, and timeliness. We developed and tested a web application enabling the calendar-based measurement of contraceptive method use histories. These measures provide valuable information for researchers studying family planning and fertility behaviors. This study describes the development of the web application and presents a comparison of data collected from online panels using the application with data from a benchmark face-to-face survey collecting similar measures (the National Survey of Family Growth).

Biocultural Strategies for Measuring Psychosocial Stress Outcomes in Field-based Research

The goal of assessing psychosocial stress as a process and outcome in naturalistic (i.e., field) settings is applicable across the social, biological, and health sciences. Meaningful measurement of biology-in-context is, however, far from simple or straightforward. In this brief methods review, we introduce theoretical framings, methodological conventions, and ethical concerns around field-collection of markers of psychosocial stress that have emerged from 50 years of research at the intersection of anthropology and human biology. Highlighting measures of psychosocial stress outcomes most often used in biocultural studies, we identify the circumstances under which varied measures are most appropriately applied and provide examples of the types of cutting-edge research questions these measures can address. We explain that field-based psychosocial stress measures embedded in different body systems are neither equivalent nor interchangeable, but this recognition strengthens the study of stress as always simultaneously cultural and biological, situated in local ecologies, social–political structures, and time.

Evaluating the Performance of Five Asset-based Wealth Indices in Predicting Socioeconomic Position in Rural Bangladesh

Social scientists have developed numerous asset-based wealth indices to assess and target socioeconomic inequalities globally. However, there are no systematic studies of the relative performance of these different measures as proxies for socioeconomic position. In this study, we compare how five asset-based wealth indices—the International Wealth Index (IWI), the Standard of Living portion of the Multi-Dimensional Poverty Index (MPI-SL), the Poverty Probability Index (PPI), the Absolute Wealth Estimate (AWE), and the DHS Wealth Index (DHS)—predict benchmarks of socioeconomic position across 11 communities in rural Bangladesh. All indices were highly correlated. The IWI best explained variation in individual and community ranking of economic well-being, while the PPI best explained variation both between and within communities for total household wealth and a general measure of subjective social status.

Community Concept Drawing: A Participatory Visual Method for Incorporating Local Knowledge into Conceptualization

Concepts can provide researchers and communities with common ground for communicating and building understandings about the world. However, researchers who engage with communities often encounter unexpected interpretations of concepts in the field. This article introduces Community Concept Drawing (CCD), a participatory visual method aimed at facilitating a deep understanding of how local communities make sense of complex concepts often central to social research. We present the methodological foundations, protocol, and utility of CCD while drawing examples from our case studies in Senegal, Nepal, Morocco, and Kenya to examine the concept of empowerment. While CCD was created to open opportunities for studying empowerment within the field of international development, this article concludes by offering applications for using CCD to examine other concepts in various fields of study.

Agree or Disagree: Does It Matter Which Comes First? An Examination of Scale Direction Effects in a Multi-device Online Survey

Previous research shows that the direction of rating scales can influence participants’ response behavior. Studies also suggest that the device used to complete online surveys might affect the susceptibility to these effects due to the different question layouts (e.g., horizontal grids vs. vertical individual questions). This article contributes to previous research by examining scale direction effects in an online multi-device survey conducted with panelists in Spain. In this experiment, respondents were randomly assigned to two groups where the scale direction was manipulated (incremental vs. decremental). Respondents completed the questionnaire using the device of their choosing (57.8% used PCs; 36.5% used smartphones; and 5.7% used tablets). The results show that scale direction influenced response distributions but did not significantly affect data quality. In addition, our findings indicate that scale direction effects were comparable across devices. Findings are discussed and implications are highlighted.

Venue-based versus Geosocial Networking Application-based Recruitment of Young Men Who Have Sex with Men: An Examination of Feasibility

Because of the high cost, venue-based probability sampling of young men who have sex with men (YMSM) is largely inaccessible to social researchers. The aim of this study is to compare the feasibility of implementing geosocial networking application-based (GSNA) and venue-based prob`ability sampling of young men who have sex with men. A cross-sectional survey conducted in Los Angeles in 2017 and 2018 recruited 124 YMSM using both methods. We compared costs and hours of work for each method. Per participant, GSNA-based methods cost approximately 157 USD compared to 383 USD for the venue-based methods. For sample sizes up to 1,000, venue-based methods cost over two times more than GSNA-based methods. Findings indicate that research teams with limited resources may be able to implement probability-based recruitment by using GSNA. By lowering the cost of research and maintaining probability-based methodological rigor, GSNAs can increase the amount of social research with YMSM.

Content Analysis and Predicting Survey Refusal: What Are Respondents’ Concerns about Participating in a Face-to-face Household Mental Health Survey?

Previous studies suggest that refusals form the largest proportion of nonresponse for household surveys. As face-to-face household health surveys are uncommon in several countries, it might be advantageous for prospective surveys to preemptively tackle respondents’ refusal to survey participation. Using contact history data from the Saudi National Mental Health Survey, we examined the relationship between social environmental factors, respondent characteristics, survey request concerns recorded by interviewers, and respondents’ propensity to refuse to participate in the survey. Content analysis and logistic regressions were conducted. Our findings suggest that urbanicity, region, socioeconomic status, age, and gender are associated with refusal. Patriarchal gatekeepers and specific survey-related concerns are more likely to lead to temporary refusals compared to final refusals. These results have implications for survey researchers employing similar recruitment and data collection methods, for example in tailoring refusal conversion strategies for interviewers to address concerns expressed by Saudi and/or culturally similar respondents.