Enhancing Participation in Probability-Based Online Panels: Two Incentive Experiments and Their Effects on Response and Panel Recruitment

This article investigates how mail-based online panel recruitment can be facilitated through incentives. The analysis relies on two incentive experiments and their effects on panel recruitment, and the intermediate participation in the recruitment survey. The experiments were implemented in the context of the German Emigration and Remigration Panel Study and encompass two samples of randomly sampled persons. Tested incentives include a conditional lottery, conditional monetary incentives, and the combination of unconditional money-in-hand with conditional monetary incentives. For an encompassing evaluation of the link between incentives and panel recruitment, the article further assesses the incentives’ implications for demographic composition and panel recruitment unit costs. Multivariate analysis indicates that low combined incentives (€5/€5) or, where unconditional disbursement is unfeasible, high conditional incentives (€20) are most effective in enhancing panel participation. In terms of demographic bias, low combined incentives (€5/€5) and €10 conditional incentives are the favored options. The budget options from the perspective of panel recruitment include the lottery and the €10 conditional incentive which break-even at net sample sizes of 1000.

A Web-based Event History Calendar Approach for Measuring Contraceptive Use Behavior

Event history calendars (EHCs) are frequently used in social measurement to capture important information about the time ordering of events in people’s lives and enable inference about the relationships of the events with other outcomes of interest. To date, EHCs have primarily been designed for face-to-face or telephone survey interviewing, and few calendar tools have been developed for more private, self-administered modes of data collection. Web surveys offer benefits in terms of both self-administration, which can reduce social desirability bias, and timeliness. We developed and tested a web application enabling the calendar-based measurement of contraceptive method use histories. These measures provide valuable information for researchers studying family planning and fertility behaviors. This study describes the development of the web application and presents a comparison of data collected from online panels using the application with data from a benchmark face-to-face survey collecting similar measures (the National Survey of Family Growth).

Maximizing participation from online survey panel members

Low survey participation from online panel members is a key challenge for market and social researchers. We identify 10 key drivers of panel members’ online survey participation from a qualitative study and then determine empirically using a stated choice experiment the relative importance of each of those drivers at aggregate and segment levels. We contribute to knowledge on survey participation by (a) eliciting key drivers of survey participation by online panel members, (b) determining the relative importance of each driver, and (c) accounting for heterogeneity across panel members in the importance assigned to drivers. Findings offer immediate practical guidance to market and social researchers on how to increase participation in surveys using online panels.

Estimating the cost of pure cybercrime to Australian individuals

This report estimates the cost of pure cybercrime to individuals in Australia in 2019. A survey was administered to a sample of 11,840 adults drawn from two online panels—one using probability sampling and the other non-probability sampling—with the resulting data weighted to better reflect the distribution of the wider Australian population. Thirty-four percent of respondents had experienced some form of pure cybercrime, with 14 percent being victimised in the last 12 months. This is equivalent to nearly 6.7 million Australian adults having ever been the victim of pure cybercrime, and 2.8 million Australians being victimised in the past year. Drawing on these population estimates, the total economic impact of pure cybercrime in 2019 was approximately $3.5b. This encompasses $1.9b in money directly lost by victims, $597m spent dealing with the consequences of victimisation, and $1.4b spent on prevention costs. Victims recovered $389m.

Changes in Health Behaviors Associated With Weight Gain by Weight Classification During the COVID-19 Pandemic

Purpose: To determine whether perceived changes (i.e. perception of engagement during the pandemic relative to pre-pandemic) in specific health behaviors differ by weight status (i.e. healthy weight, overweight, obese). Design: Cross-sectional. Recruitment took place between June-August 2020, via social media posts and Qualtrics online panels. Setting: Participants completed the survey online through the Qualtrics platform. Sample: Analyses included N = 502 participants (≥18 years); 45.2% healthy weight (n = 227), 28.5% overweight (n = 143), and 26.3% obese (n = 132). Measures: Study-specific survey items included questions about demographics and perceived changes in health behaviors. Analysis: Logistic regression models, adjusted for age, race, ethnicity, gender, education, and COVID-19 diagnosis, assessed the odds of perceiving changes in health behaviors considered a risk for weight gain. Results: Participants with obesity, but not overweight, were significantly more likely to report deleterious changes to health behaviors compared to healthy weight peers, including: (1) decreased fruit/vegetable consumption [adjusted odds ratio (AOR) = 1.92; 95% confidence interval (CI): (1.13, 3.26)]; (2) increased processed food consumption [AOR = 1.85; 95%CI: (1.15, 3.00)]; (3) increased caloric intake [AOR = 1.66; 95% CI: (1.06, 2.61)]; (4) decreased physical activity [AOR = 2.07; 95%CI: (1.31, 3.28)]; and (5) deterioration in sleep quality [AOR = 2.07; 95%CI: (1.32, 3.25)]. Conclusion: Our findings suggest that adults with obesity may be at greater risk for unhealthy behaviors during a period of prolonged social distancing, potentially exacerbating the obesity epidemic.

Recruiting a Probability-Based Online Panel via Postal Mail: Experimental Evidence

Once recruited, probability-based online panels have proven to enable high-quality and high-frequency data collection. In ever faster-paced societies and, recently, in times of pandemic lockdowns, such online survey infrastructures are invaluable to social research. In absence of email sampling frames, one way of recruiting such a panel is via postal mail. However, few studies have examined how to best approach and then transition sample members from the initial postal mail contact to the online panel registration. To fill this gap, we implemented a large-scale experiment in the recruitment of the 2018 sample of the German Internet Panel (GIP) varying panel recruitment designs in four experimental conditions: online-only, concurrent mode, online-first, and paper-first. Our results show that the online-only design delivers higher online panel registration rates than the other recruitment designs. In addition, all experimental conditions led to similarly representative samples on key socio-demographic characteristics.

Pre-screening workers to overcome bias amplification in online labour markets

Groups have access to more diverse information and typically outperform individuals on problem solving tasks. Crowdsolving utilises this principle to generate novel and/or superior solutions to intellective tasks by pooling the inputs from a distributed online crowd. However, it is unclear whether this particular instance of “wisdom of the crowd” can overcome the influence of potent cognitive biases that habitually lead individuals to commit reasoning errors. We empirically test the prevalence of cognitive bias on a popular crowdsourcing platform, examining susceptibility to bias of online panels at the individual and aggregate levels. We then investigate the use of the Cognitive Reflection Test, notable for its predictive validity for both susceptibility to cognitive biases in test settings and real-life reasoning, as a screening tool to improve collective performance. We find that systematic biases in crowdsourced answers are not as prevalent as anticipated, but when they occur, biases are amplified with increasing group size, as predicted by the Condorcet Jury Theorem. The results further suggest that pre-screening individuals with the Cognitive Reflection Test can substantially enhance collective judgement and improve crowdsolving performance.

Maximising participation from online survey panel members

Low survey participation from online panel members is a key challenge for market and social researchers. We identify ten key drivers of panel members’ online survey participation from a qualitative study, then determine empirically using a stated choice experiment the relative importance of each of those drivers at aggregate and segment level. We contribute to knowledge on survey participation by (1) eliciting key drivers of survey participation by online panel members, (2) determining the relative importance of each driver, and (3) accounting for heterogeneity across panel members in the importance assigned to drivers. Findings offer immediate practical guidance to market and social researchers on how to increase participation in surveys using online panels.

Enhancing Participation in Probability-Based Online Panels: Two Incentive Experiments and their Effects on Response and Panel Recruitment

This article investigates how mail based online panel recruitment can be facilitated through incentives. The analysis relies on two incentive experiments and their effects on panel recruitment and the intermediate participation in the recruitment survey. The experiments were implemented in the context of the German Emigration and Remigration Panel Study and encompass two samples of randomly sampled persons. Tested incentives include a conditional lottery, conditional monetary incentives, and the combination of unconditional money-in-hand with conditional monetary incentives. For an encompassing evaluation of the link between incentives and panel recruitment, the article further assesses the incentives’ implications for demographic composition and panel recruitment unit costs. Multivariate analysis indicates that low combined incentives (€5/€5) or, where unconditional disbursement is unfeasible, high conditional incentives (€20) are most effective in enhancing panel participation. In terms of demographic bias, low combined incentives (€5/€5) and €10 conditional incentives are the favored options. The budget options from the perspective of panel recruitment include the lottery and the €10 conditional incentive which break even at net sample sizes of 1,000.

Learning by doing: The impact of experiencing democracy in education on political trust and participation

This article investigates whether engagement in school or university, such as being the speaker of class, a member of a student council, and so on, has an impact on political participation and political trust. Following interactionist socialization theory, engagement during adolescence should develop ideas of citizenship, democracy, and political participation. Schools and universities are arguably key institutions as they can promote democratic decision making in the classroom. This strengthens democracy by increasing experienced political efficacy and through internalizing democratic principles (‘learning democracy’): by acting democratic, one becomes a democratic citizen. My findings show that respondents who experienced democracy in school or university indeed tend to vote and engage even in contentious forms of political participation more often. Also, the experience of democratic practices in school and university increases trust in political institutions. Moreover, trust in political institutions, in turn, increases the likelihood of voting, but not of engaging in other forms of participation. Thus, early democratic experiences seem to foster vivid and participatory democracy without streamlining people into passive participation. The article provides empirical evidence from nine European countries and an additional glance at young cohorts based on online panels.