scholarly journals Enhancing Participation in Probability-Based Online Panels: Two Incentive Experiments and Their Effects on Response and Panel Recruitment

2022 ◽  
pp. 089443932110549
Author(s):  
Nils Witte ◽  
Ines Schaurer ◽  
Jette Schröder ◽  
Jean Philippe Décieux ◽  
Andreas Ette
Keyword(s):  
Multivariate Analysis ◽  
Panel Study ◽  
Monetary Incentives ◽  
Sample Sizes ◽  
Demographic Composition ◽  
Unit Costs ◽  
Online Panel ◽  
Two Samples ◽  
Online Panels

This article investigates how mail-based online panel recruitment can be facilitated through incentives. The analysis relies on two incentive experiments and their effects on panel recruitment, and the intermediate participation in the recruitment survey. The experiments were implemented in the context of the German Emigration and Remigration Panel Study and encompass two samples of randomly sampled persons. Tested incentives include a conditional lottery, conditional monetary incentives, and the combination of unconditional money-in-hand with conditional monetary incentives. For an encompassing evaluation of the link between incentives and panel recruitment, the article further assesses the incentives’ implications for demographic composition and panel recruitment unit costs. Multivariate analysis indicates that low combined incentives (€5/€5) or, where unconditional disbursement is unfeasible, high conditional incentives (€20) are most effective in enhancing panel participation. In terms of demographic bias, low combined incentives (€5/€5) and €10 conditional incentives are the favored options. The budget options from the perspective of panel recruitment include the lottery and the €10 conditional incentive which break-even at net sample sizes of 1000.

scholarly journals Enhancing Participation in Probability-Based Online Panels: Two Incentive Experiments and their Effects on Response and Panel Recruitment

2021 ◽  
Author(s):  
Nils Witte ◽  
Ines Schaurer ◽  
Jette Schröder ◽  
Jean Philippe Décieux ◽  
Andreas Ette
Keyword(s):  
Multivariate Analysis ◽  
Panel Study ◽  
Monetary Incentives ◽  
Sample Sizes ◽  
Demographic Composition ◽  
Unit Costs ◽  
Online Panel ◽  
Two Samples ◽  
Online Panels

This article investigates how mail based online panel recruitment can be facilitated through incentives. The analysis relies on two incentive experiments and their effects on panel recruitment and the intermediate participation in the recruitment survey. The experiments were implemented in the context of the German Emigration and Remigration Panel Study and encompass two samples of randomly sampled persons. Tested incentives include a conditional lottery, conditional monetary incentives, and the combination of unconditional money-in-hand with conditional monetary incentives. For an encompassing evaluation of the link between incentives and panel recruitment, the article further assesses the incentives’ implications for demographic composition and panel recruitment unit costs. Multivariate analysis indicates that low combined incentives (€5/€5) or, where unconditional disbursement is unfeasible, high conditional incentives (€20) are most effective in enhancing panel participation. In terms of demographic bias, low combined incentives (€5/€5) and €10 conditional incentives are the favored options. The budget options from the perspective of panel recruitment include the lottery and the €10 conditional incentive which break even at net sample sizes of 1,000.

Invitation Timing and Participation Rates in Online Panels: Findings From Two Survey Experiments

2018 ◽  
Vol 38 (2) ◽  
pp. 225-244 ◽  
Author(s):  
Elina Lindgren ◽  
Elias Markstedt ◽  
Johan Martinsson ◽  
Maria Andreasson
Keyword(s):  
Large Scale ◽  
Experimental Studies ◽  
Time Of Day ◽  
Willingness To Participate ◽  
Participation Rates ◽  
Web Surveys ◽  
Online Panel ◽  
Extended Field ◽  
Timing Effects ◽  
Online Panels

Falling participation rates is one of the most significant challenges facing survey research today. To curb this negative trend, scholars have searched for factors that can increase and decrease citizens’ willingness to participate in surveys. In this article, we investigate the timing effects of survey invitation e-mails on participation rates in a university-based online panel with members of the Swedish public. Through two large-scale experimental studies, we examine whether the day of week ( N = 11,294) and time of day ( N = 47,279) for sending out survey invitations impact participation rates. We also ask respondents when they prefer to answer surveys. We find that the timing of survey invitations affects participation rates, however, the effects are small, short-lived, and even out within a week. We also find that the effects of timing vary by employment status and age. The results have implications for scholars and practitioners who utilize online panels for web surveys. When quick answers are important, there may be some limited gains of tailoring the timing of the survey invitation to different individuals. In surveys with more extended field periods, however, such efforts seem less warranted.

Determinanten der Rücklaufquote in Online-Panels

2005 ◽  
Vol 17 (2) ◽  
pp. 64-74 ◽  
Author(s):  
Bernad Batinic ◽  
Klaus Moser
Keyword(s):  
Online Panel ◽  
Online Panels

Zusammenfassung. Überprüft wird der Einfluss der Gratifikationsform (Bonuspunkte, Verlosungen, Ergebnisberichte), des Untersuchungszwecks (wissenschaftliche versus kommerzielle Befragung) und der Zahl der Reminder auf die Rücklaufquote in Online-Panels. Hierzu wurden 68 Online-Umfragen, die in vier Online-Panels in den Jahren 2000 bis 2004 durchgeführt wurden, miteinander verglichen. Die durchschnittliche Rücklaufquote über alle untersuchten Online-Panel Umfragen hinweg betrug 71,9 Prozent (N = 57.598) bzw. stichprobengewichtet 73,5 Prozent. Vergabe von Bonuspunkten und Zahl der Reminder stehen in einem positiven Zusammenhang zur Rücklaufquote. Zwischen der Untersuchungsthematik (Forschung vs. kommerzielles Ziel) und der Rücklaufquote konnte hingegen nur ein schwacher Zusammenhang festgestellt werden. Die Ankündigung eines Ergebnisberichts über die Befragung steht entgegen den Erwartungen in einem negativen Zusammenhang zur Rücklaufquote. Generalisierbarkeit der Befunde sowie weitere Forschungsfragen werden abschließend diskutiert.

scholarly journals Does the Recruitment of Offline Households Increase the Sample Representativeness of Probability-Based Online Panels? Evidence From the German Internet Panel

2016 ◽  
Vol 35 (4) ◽  
pp. 498-520 ◽  
Author(s):  
Annelies G. Blom ◽  
Jessica M. E. Herzing ◽  
Carina Cornesse ◽  
Joseph W. Sakshaug ◽  
Ulrich Krieger ◽  
...  
Keyword(s):  
Panel Surveys ◽  
Recruitment Methods ◽  
Target Populations ◽  
Sample Representativeness ◽  
Online Panel ◽  
Implementation Costs ◽  
Using Data ◽  
Online Panels ◽  
The Impact ◽  
Internet Panels

The past decade has seen a rise in the use of online panels for conducting survey research. However, the popularity of online panels, largely driven by relatively low implementation costs and high rates of Internet penetration, has been met with criticisms regarding their ability to accurately represent their intended target populations. This criticism largely stems from the fact that (1) non-Internet (or offline) households, despite their relatively small size, constitute a highly selective group unaccounted for in Internet panels, and (2) the preeminent use of nonprobability-based recruitment methods likely contributes a self-selection bias that further compromises the representativeness of online panels. In response to these criticisms, some online panel studies have taken steps to recruit probability-based samples of individuals and providing them with the means to participate online. Using data from one such study, the German Internet Panel, this article investigates the impact of including offline households in the sample on the representativeness of the panel. Consistent with studies in other countries, we find that the exclusion of offline households produces significant coverage biases in online panel surveys, and the inclusion of these households in the sample improves the representativeness of the survey despite their lower propensity to respond.

Are Millennials Really Particularly Selfish? Preliminary Evidence From a Cross-Sectional Sample in the Philanthropy Panel Study

2019 ◽  
Vol 63 (14) ◽  
pp. 1965-1982 ◽  
Author(s):  
Peter Koczanski ◽  
Harvey S. Rosen
Keyword(s):  
Multivariate Analysis ◽  
Panel Data ◽  
Prosocial Behavior ◽  
Panel Study ◽  
Preliminary Evidence ◽  
Demographic Variables ◽  
Cross Sectional ◽  
Charitable Donations ◽  
Causal Mechanisms

We use panel data on charitable donations to analyze how the philanthropic behavior of Millennials (born between 1981 and 1996) compares with that of earlier generations. On the basis of a multivariate analysis with a rich set of economic and demographic variables, we find that conditional on making a gift, one cannot reject the hypothesis that Millennials donate more than members of earlier generations. However, Millennials are somewhat less likely to make any donations at all than their generational predecessors. While our data do not allow us to explore causal mechanisms, our findings suggest a more nuanced view of the Millennials’ prosocial behavior than is depicted in popular accounts.

Rules-Based Accounting Standards and SEC Enforcement

2020 ◽  
Vol 27 (2) ◽  
pp. 101
Author(s):  
Devon Baranek
Keyword(s):  
Multivariate Analysis ◽  
Opposite Effect ◽  
Accounting Standards ◽  
Financial Statement ◽  
Enforcement Action ◽  
Two Samples ◽  
The Impact ◽  
Archival Study

This archival study investigates the association between rules-based violations and the likelihood of SEC enforcement. I utilize two samples of firms subject to SEC investigations: 1) firms with investigations that end in an enforcement action and 2) firms with investigations that are dropped, and examine the impact of rules-based accounting violations on enforcement. Each enforcement action in the sample specifically cites the GAAP standard violated, and the degree to which the standards contain rules-based characteristics is quantified. The violations are classified as either rules-based or principles-based and a multivariate analysis is performed. The “roadmap” theory suggests that firms who commit rules-based violations are more likely to be subject to SEC enforcement, while the “roadblock” theory predicts the opposite effect. Overall, the results suggest the SEC is less likely to litigate cases that involve rules-based accounting violations, or more likely to drop/dismiss investigations centered on rules-based violations, consistent with the “roadblock” theory. No evidence is found of a relation between rules-based accounting violations and the dollar magnitude of penalties assessed. These results are relevant for financial statement preparers, auditors, and regulators.

scholarly journals Recruiting a Probability-Based Online Panel via Postal Mail: Experimental Evidence

2021 ◽  
pp. 089443932110060
Author(s):  
Carina Cornesse ◽  
Barbara Felderer ◽  
Marina Fikel ◽  
Ulrich Krieger ◽  
Annelies G. Blom
Keyword(s):  
High Frequency ◽  
Large Scale ◽  
Online Survey ◽  
Social Research ◽  
Experimental Conditions ◽  
Online Panel ◽  
Scale Experiment ◽  
Online Panels ◽  
Postal Mail ◽  
Representative Samples

Once recruited, probability-based online panels have proven to enable high-quality and high-frequency data collection. In ever faster-paced societies and, recently, in times of pandemic lockdowns, such online survey infrastructures are invaluable to social research. In absence of email sampling frames, one way of recruiting such a panel is via postal mail. However, few studies have examined how to best approach and then transition sample members from the initial postal mail contact to the online panel registration. To fill this gap, we implemented a large-scale experiment in the recruitment of the 2018 sample of the German Internet Panel (GIP) varying panel recruitment designs in four experimental conditions: online-only, concurrent mode, online-first, and paper-first. Our results show that the online-only design delivers higher online panel registration rates than the other recruitment designs. In addition, all experimental conditions led to similarly representative samples on key socio-demographic characteristics.

Scratch the Scratch-off: Testing Prepaid and Conditional Incentives With Postcard and Letter Invitations in a Web-push Design With an Address-based Sample

Field Methods ◽  
2022 ◽  
pp. 1525822X2110696
Author(s):  
Philip S. Brenner ◽  
Trent D. Buskirk
Keyword(s):  
Response Rate ◽  
Panel Study ◽  
Cost Effective ◽  
Response Rates ◽  
Lottery Ticket ◽  
Survey Experiment ◽  
The Novel ◽  
Online Panel

We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive types (prepaid cash, prepaid giftcodes, and conditional giftcodes). Invitations were sent to a sample of 17,808 addresses in Boston, Massachusetts, recruiting for a new online panel study of city residents. We report response rates and costs for each condition. Findings suggest that letters achieve higher response rates than postcards and are more cost effective overall. We also find that conditional incentives achieve higher response rates and are more cost effective, although conflating factors do not permit clear inferences. Notably, the novel scratch-off postcard condition achieved the lowest response rate and the highest costs per completed survey.

What Affects People’s Willingness to Participate in Qualitative Research? An Experimental Comparison of Five Incentives

Field Methods ◽  
2017 ◽  
Vol 29 (4) ◽  
pp. 333-350 ◽  
Author(s):  
Bridget Kelly ◽  
Marjorie Margolis ◽  
Lauren McCormack ◽  
Patricia A. LeBaron ◽  
Dhuly Chowdhury
Keyword(s):  
Qualitative Research ◽  
Representative Sample ◽  
Qualitative Interview ◽  
Experimental Comparison ◽  
Monetary Incentives ◽  
Willingness To Participate ◽  
Online Panel ◽  
The Us ◽  
Nationally Representative ◽  
The Impact

The literature on factors that influence participation in qualitative research is lacking. We conducted an experiment with a nationally representative sample to test the impact of different incentive types and amounts on willingness to participate in a hypothetical qualitative interview. We randomized participants from an online panel to one of the five versions of a recruitment ad: no incentive, a nonmonetary incentive, US$25, US$50, or US$75 ( N = 4,136). All three monetary incentives resulted in greater willingness to participate than no incentive or a nonmonetary incentive. No differences emerged between no incentive and a nonmonetary incentive (drawing for noncash prize). Among those who had at least some willingness, US$75 produced more willingness than US$25. The US$50 and US$75 amounts did not differ. Results suggest incentives matter in achieving participation in qualitative research, but there may be diminishing returns. Nonmonetary incentives may not result in higher participation than no incentive at all.

Sign in / Sign up

Export Citation Format

Share Document