Scratch the Scratch-off: Testing Prepaid and Conditional Incentives With Postcard and Letter Invitations in a Web-push Design With an Address-based Sample

Field Methods ◽  
2022 ◽  
pp. 1525822X2110696
Author(s):  
Philip S. Brenner ◽  
Trent D. Buskirk
Keyword(s):  
Response Rate ◽  
Panel Study ◽  
Cost Effective ◽  
Response Rates ◽  
Lottery Ticket ◽  
Survey Experiment ◽  
The Novel ◽  
Online Panel

We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive types (prepaid cash, prepaid giftcodes, and conditional giftcodes). Invitations were sent to a sample of 17,808 addresses in Boston, Massachusetts, recruiting for a new online panel study of city residents. We report response rates and costs for each condition. Findings suggest that letters achieve higher response rates than postcards and are more cost effective overall. We also find that conditional incentives achieve higher response rates and are more cost effective, although conflating factors do not permit clear inferences. Notably, the novel scratch-off postcard condition achieved the lowest response rate and the highest costs per completed survey.

scholarly journals The effect of a web-push survey on physician survey response rates: a randomized experiment.

2019 ◽  
Author(s):  
Cristine D. Delnevo ◽  
Binu Singh
Keyword(s):  
Survey Methodology ◽  
Response Rate ◽  
Mail Survey ◽  
Cost Effective ◽  
Response Rates ◽  
National Sample ◽  
High Response Rate ◽  
Future Research ◽  
Effective Delivery ◽  
The Web

Abstract Background: Achieving a high response rate for physicians has been challenging and with response rates declining in recent years, innovative methods are needed to increase rates. An emerging concept in survey methodology has been web-push survey delivery. In this delivery method, contact is made by mail to request a response by web. This study explored the feasibility of a web-push survey on a national sample of physicians. Methods: 1000 physicians across six specialties were randomly assigned to a mail only or web-push survey delivery. Each mode consisted of four contacts including an initial mailing, reminder postcard, and two additional follow-ups. Response rates were calculated using AAPOR’s response rate 3 calculation. Data collection occurred between Febuary – April 2018 and analyzed March 2019. Results: Overall reponse rates for the mail only vs. web-push survey delivery were comparable (51.2% vs. 52.8%). Higher response rates across all demographics were seen in the web-push delivery with the exception of pulmonary/critical care and physicians over the age of 65. The web-push survey yielded a greater response after the first mailing requiring fewer follow-up contacts resulting in a more cost-effective delivery. Conclusions: A web-push mail survey is effective in achieveing a comparable response rate to traditional mail only delivery for physicians. The web-push survey was more efficient in terms of cost and in receiving responses in a more timely manner. Future research should explore the efficiency of a web-push survey delivery across various health care provider populations.

scholarly journals The Effects of a Between-Wave Incentive Experiment on Contact Update and Production Outcomes in a Panel Study

2013 ◽  
Vol 29 (2) ◽  
pp. 261-276 ◽  
Author(s):  
Katherine A. McGonagle ◽  
Robert F. Schoeni ◽  
Mick P. Couper
Keyword(s):  
Data Collection ◽  
Overall Response Rate ◽  
Response Rate ◽  
Panel Study ◽  
Response Rates ◽  
Income Dynamics ◽  
Overall Response ◽  
Percentage Points ◽  
Contact Information ◽  
The U.S

Abstract Since 1969, families participating in the U.S. Panel Study of Income Dynamics (PSID) have been sent a mailing asking them to update or verify their contact information in order to keep track of their whereabouts between waves. Having updated contact information prior to data collection is associated with fewer call attempts, less tracking, and lower attrition. Based on these advantages, two experiments were designed to increase response rates to the between wave contact mailing. The first experiment implemented a new protocol that increased the overall response rate by 7-10 percentage points compared to the protocol in place for decades on the PSID. This article provides results from the second experiment which examines the basic utility of the between-wave mailing, investigates how incentives affect article cooperation to the update request and field effort, and attempts to identify an optimal incentive amount. Recommendations for the use of contact update strategies in panel studies are made.

scholarly journals The Trump Effect: An Experimental Investigation of the Emboldening Effect of Racially Inflammatory Elite Communication

2020 ◽  
pp. 1-22 ◽  
Author(s):  
Benjamin Newman ◽  
Jennifer L. Merolla ◽  
Sono Shah ◽  
Danielle Casarez Lemi ◽  
Loren Collingwood ◽  
...  
Keyword(s):  
United States ◽  
Experimental Investigation ◽  
Panel Study ◽  
The United States ◽  
Political Elites ◽  
Survey Experiment ◽  
Political Actors ◽  
Online Panel ◽  
Societal Context ◽  
Elite Communication

Abstract This article explores the effect of explicitly racial and inflammatory speech by political elites on mass citizens in a societal context where equality norms are widespread and generally heeded yet a subset of citizens nonetheless possesses deeply ingrained racial prejudices. The authors argue that such speech should have an ‘emboldening effect’ among the prejudiced, particularly where it is not clearly and strongly condemned by other elite political actors. To test this argument, the study focuses on the case of the Trump campaign for president in the United States, and utilizes a survey experiment embedded within an online panel study. The results demonstrate that in the absence of prejudiced elite speech, prejudiced citizens constrain the expression of their prejudice. However, in the presence of prejudiced elite speech – particularly when it is tacitly condoned by other elites – the study finds that the prejudiced are emboldened to both express and act upon their prejudices.

Material Incentives and Other Potential Factors Associated With Response Rates to Internet Surveys of American Evaluation Association Members: Findings From a Randomized Experiment

2019 ◽  
Vol 41 (2) ◽  
pp. 277-296 ◽  
Author(s):  
Chris L. S. Coryn ◽  
Lyssa W. Becho ◽  
Carl D. Westine ◽  
Pedro F. Mateu ◽  
Ruqayyah N. Abu-Obaid ◽  
...  
Keyword(s):  
Overall Response Rate ◽  
Response Rate ◽  
Cost Effective ◽  
Response Rates ◽  
Randomized Experiment ◽  
Incentive Condition ◽  
Evaluation Practice ◽  
Internet Surveys ◽  
Potential Factors ◽  
The Cost

Internet surveys of American Evaluation Association (AEA) members are a common method for studying evaluation practice. Response rates obtained from Internet surveys of AEA members are, however, frequently very small. To investigate whether or not material incentives increase response rates to Internet surveys of AEA members, a between-subjects three-treatment and one control randomized experiment in which a randomly selected sample of AEA members were randomly assigned to a no-incentive control condition, lottery condition, token incentive condition, or philanthropic donation incentive condition was utilized. The overall response rate to the survey was 39.66% and the response rates for each of the four conditions were control = 36.24%, lottery = 44.39%, token incentive = 43.28%, and philanthropic donation = 34.67%, respectively. The cost-effectiveness of each of the four conditions also was examined, demonstrating that the lottery was the most cost-effective. Other factors potentially influencing response or nonresponse decisions also are discussed.

Improving Survey Response Rates with Visible Money

2019 ◽  
Vol 8 (5) ◽  
pp. 821-831
Author(s):  
Matthew Debell ◽  
Natalya Maisel ◽  
Brad Edwards ◽  
Michelle Amsbary ◽  
Vanessa Meldener
Keyword(s):  
Representative Sample ◽  
Response Rate ◽  
Mail Survey ◽  
Cost Effective ◽  
Response Rates ◽  
Survey Response ◽  
Research Note ◽  
Significant Cost ◽  
Mail Surveys ◽  
Nationally Representative

Abstract In mail surveys and in advance letters for surveys in other modes, it is common to include a prepaid incentive of a small amount such as $5. However, when letters are addressed generically (such as to “Resident”), advance letters may be thrown away without being opened, so the enclosed cash is wasted and the invitation or advance letter is ineffective. This research note describes results of an experiment using a nationally representative sample of 4,725 residential addresses to test a new way of letting mail recipients know their letter contains cash and is therefore worth opening: an envelope with a window revealing $5, so the cash is clearly visible from outside the sealed envelope. We also tested the USPS for evidence of theft, and we compared First Class and Priority Mail postage. We found no evidence of theft. We found no difference in response rates between Priority Mail and First Class, making First Class much more cost-effective, and we found that visible money increased the response rate to a mail survey from 42.6 to 46.9 percent, at no significant cost.

scholarly journals Effectiveness of incentives and follow-up on increasing survey response rates and participation in field studies

2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Michael G. Smith ◽  
Maryam Witte ◽  
Sarah Rocha ◽  
Mathias Basner
Keyword(s):  
Field Study ◽  
Response Rate ◽  
Cost Effective ◽  
Response Rates ◽  
Field Studies ◽  
Public Health Research ◽  
Postal Questionnaire ◽  
Sleep Study ◽  
Cash Incentives

Abstract Background Questionnaires are valuable data collection instruments in public health research, and can serve to pre-screen respondents for suitability in future studies. Survey non-response leads to reduced effective sample sizes and can decrease representativeness of the study population, so high response rates are needed to minimize the risk of bias. Here we present results on the success of different postal questionnaire strategies at effecting response, and the effectiveness of these strategies at recruiting participants for a field study on the effects of aircraft noise on sleep. Methods In total, we mailed 17 rounds of 240 questionnaires (total n = 4080) to randomly selected households around Atlanta International Airport. Different mailing rounds were varied in the length of the questionnaire (11, 26 or 55 questions), survey incentive (gift card or $2 cash), number of follow-up waves (0, 2 or 3), incentive for participating in a 5-night in-home sleep study ($100, $150 or $200), and address personalization. Results We received completed questionnaires from 407 respondents (response rate 11.4%). Personalizing the address, enclosing a $2 cash incentive with the initial questionnaire mailing and repeated follow-up mailings were effective at increasing response rate. Despite the increased expense of these approaches in terms of each household mailed, the higher response rates meant that they were more cost-effective overall for obtaining an equivalent number of responses. Interest in participating in the field study decreased with age, but was unaffected by the mailing strategies or cash incentives for field study participation. The likelihood that a respondent would participate in the field study was unaffected by survey incentive, survey length, number of follow-up waves, field study incentive, age or sex. Conclusions Pre-issued cash incentives and sending follow-up waves could maximize the representativeness and numbers of people from which to recruit, and may be an effective strategy for improving recruitment into field studies.

Web-Based Patient Experience Surveys to Enhance Response Rates

2017 ◽  
Vol 107 (6) ◽  
pp. 516-521
Author(s):  
Jonathan Labovitz ◽  
Neil Patel ◽  
Israel Santander
Keyword(s):  
Patient Experience ◽  
Response Rate ◽  
Care Delivery ◽  
Effective Means ◽  
Healthcare Providers ◽  
Cost Effective ◽  
Response Rates ◽  
Web Based ◽  
Survey Administration ◽  
E Mail

Background: Patient experience is a critical component of continuous quality improvement and value-based health-care delivery. This study aimed to identify a simple, cost-effective means of administering a validated patient experience survey in ambulatory-care settings. Methods: Patients were randomly assigned to groups to complete the validated Consumer Assessment of Healthcare Providers and Systems (CAHPS) clinician and group patient satisfaction survey using a Web-based platform. The response rate was assessed for in-clinic and e-mail distribution and was compared with the historical response rates. Patients were able to change groups after randomization to assess effect on response rate and potential bias. The cost of survey administration was compared. Results: Of 132 participants, 87 completed surveys (65.9%), with no significant differences among distribution methods. Twenty-three participants self-selected the in-clinic survey after being randomized to the e-mail cohort. Survey responses were statistically significantly different in only three of 34 questions. Web-based survey administration costs two to four times less than standard mail, phone, and mixed-modal survey administration. Conclusions: We recommend that ambulatory clinics use Web-based technology to administer CAHPS clinician and group surveys, using both e-mail and in-clinic distribution to enhance the response rate.

Increasing Response Rates among Coaches: The Role of Prenotification Methods

2002 ◽  
Vol 16 (3) ◽  
pp. 230-238 ◽  
Author(s):  
Aubrey Kent ◽  
Brian Turner
Keyword(s):  
Significant Influence ◽  
Response Rate ◽  
Cost Effective ◽  
Response Rates ◽  
Return Rate ◽  
Head Coaches ◽  
The Internet ◽  
Control Group ◽  
E Mail

This study determined whether, in a population of intercollegiate head coaches, prenotification had a significant influence on the return rate of mailed questionnaires. Acknowledging the growing use of e-mail and the Internet for survey distribution, the current study evaluated the effectiveness of e-mail as a prenotification technique, Response rates of Intercollegiate Head Coaches to mailed questionnaires from two separate samples were analyzed. Comparisons were made based upon the categorization of coaches into groups of prenotification by e-mail, formal letter, and a non-prenotified control group. Results indicated that prenotification of the survey recipients significantly increased response rates, with the group receiving e-mail prenotification having the highest response rate among the three groups. In addition to being cost effective for researchers, e-mail prenotification was an effective way to increase both the number and variety of contacts with survey recipients.

scholarly journals Assessing Physician Response Rate Using a Mixed-Mode Survey

2010 ◽  
Vol 3 (5) ◽  
pp. 1-6 ◽  
Author(s):  
Carolyn R Ahlers-Schmidt ◽  
Amy Chesser ◽  
Traci Hart ◽  
Jordan Jones ◽  
Katherine S Williams ◽  
...  
Keyword(s):  
Text Messaging ◽  
Mixed Mode ◽  
Response Rate ◽  
Cost Effective ◽  
Response Rates ◽  
Primary Study ◽  
Willingness To Use ◽  
E Mail ◽  
Physician Response

Background. It is important to minimize time and cost of physician surveys while still achieving a reasonable response rate. Mixed-mode survey administration appears to improve response rates and decrease bias. A literature review revealed physician response rates to mixed-mode surveys averaged about 68%. However, no identified studies used the combination of e-mail, fax, and telephone. The purpose of this study was to evaluate physician response rates based on surveys first administered by e-mail, then fax, then telephone. Methods. Surveys initially were administered by e-mail to 149 physicians utilizing SurveyMonkey©. Two follow-up reminder e-mails were sent to non-respondents at two-week intervals. Surveys then were faxed to physicians who had not responded. A follow-up fax was sent to non-respondents one week later. Finally, phone interviews were attempted with physicians who had not responded by e-mail or fax; each physician was called at least twice. Results. Of the 149 eligible physicians, 102 completed the survey for a response rate of 68.5%. Of those who responded, 49 (48%) responded by e-mail, 25 (24.5%) by fax, and 28 (27.5%) by phone. Mode of response did not differ by gender, specialization, or years in practice. In addition, mode of response was not related to the primary study question, physician willingness to use text messaging for immunization reminders. Conclusions. This mix of survey methodologies appeared to be a feasible combination for achieving physician responses and may be more cost effective than other mixed methods.

Comparing face-to-face to web data collection: unit response and costs in a national health survey (Preprint)

2020 ◽  
Author(s):  
Elise Braekman ◽  
Stefaan Demarest ◽  
Rana Charafeddine ◽  
Sabine Drieskens ◽  
Finaba Berete ◽  
...  
Keyword(s):  
Data Collection ◽  
Response Rate ◽  
Response Rates ◽  
Demographic Characteristics ◽  
Unit Response ◽  
Cost Advantage ◽  
Web Data ◽  
Demographic Groups ◽  
Considerable Cost ◽  
The Difference

BACKGROUND Potential is seen in web data collection for population health surveys due to a combination of its cost-effectiveness, implementation ease and the increased internet penetration. Nonetheless, web modes may lead to lower and more selective unit response rates than traditional modes and hence may increase bias in the measured indicators. OBJECTIVE This research assesses the unit response and costs of a web versus F2F study. METHODS Alongside the F2F Belgian Health Interview Survey of 2018 (BHIS2018; n gross sample used: 7,698), a web survey (BHISWEB; n gross sample=6,183) is organized. Socio-demographic data on invited individuals is obtained from the national register and census linkages. Unit response rates considering the different sampling probabilities of both surveys are calculated. Logistic regression analyses examine the association between mode system (web vs. F2F) and socio-demographic characteristics on unit non-response. The costs per completed web questionnaire are compared with these for a completed F2F questionnaire. RESULTS The unit response rate is lower in BHISWEB (18.0%) versus BHIS2018 (43.1%). A lower web response is found among all socio-demographic groups, however, the difference is higher among people older than 65, low educated people, people with a non-Belgian nationality, people living alone and these living in Brussels Capital. Not the same socio-demographic characteristics are associated with non-response in both studies. Having another European (OR (95% CI): 1.60 (1.20-2.13)) or a non-European nationality (OR (95% CI): 2.57 (1.79-3.70)) (compared to having the Belgian nationality) and living in the Brussels Capital (95% CI): 1.72 (1.41-2.10)) or Walloon (OR (95% CI): 1.47 (1.15 - 1.87) region (compared to living in the Flemish region) is only in BHISWEB associated with a higher non-response. In BHIS2018 younger people (OR (95% CI): 1.31 (1.11-1.54)) are more likely to be non-respondent than older people, this was not found BHISWEB. In both studies, lower educated people have a higher change to be non-respondent, but this effect is more pronounced in BHISWEB (OR low vs. high education level (95% CI): Web 2.71 (2.21-3.39)); F2F 1.70 (1.48-1.95)). The BHISWEB study has a considerable cost advantage; the total cost per completed questionnaire is almost three times lower (€41) compared to the F2F data collection (€111). CONCLUSIONS The F2F unit response rate is generally higher, yet for certain groups the difference between web versus F2F is more limited. A considerable cost advantage of web collection is found. It is therefore worthwhile to experiment with adaptive mixed-mode designs to optimize financial resources without increasing selection bias; e.g. only inviting socio-demographic groups more eager to participate online for web surveys while remaining to focus on increasing the F2F response rates for other groups. CLINICALTRIAL Studies approved by the Ethics Committee of the University hospital of Ghent

Sign in / Sign up

Export Citation Format

Share Document