scholarly journals What’s in a Name? Effects of Alternative Forms of Addressing Households on Response Rates and Data Quality in an Address-based Mail Survey

Field Methods ◽  
2018 ◽  
Vol 31 (1) ◽  
pp. 39-55 ◽  
Author(s):  
Jennifer Dykema ◽  
Nadia Assad ◽  
Griselle Sanchez-Diettert ◽  
Kelly Elver ◽  
John Stevenson
Keyword(s):  
Best Practices ◽  
Data Quality ◽  
Survey Design ◽  
Mail Survey ◽  
Response Rates ◽  
Postal Service ◽  
Item Nonresponse ◽  
Mail Surveys ◽  
Materials Used ◽  
The Impact

Best practices in mail survey design advise personalizing correspondence, but most research predates the use of address-based sampling (ABS) in which a householder’s name either cannot be matched to an address or may be matched incorrectly. Further, recent evidence casts doubt on the effectiveness of personalization. The current study examines the impact of using a personalized versus a generic salutation on response rates and data quality in an ABS mail survey of the general population. A sample of 2,000 household addresses in Wisconsin was randomly selected from the U.S. Postal Service Delivery Sequence File. For households in the personalized salutation group, all materials used the surname of the household; cases in the generic salutation group referred to the state conducting the survey. While personalization was not related to response rates, it was associated with higher levels of item nonresponse. Findings support current recommendations not to use names in ABS mail surveys.

Effects of Sequential Prepaid Incentives on Response Rates, Data Quality, Sample Representativeness, and Costs in a Mail Survey of Physicians

2020 ◽  
pp. 016327872095818
Author(s):  
Jennifer Dykema ◽  
John Stevenson ◽  
Nadia Assad ◽  
Chad Kniss ◽  
Catherine A. Taylor
Keyword(s):  
Data Quality ◽  
Mail Survey ◽  
Response Rates ◽  
Quality Data ◽  
Item Nonresponse ◽  
Sample Representativeness ◽  
Initial Mailing ◽  
Cash Incentive ◽  
Group 10 ◽  
Group 5

While collecting high quality data from physicians is critical, response rates for physician surveys are frequently low. A proven method for increasing response in mail surveys is to provide a small, prepaid monetary incentive in the initial mailing. More recently, researchers have begun experimenting with adding a second cash incentive in a follow-up contact in order to increase participation among more reluctant respondents. To assess the effects of sequential incentives on response rates, data quality, sample representativeness, and costs, physicians (N = 1,500) were randomly assigned to treatments that crossed the amount of a first ($5 or $10) and second ($0, $5, or $10) incentive to form the following groups: Group $5/$5; Group $5/$10; Group $10/$0; Group $10/$5; and Group $10/$10. Overall, second incentives were associated with higher response rates and lower costs per completed survey, and while they had no effect on item nonresponse, they increased sample representativeness.

Response Rates and Perceived Questionnaire Length in Mail Surveys

1979 ◽  
Vol 16 (3) ◽  
pp. 429-431 ◽  
Author(s):  
Terry L. Childers ◽  
O. C. Ferrell
Keyword(s):  
Interaction Effect ◽  
Response Rate ◽  
Mail Survey ◽  
Response Rates ◽  
Survey Response ◽  
Factorial Experiment ◽  
Mail Surveys ◽  
Survey Response Rate ◽  
Significant Difference ◽  
The Impact

A 2 × 2 factorial experiment was designed to test the impact on mail survey response rate resulting from variations in paper trim size and number of printed pages in the questionnaire. ANOVA findings suggest 8½ × 11″ paper trim size produces a better response rate than an 8½ × 14″ paper trim size. Use of a one-sheet (front and back) versus a two-sheet (front only) questionnaire did not cause a significant difference in response rate; a hypothesized interaction effect was not found to be statistically significant.

scholarly journals Impact of Asking Race Information in Mail Surveys

1980 ◽  
Vol 44 (1) ◽  
pp. 67-70
Author(s):  
Jagdish N. Sheth ◽  
Arthur Leclaire ◽  
David Wachspress
Keyword(s):  
Field Experiment ◽  
Mail Survey ◽  
Response Rates ◽  
Mail Surveys ◽  
The Impact

A field experiment was carried out in four regions to measure the impact of asking race information in a mail survey. The six-page questionnaire was identical between control and test groups except for the addition of questions on race information. The response rates for both groups were identical.

Exploring the Impact of E-mail and Postcard Prenotification on Response Rates to a Mail Survey in an Academic Setting

2008 ◽  
Vol 2 (1) ◽  
pp. 94-103
Author(s):  
Leslie A. McCallister ◽  
Bobette Otto
Keyword(s):  
Response Rate ◽  
Mail Survey ◽  
Response Rates ◽  
Impact Response ◽  
Full Time ◽  
Initial Mailing ◽  
Project Costs ◽  
The Impact ◽  
E Mail ◽  
Time Faculty

What techniques effectively and consistently impact response rates to a mail survey? No clear answer to this question exists, largely because variability in response rates occurs depending on the population of interest, questionnaire type, and procedures used by researchers. This article examines the impact of e-mail and postcard prenotification on response rates to a mail survey by using a population of university full-time faculty and staff. Comparisons were made among respondents who received a postcard prenotification, those who received an e-mail prenotification, and those who received no prenotification prior to the initial mailing of a questionnaire. Data show that e-mail prenotification had the largest impact on response rate, while postcard prenotification had the least impact. In addition, the use of e-mail prenotification reduced overall project costs (both time and money). We suggest that the uses and applicability of e-mail prenotification be further explored to examine both its initial and overall impact on response rate in populations utilizing an electronic environment.

Increasing Response Rates to Mail Surveys: The Impact of Adherence to Dillman-like Procedures and Techniques

1986 ◽  
Vol 9 (2) ◽  
pp. 229-242 ◽  
Author(s):  
Lawrence S. Cote ◽  
Robert E. Grinnell ◽  
Loren D. Tompkins
Keyword(s):  
Response Rates ◽  
Mail Surveys ◽  
The Impact

SME Survey Methodology: Response Rates, Data Quality, and Cost Effectiveness

2003 ◽  
Vol 28 (2) ◽  
pp. 163-172 ◽  
Author(s):  
Rick Newby ◽  
John Watson ◽  
David Woodliff
Keyword(s):  
Cost Effectiveness ◽  
Data Collection ◽  
Data Quality ◽  
Survey Methodology ◽  
Methodological Issue ◽  
Cost Effective ◽  
Response Rates ◽  
Mail Surveys ◽  
Medium Enterprise ◽  
Quality Response

Cost effective data collection is an important methodological issue for small and medium enterprise (SME) researchers. There is a generally held view that mail surveys are the most efficient means of collecting empirical data, despite the potential difficulties associated with low response rates. To enhance the usefulness of mail surveys, researchers have suggested a variety of strategies aimed at improving response rates. While previous studies have examined the effect on response rates of many of these strategies, their impact on data quality and on the cost effectiveness of data collection is less well understood. This study evaluates four response–inducing strategies (printing the survey instrument on colored paper, telephone pre–notification, payment of a monetary incentive, and a follow–up mailing) in terms of their effect on data quality, response rates, and cost effectiveness for a population of SMEs.

Effects of Type of Postage and Covering Envelope on Response Rates in a Mail Survey

1986 ◽  
Vol 59 (1) ◽  
pp. 279-283 ◽  
Author(s):  
Melissa Elkind ◽  
Georgiana Shick Tryon ◽  
Anthony J. De Vito
Keyword(s):  
Cost Effectiveness ◽  
Mail Survey ◽  
Response Rates ◽  
Postage Stamp ◽  
Return Rates ◽  
Mail Surveys ◽  
Return Envelope

Two variables thought to influence return rates for mail surveys, type of covering envelope (plain or university printed) and type of return envelope (postage stamp or business reply) produced no statistically significant differences in return rates. Therefore, anticipated response rates and cost-effectiveness become important considerations when choosing methods for mail survey.

scholarly journals A Randomized Trial of the Impact of Survey Design Characteristics on Response Rates Among Nursing Home Providers

2011 ◽  
Vol 34 (4) ◽  
pp. 464-486 ◽  
Author(s):  
Melissa Clark ◽  
Michelle Rogers ◽  
Andrew Foster ◽  
Faye Dvorchak ◽  
Frances Saadeh ◽  
...  
Keyword(s):  
Survey Design ◽  
Response Rates ◽  
Incentive Structure ◽  
Term Care ◽  
Incentive Structures ◽  
Design Characteristics ◽  
C 30 ◽  
The Individual ◽  
Director Of Nursing ◽  
The Impact

An experiment was conducted to maximize participation of both the Director of Nursing (DoN) and the Administrator (ADMIN) in long-term care facilities. Providers in each of the 224 randomly selected facilities were randomly assigned to 1 of 16 conditions based on the combination of data collection mode (web vs. mail), questionnaire length (short vs. long), and incentive structure. Incentive structures were determined by amount compensated if the individual completed and an additional amount per individual if the pair completed (a) $30 individual/$5 pair/$35 total; (b) $10 individual/$25 pair/$35 total; (c) $30 individual/$20 pair/$50 total; and (d) $10 individual/$40 pair/$50 total. Overall, 47.4% of eligible respondents participated; both respondents participated in 29.3% of facilities. In multivariable analyses, there were no differences in the likelihood of both respondents participating by mode, questionnaire length, or incentive structure. Providing incentives contingent on participation by both providers of a facility was an ineffective strategy for significantly increasing response rates.

scholarly journals The Effects of a Delayed Incentive on Response Rates, Response Mode, Data Quality, and Sample Bias in a Nationally Representative Mixed Mode Study

Field Methods ◽  
2016 ◽  
Vol 29 (3) ◽  
pp. 221-237 ◽  
Author(s):  
Katherine A. McGonagle ◽  
Vicki A. Freedman
Keyword(s):  
Data Quality ◽  
Mixed Mode ◽  
Panel Study ◽  
Response Rates ◽  
Response Mode ◽  
Future Research ◽  
Sample Bias ◽  
Treatment Conditions ◽  
Nationally Representative ◽  
The Impact

This article describes the results of an experiment designed to examine the impact of the use and amount of delayed unconditional incentives in a mixed mode (push to web) supplement on response rates, response mode, data quality, and sample bias. The supplement was administered to individuals who participate in the U.S. Panel Study of Income Dynamics, the longest running national household panel in the world. After 10 weeks of data collection, individuals who had not yet completed the interview were sent a final survey request and randomly assigned to one of three treatment conditions: no incentive, US$5, and US$10. The impact of the incentives on response rates and mode, effects on data quality, and sample bias are described. The implications for the use of incentives in mixed mode surveys and directions for future research are discussed.

Item Nonresponse in a Population-Based Mail Survey of Physical Activity

2004 ◽  
Vol 1 (4) ◽  
pp. 344-362 ◽  
Author(s):  
Nicola W. Burton ◽  
Gavin Turrell ◽  
Brian Oldenburg
Keyword(s):  
Physical Activity ◽  
Low Income ◽  
Response Rate ◽  
Mail Survey ◽  
Population Based ◽  
Moderate Intensity ◽  
Item Nonresponse ◽  
Low Socioeconomic ◽  
Mail Surveys ◽  
Vigorous Intensity

Background.This study assessed item nonresponse (INR) in a population-based mail survey of physical activity (PA).Methods.A questionnaire was mailed to a random sample, with a 57% response rate (n = 2532). The magnitude and type of PA INR and the association with sociodemographic variables was examined using logistic regression.Results.Among survey respondents, 28% had incomplete PA data; 11% missed 1 item, 11% missed 2 items, and 5% missed all 3 items. Respondents missing 3 items tended to be female, less educated, low income, in poor health, and current smokers. The walking item was missed by 8% of respondents, and 18% and 23% missed the vigorous-intensity and moderate-intensity PA items respectively. These groups were sociodemograpically different from those without INR. Incomplete PA data was also associated with sociodemographic INR.Conclusions.Mail surveys may underrepresent individuals insufficiently active for health, in particular those of low socioeconomic position.

Sign in / Sign up

Export Citation Format

Share Document