Promised Incentives in Media Research: A Look at Data Quality, Sample Representativeness, and Response Rate

1984 ◽  
Vol 21 (2) ◽  
pp. 148-154 ◽  
Author(s):  
Edward G. Goetz ◽  
Tom R. Tyler ◽  
Fay Lomax Cook

The authors examine the effects of using promised incentives to increase respondent compliance in media research. The impact of promised incentives on data quality, sample representativeness, and response rate is studied. The use of promised incentives is found to increase response rates without lessening sample representativeness or response quality. In fact, the data suggest that incentives heighten response quality because they increase the attention respondents devote to the task for which they are being paid.

2008 ◽  
Vol 2 (1) ◽  
pp. 94-103
Author(s):  
Leslie A. McCallister ◽  
Bobette Otto

What techniques effectively and consistently impact response rates to a mail survey? No clear answer to this question exists, largely because variability in response rates occurs depending on the population of interest, questionnaire type, and procedures used by researchers. This article examines the impact of e-mail and postcard prenotification on response rates to a mail survey by using a population of university full-time faculty and staff. Comparisons were made among respondents who received a postcard prenotification, those who received an e-mail prenotification, and those who received no prenotification prior to the initial mailing of a questionnaire. Data show that e-mail prenotification had the largest impact on response rate, while postcard prenotification had the least impact. In addition, the use of e-mail prenotification reduced overall project costs (both time and money). We suggest that the uses and applicability of e-mail prenotification be further explored to examine both its initial and overall impact on response rate in populations utilizing an electronic environment.


Author(s):  
David Dutwin ◽  
Trent D Buskirk

Abstract Telephone surveys have become much maligned in the past few years, considering recent failures to correctly predict elections worldwide, response rates declining into the single digits, and the rise of low-cost, nonprobabilistic alternatives. Yet there is no study assessing the degree to which data attained via modern-day telephone interviewing has or has not significantly declined in terms of data quality. Utilizing an elemental approach, we evaluate the bias of various cross-tabulations of core demographics from a collection of surveys collected over the past two decades. Results indicate that (1) there has been a modest increase in bias over the past two decades but a downward trend in the past five years; (2) the share of cell phone interviews in samples has a significant impact on the bias; (3) traditional weighting largely mitigates the linear trend in bias; and (4), once weighted, telephone samples are nearly on par in data quality to higher response rate unweighted in-person data. Implications for the “fit for purpose” of telephone data and its general role in the future of survey research are discussed given our findings.


Field Methods ◽  
2016 ◽  
Vol 29 (3) ◽  
pp. 221-237 ◽  
Author(s):  
Katherine A. McGonagle ◽  
Vicki A. Freedman

This article describes the results of an experiment designed to examine the impact of the use and amount of delayed unconditional incentives in a mixed mode (push to web) supplement on response rates, response mode, data quality, and sample bias. The supplement was administered to individuals who participate in the U.S. Panel Study of Income Dynamics, the longest running national household panel in the world. After 10 weeks of data collection, individuals who had not yet completed the interview were sent a final survey request and randomly assigned to one of three treatment conditions: no incentive, US$5, and US$10. The impact of the incentives on response rates and mode, effects on data quality, and sample bias are described. The implications for the use of incentives in mixed mode surveys and directions for future research are discussed.


2012 ◽  
Vol 54 (2) ◽  
pp. 241-260 ◽  
Author(s):  
Jared M. Hansen ◽  
Scott M. Smith

Increasing both survey completion rates and data quality remains an important topic for fields as diverse as sociology, marketing, medicine and history. Thousands of studies have made response quality their central topic of examination, but their focus has largely been to measure response bias through the comparison of early–late wave responses. In this study, an innovative online field experiment tests a two-staged highly interesting question to produce an 8% better survey completion rate and to change sample representativeness by 12% over a usual one-stage highly interesting question appearing at the beginning of the questionnaire. In addition to these substantive findings, a distributional and probability analysis is developed that further refines methods for identifying the extent of non-response bias.


Blood ◽  
2007 ◽  
Vol 110 (11) ◽  
pp. 388-388 ◽  
Author(s):  
Martin H. Dreyling ◽  
Eva Hoster ◽  
Olivier Hermine ◽  
J.C. Kluin-Nelemans ◽  
Jan Walewski ◽  
...  

Abstract Background: Conventional chemotherapy achieves only short term remission despite high initial response rates of 70%–80%. In the current study generation, the European MCL Network investigates the impact of various combined immuno-chemotherapy regimens. Additionally, in elderly patients the role of rituximab maintenance is being evaluated, whereas in younger patients dose-intensified regimens with implementation of high dose cytarabine are investigated based on the excellent results of the HyperCVAD regimen. Methods: In MCL elderly, patients are initially randomized between 8 cycles of R-CHOP or 6 cycles of R-FC (experimental arm). Patients who achieve either an PR or CR, receive subsequently either interferon maintenance (standard arm) or a single rituximab dose every 2 months. In MCL younger, the standard arm (R-CHOP induction followed by myeloablative consolidation: 12 Gray TBI, 2x 60mg/kg cyclophosphamide) is compared to the implementation of high dose cytarabine into induction (R-CHOP/R-DHAP) and consolidation (10 Gray TBI, 4x1,5 g/m2 Ara-C, 140mg/m2 melphalan). Results: In MCL elderly, 222 of 263 patients were evaluable based on the annual interim analysis. Median age was 70 years with 66% of patients displaying an intermediate high/high risk IPI. Induction was well tolerated with mainly hematological toxicity (grade III/IV in R-CHOP/R-FC): Leukocytopenia 62/72%, thrombocytopenia 13%/40%, but only rare febrile neutropenia (23%/7%) or infections (19%/23%). Despite the poor risk profile, combined immuno-chemotherapy (total group) achieved a remarkable 84% response rate (51% CR/CRu). Although the impact of maintenance is not yet evaluable, both progression-free and overall survival were encouraging with 77% and 86% at 12 months, respectively. In MCL younger, 247 of 271 patients were evaluable. Again, toxicity (grade III/IV in R-CHOP/alternating R-DHAP) was mainly hematological: leukocytopenia 58/77%, thrombocytopenia 14%/74%, but only rare febrile neutropenia (11%/22%) or infections (5%/7%). Combined immuno-chemotherapy achieved a 93% response rate (60% CR/CRu) before subsequent high dose consolidation. Again, both progression-free and overall survival are remarkable with both 90% at 12 months, respectively. Discussion: Combined immuno-chemotherapy results in high response rates in two prospective international trials. Further recruitment and follow-up will determine the role of rituximab maintenance and high dose cytarabine in this distinct subtype of malignant lymphoma.


2007 ◽  
Vol 21 (3) ◽  
pp. 169-175 ◽  
Author(s):  
Robert P Myers ◽  
Abdel Aziz M Shaheen ◽  
Samuel S Lee

BACKGROUND: Surveys originating from universities appear to have higher response rates than those from commercial sources. In light of the growing scrutiny placed on physician-industry relations, the present study aimed to determine the impact of the pharmaceutical industry versus university sponsorship on response to a postal survey completed by Canadian hepatitis C virus (HCV) care providers.PATIENTS AND METHODS: In the present controlled trial, 229 physicians and nurses involved in HCV treatment were randomly assigned to receive a survey with sponsorship from a pharmaceutical company or university. The primary outcome was the proportion of completed surveys returned. The secondary outcomes included the response rate after the first mailing and the number of days taken to respond.RESULTS: One hundred fifteen participants were randomly assigned to receive the pharmaceutical industry survey and 114 were assigned to receive the university survey. The final response rate was 72.9% (167 of 229), which did not differ between the industry and university groups (RR=0.91; 95% CI 0.78 to 1.07). Nurses (OR=2.20; 95% CI 1.08 to 4.48) and participants from an academic centre (OR=3.14; 95% CI 1.64 to 6.00) were more likely to respond. The response rate after the first mailing (RR=0.85; 95% CI 0.68 to 1.07) and the median number of days taken to respond (21 days in both groups; P=0.20) did not differ between the industry and university groups.CONCLUSIONS: Pharmaceutical industry sponsorship does not appear to negatively impact response rates to a postal survey completed by Canadian HCV care providers.


2020 ◽  
pp. 016327872095818
Author(s):  
Jennifer Dykema ◽  
John Stevenson ◽  
Nadia Assad ◽  
Chad Kniss ◽  
Catherine A. Taylor

While collecting high quality data from physicians is critical, response rates for physician surveys are frequently low. A proven method for increasing response in mail surveys is to provide a small, prepaid monetary incentive in the initial mailing. More recently, researchers have begun experimenting with adding a second cash incentive in a follow-up contact in order to increase participation among more reluctant respondents. To assess the effects of sequential incentives on response rates, data quality, sample representativeness, and costs, physicians (N = 1,500) were randomly assigned to treatments that crossed the amount of a first ($5 or $10) and second ($0, $5, or $10) incentive to form the following groups: Group $5/$5; Group $5/$10; Group $10/$0; Group $10/$5; and Group $10/$10. Overall, second incentives were associated with higher response rates and lower costs per completed survey, and while they had no effect on item nonresponse, they increased sample representativeness.


Blood ◽  
2006 ◽  
Vol 108 (11) ◽  
pp. 522-522 ◽  
Author(s):  
S. Park ◽  
C. Kelaidi ◽  
S. Grabar ◽  
O. Beyne-Rauzy ◽  
S. Cheze ◽  
...  

Abstract Background: EPO and its derivative darbepoietin alfa (DAR) are important treatments of anemia in lower risk MDS. Prognostic factors of response and of its duration have been recently updated (Blood, 2005, 106, 803–11) and we reanalyzed them in a large series of patients (pts) treated in France and Belgium. Patients: 419 MDS pts were treated with EPO (≥30000UI/wk for at least 12 wks) or DAR (300μg/wk)± GCSF in 25 GFM centers between 1998 and 2006 (160 prospectively analyzed in 3 consecutive trials, and 259 retrospectively analyzed). Median follow-up was 54 months, median age: 73.5 years. WHO classification: RA (14%), RCMD (16%), 5q- syndrome (4%), RARS (21%) RCMD-RS (13%), RAEB-1 (22%), RAEB-2 (6%), and also 4%CMML (FAB); karyotype: 64% FAV, 16% INT, and 4% UNFAV (16% failure or not done). IPSS: 34% LOW, 40% INT-1, 8% INT-2, 2% HIGH (16% unavailable). 185, 126, 80 and 28 pts received EPO alone (alfa or beta), DAR, EPO+G and DAR+G respectively. Median pre-treatment EPO level was 76 UI/l (only 7% pts>500 UI/l). All pts had Hb<10g/dl and 54% required RBC transfusions (including 36% with >2 RBC units/month). Results: 63% pts responded (IWG criteria: 43%HI-E major and 20% HI-E minor), including 57%, 63%, 57%, 66%, 63% with EPO alfa alone, beta alone, EPO+G, DAR alone, DAR+G response (p=ns). Median response duration was 20 mos (range 3–74 mos), 25 and 14 mos for major and minor responses (p= 0.001). Relapse was associated with treatment discontinuation (45%), progression to higher grade MDS (12%) or AML (13%), but without evident cause in 30% cases. In univariate analysis, significantly higher response rates were observed in pts with <10% blasts (p= 0.002), low and INT-1 IPSS score (p=0.001), transfusion <2 RBC units/month (p<0.0001), EPO level<200UI/l (p<0.0001) whereas no significant difference in response rate were seen between RA (69%,) RCMD (72%), RARS (59%), RCMD-RS (71%), RAEB-1 (60%) and 5q- syndrome (52%), and between cytogenetic groups. The response rate in RARS and RCMD-RS was similar with EPO or DAR alone (62.5%), and EPO or DAR+G (60%). In multivariate analysis, EPO <200UI/l (p=0.008), transfusion requirement (p<0.0001) and IPSS (p=0.047) remained predictive factors of response. Longer response duration was significantly associated with blasts<10% (20 mos vs 8 mos for blasts>10%, p=0.007), major response (vs minor), IPSS low-INT-1 (median 22 mos vs 8 mos for INT-2/HIGH, p=0.001) and in pts with absence of multilineage dysplasia (24 mos vs 16 mos, p=0.01). In multivariate analysis, blasts <10% and major response remained predictive factors of longer response. Conclusions: EPO level <200UI/l, RBC transfusions <2 units/month were confirmed as major prognostic factors of response to EPO±G. Good response rates were seen in RAEB-1, and with EPO alone, in RARS and RCMD-RS. Multilineage dysplasia was not associated with lower response rates, but with shorter response duration. Other prognostic factors of shorter response duration were minor response (vs major), and blasts >10%. A case control study with pts of the International MDS risk Analysis Workshop, who received RBC transfusion alone, is in progress to evaluate the impact of EPO treatment on leukemia-free survival and overall survival, and its results will be presented.


1979 ◽  
Vol 16 (3) ◽  
pp. 429-431 ◽  
Author(s):  
Terry L. Childers ◽  
O. C. Ferrell

A 2 × 2 factorial experiment was designed to test the impact on mail survey response rate resulting from variations in paper trim size and number of printed pages in the questionnaire. ANOVA findings suggest 8½ × 11″ paper trim size produces a better response rate than an 8½ × 14″ paper trim size. Use of a one-sheet (front and back) versus a two-sheet (front only) questionnaire did not cause a significant difference in response rate; a hypothesized interaction effect was not found to be statistically significant.


Sign in / Sign up

Export Citation Format

Share Document