Material Incentives and Other Potential Factors Associated With Response Rates to Internet Surveys of American Evaluation Association Members: Findings From a Randomized Experiment

2019 ◽  
Vol 41 (2) ◽  
pp. 277-296 ◽  
Author(s):  
Chris L. S. Coryn ◽  
Lyssa W. Becho ◽  
Carl D. Westine ◽  
Pedro F. Mateu ◽  
Ruqayyah N. Abu-Obaid ◽  
...  

Internet surveys of American Evaluation Association (AEA) members are a common method for studying evaluation practice. Response rates obtained from Internet surveys of AEA members are, however, frequently very small. To investigate whether or not material incentives increase response rates to Internet surveys of AEA members, a between-subjects three-treatment and one control randomized experiment in which a randomly selected sample of AEA members were randomly assigned to a no-incentive control condition, lottery condition, token incentive condition, or philanthropic donation incentive condition was utilized. The overall response rate to the survey was 39.66% and the response rates for each of the four conditions were control = 36.24%, lottery = 44.39%, token incentive = 43.28%, and philanthropic donation = 34.67%, respectively. The cost-effectiveness of each of the four conditions also was examined, demonstrating that the lottery was the most cost-effective. Other factors potentially influencing response or nonresponse decisions also are discussed.

Author(s):  
Cristine D. Delnevo ◽  
Binu Singh

Abstract Background: Achieving a high response rate for physicians has been challenging and with response rates declining in recent years, innovative methods are needed to increase rates. An emerging concept in survey methodology has been web-push survey delivery. In this delivery method, contact is made by mail to request a response by web. This study explored the feasibility of a web-push survey on a national sample of physicians. Methods: 1000 physicians across six specialties were randomly assigned to a mail only or web-push survey delivery. Each mode consisted of four contacts including an initial mailing, reminder postcard, and two additional follow-ups. Response rates were calculated using AAPOR’s response rate 3 calculation. Data collection occurred between Febuary – April 2018 and analyzed March 2019. Results: Overall reponse rates for the mail only vs. web-push survey delivery were comparable (51.2% vs. 52.8%). Higher response rates across all demographics were seen in the web-push delivery with the exception of pulmonary/critical care and physicians over the age of 65. The web-push survey yielded a greater response after the first mailing requiring fewer follow-up contacts resulting in a more cost-effective delivery. Conclusions: A web-push mail survey is effective in achieveing a comparable response rate to traditional mail only delivery for physicians. The web-push survey was more efficient in terms of cost and in receiving responses in a more timely manner. Future research should explore the efficiency of a web-push survey delivery across various health care provider populations.


2013 ◽  
Vol 29 (2) ◽  
pp. 261-276 ◽  
Author(s):  
Katherine A. McGonagle ◽  
Robert F. Schoeni ◽  
Mick P. Couper

Abstract Since 1969, families participating in the U.S. Panel Study of Income Dynamics (PSID) have been sent a mailing asking them to update or verify their contact information in order to keep track of their whereabouts between waves. Having updated contact information prior to data collection is associated with fewer call attempts, less tracking, and lower attrition. Based on these advantages, two experiments were designed to increase response rates to the between wave contact mailing. The first experiment implemented a new protocol that increased the overall response rate by 7-10 percentage points compared to the protocol in place for decades on the PSID. This article provides results from the second experiment which examines the basic utility of the between-wave mailing, investigates how incentives affect article cooperation to the update request and field effort, and attempts to identify an optimal incentive amount. Recommendations for the use of contact update strategies in panel studies are made.


Blood ◽  
2021 ◽  
Vol 138 (Supplement 1) ◽  
pp. 751-751
Author(s):  
George Goshua ◽  
Pranay Sinha ◽  
Lauren Pischel ◽  
Alfred Ian Lee ◽  
Adam Cuker

Abstract Introduction: Immune thrombocytopenia (ITP) is an autoimmune disorder characterized by accelerated platelet clearance and impaired platelet production. Up to 75% of cases in adults assume a chronic course. Standard second-line treatment options include rituximab, thrombopoietin receptor agonists (TPO-RAs), and splenectomy. The 2019 American Society of Hematology (ASH) guidelines provide three dichomotous evaluations of these treatments with conditional recommendations for 1) splenectomy or TPO-RA, 2) rituximab over splenectomy, and 3) TPO-RA over rituximab. The guideline panel noted that there were no studies available to evaluate the cost-effectiveness of these therapies. We sought to address this knowledge gap by conducting the first cost-effectiveness analysis of second-line therapies for chronic ITP. Methods: We built a Markov model comparing the cost-effectiveness of all six treatment pathways utilizing rituximab, TPO-RA (romiplostim or eltrombopag), and splenectomy. We assumed a median age of 50 at diagnosis and a 20-year time-horizon. Costs were assessed from the health system perspective. Effectiveness was calculated in quality-adjusted life-years (QALYs). The costs of splenectomy treatment included the cost of surgery, postoperative care, accessory spleen imaging and repeat splenectomy, treatment for post-splenectomy sepsis and thromboembolism. The annual risks of post-splenectomy sepsis and thromboembolism were assumed to be the highest reported, every post-splenectomy infectious complication was assumed to be severe septic shock, and patients with thromboembolism accrued the costs of indefinite anticoagulation. To minimize bias against TPO-RAs, TPO-RA therapy was assumed to have no adverse events, a constant high overall response without any loss of effectiveness, and the highest reported rate of successful TPO-RA therapy discontinuation after two years, which we assumed to be permanent. Rituximab treatment was assumed to have no adverse events and overall response rates as previously reported. Cost-effectiveness of each treatment pathway was calculated as the incremental cost-effectiveness ratio (ICER), calculated as ratio of costs to QALYs. The ICER was compared against a 2019 US willingness-to-pay (WTP) threshold of $195,300. We then performed one-way deterministic sensitivity analyses varying all parameters including the costs of splenectomy, TPO-RA, rituximab, splenectomy complications, splenectomy complete response rates, TPO-RA and rituximab overall response rates, utilities of the well and diseases states, annual post-splenectomy septic shock mortality and perioperative splenectomy mortality. We concluded with a probabilistic sensitivity analysis running 10,000 Monte Carlo simulations. Results: The most cost-effective treatment pathway was #5 (splenectomy->rituximab->TPO-RA; Figure). The next most cost-effective pathway was #4 (rituximab followed by splenectomy and then TPO-RA therapy), with an ICER of $369,289. All four remaining treatment pathways (#1-3, 6) utilizing TPO-RA therapy early (first or second) had an ICER above $1 million, far above the US WTP of $195,300, and/or were dominated. Of these, pathways #1 and #3 were externally dominated and #2 was absolutely dominated. No parameter change in one-way deterministic sensitivity analysis in any of the 4 pathways featuring TPO-RA early brought down the ICER to under $1 million. In the probabilistic sensitivity analysis, pathway #5 was favored in 100% of 10,000 Monte Carlo simulations. The cost of TPO-RA would have to be decreased to under $20,000 annually (e.g., >80% reduction in the cost of eltrombopag or romiplostim) before it could become cost-effective in any TPO-early treatment pathway. Conclusion: Four treatment pathways (#1-#4) are consistent and two pathways (#5-#6) are at variance with the ASH guidelines. Although it does not align with the ASH guidelines, pathway #5 (splenectomy->rituximab->TPO-RA) was most cost-effective. Over a 20-year time-horizon, all pathways featuring early use of a TPO-RA exceeded an ICER >$1 million or were dominated. Because our model was designed to maximize the cost-effectiveness of TPO-RA, it is likely that the actual ICER of pathways featuring early use of TPO-RA are higher than what we report here. Preferred second-line treatment strategies in adults with chronic ITP may be worth considering in light of our findings. Figure 1 Figure 1. Disclosures Cuker: Synergy: Consultancy; Novo Nordisk: Research Funding; Alexion: Research Funding; UpToDate: Patents & Royalties; Novartis: Research Funding; Bayer: Research Funding; Takeda: Research Funding; Pfizer: Research Funding; Sanofi: Research Funding; Spark Therapeutics: Research Funding.


Field Methods ◽  
2022 ◽  
pp. 1525822X2110696
Author(s):  
Philip S. Brenner ◽  
Trent D. Buskirk

We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive types (prepaid cash, prepaid giftcodes, and conditional giftcodes). Invitations were sent to a sample of 17,808 addresses in Boston, Massachusetts, recruiting for a new online panel study of city residents. We report response rates and costs for each condition. Findings suggest that letters achieve higher response rates than postcards and are more cost effective overall. We also find that conditional incentives achieve higher response rates and are more cost effective, although conflating factors do not permit clear inferences. Notably, the novel scratch-off postcard condition achieved the lowest response rate and the highest costs per completed survey.


1996 ◽  
Vol 63 (4) ◽  
pp. 451-457
Author(s):  
F. De Braud ◽  
T. De Pas ◽  
M. Maffezzini

Although many different treatments have been evaluated in the last thirty years, advanced renal cell carcinoma still has a poor prognosis, characterised by a survival rate which is less than 5% at 3 years from diagnosis. Many different therapeutic approaches have been carried out in addition to cytotoxic chemotherapy, which shows obvious limits such as an overall response rate that does not go above 10-15%. One of the more promising treatments that has been studied the most is undoubtedly immunotherapy. We present a literature review aimed at summing up all the results obtained until now with immunotherapy of renal cell carcinoma, whether alone or in combination with cytotoxic chemotherapy. Unanswered questions of major concern are stressed, such as treatment choice, dosage, the most convenient schedules with particular regard to the cost-benefit issue.


Blood ◽  
2012 ◽  
Vol 120 (21) ◽  
pp. 4640-4640
Author(s):  
Kelly Northridge ◽  
Mark Danese ◽  
Robert Deuson

Abstract Abstract 4640 OBJECTIVES: To compare the drug costs relative to response of two thrombopoietin receptor agonists, romiplostim and eltrombopag, to Watch & Rescue for the treatment of chronic immune thrombocytopenia (ITP), from a health plan perspective. ITP, a diagnosis of exclusion, is characterized by low platelet counts and, depending on platelet count level, increased risk of bleeding (Rodeghiero F, et al. Blood. 2009:113(11):2386–2393). METHODS: An Excel® model compared 2011 US drug costs (wholesale acquisition cost) to the overall patient response rates (four or more weekly platelet counts of ≥50 × 109/L during the study from week 2 to 25) observed in individual 6-month placebo-controlled trials for romiplostim, eltrombopag, and placebo (or Watch & Rescue) (http://www.nice.org.uk/nicemedia/live/12025/50715/50715.pdf). These trials studied patients with median baseline platelet counts of 16 × 109/L (in both the romiplostim and eltrombopag trials) with 51% of the eltrombopag and 64% of the romiplostim patients receiving ≥3 previous treatments prior to joining each respective trial (Kuter, D, et al. Lancet. 2008:371:395–403; Cheng G, et al. Lancet. 2011:377:393–402; Bussel, J, et al. Lancet. 2009:373:641–648). The model considers a 55 mg daily dose of eltrombopag, and an average dose (including wastage) derived from a trial-based simulation for the US of 286 mcg per weekly administration of romiplostim. It assumes that 30% of US patients are splenectomized. The model considers a 1 g/kg overall dose of IVIg per rescue event at an average romiplostim trial-based weighted average (by splenectomy status) rate of 2.29 administrations per 6-month period (Weitz, I, et al. Curr Med Res Opin. 2012:28(5):789–796). RESULTS: For romiplostim patients, the expected cost of treating a patient with romiplostim over a 6-month period (trial period) is $34,655, with an overall response rate of 83%, or a cost per patient with an overall response of $41,753 ($34,655÷83%). The expected 6-month cost of treating the same patient with eltrombopag is $28,516, for an overall response rate of 57%, or a cost per patient with an overall response of $50,028 ($28,516÷57%). Comparatively, the expected 6-month cost of treating the same patient with Watch & Rescue is $11,681, with an overall response rate of 9%, or a cost per patient with an overall response of $129,789 ($11,681÷9%). Patients treated with thrombopoietin receptor agonists experience a 48 to 74% higher overall response rates than patients treated with Watch & Rescue, at a 153 to 196% reduction in resources to achieve the response. Sensitivity analyses were performed on key variables; a ±50% change in the average 6-month cost of IVIg (from either a decrease in cost or a decrease in the average number of administrations) resulted in ±50% change in the Watch & Rescue cost per response ($64,894 to $194,683). A decrease of 25% to the response rates for romiplostim and eltrombopag individually resulted in a 33% increase in the overall cost per patient with an overall response to $55,670 for romiplostim and $66,704 for eltrombopag. CONCLUSIONS: In chronic adult ITP, the use of thrombopoietin receptor agonists represents an efficient use of healthcare resources, with better health outcomes at a significantly lower cost per treatment success than treatment with Watch & Rescue. Disclosures: Northridge: Amgen Inc.: Consultancy, Research Funding. Danese:Amgen Inc.: Consultancy, Research Funding. Deuson:Amgen Inc.: Employment, Equity Ownership.


2006 ◽  
Vol 24 (18_suppl) ◽  
pp. 7167-7167 ◽  
Author(s):  
C. Yang ◽  
C. Yu ◽  
K. Chen ◽  
Z. Lin ◽  
S. Kuo ◽  
...  

7167 Background: Gefitinib is an effective treatment for chemotherapy-treated nonsmall cell lung cancer (NSCLC) in East Asian patients. There were only limited prospective studies on the use of gefitinib in chemonaive advanced or metastatic NSCLC patients. Methods: Eligibility included histological or cytological proven chemonaive stage IIIB/IV NSCLC, measurable disease, ECOG performance status of 0–2, good organ functions and candidate for platinum-based chemotherapy. Patients were treated with 250mg gefitinib per day. Tumor assessments were performed every two months by RECIST criteria. Responding patients were treated until progression. Patients with stable disease more than 2 months may continue treatment or shift to chemotherapy. The primary objective of this study was overall response rate of patients. Secondary objectives included 1-year progression-free survival, overall survival, and ancillary biomarker studies. Simon’s two-stage design was used to aim at a response rate more than 20%. Forty-four patients were planned in stage one and the study will be terminated if 5 or less patients responded to the treatment. A total of 106 patients are planned. Results: The planned interim analysis on the first 44 patients is reported here. There were 13 male and 31 female, median age was 63 (range 39–86), ECOG performance status of 0/1/2 were 0/40/4. 33 patients were nonsmokers. 39 patients had adenocarcinoma. The side effects of the treatment were mild and well accepted by patients. There were 24/9/10/1 patients with PR/SD/PD/NE. Overall response rate was 54.5% and disease control rate was 75%. The response rates for female / adenocarcinoma / nonsmoker were 58%/59%/61% respectively. The response rates for male / non-adenocarcinoma / smoker patients were 46%/20%/36%. The median time to progression for all patients was 6.3 months. Conclusions: Gefitinib is a very effective treatment for East Asian chemonaive advanced or metastatic NSCLC patients. Although the patients’ number was small, the response rates for patients with one unfavorable predictive factor were comparable to the response rates of patients receiving combination chemotherapy. The response rates and duration for 106 patients will be presented in the meeting. [Table: see text]


2019 ◽  
Vol 8 (5) ◽  
pp. 821-831
Author(s):  
Matthew Debell ◽  
Natalya Maisel ◽  
Brad Edwards ◽  
Michelle Amsbary ◽  
Vanessa Meldener

Abstract In mail surveys and in advance letters for surveys in other modes, it is common to include a prepaid incentive of a small amount such as $5. However, when letters are addressed generically (such as to “Resident”), advance letters may be thrown away without being opened, so the enclosed cash is wasted and the invitation or advance letter is ineffective. This research note describes results of an experiment using a nationally representative sample of 4,725 residential addresses to test a new way of letting mail recipients know their letter contains cash and is therefore worth opening: an envelope with a window revealing $5, so the cash is clearly visible from outside the sealed envelope. We also tested the USPS for evidence of theft, and we compared First Class and Priority Mail postage. We found no evidence of theft. We found no difference in response rates between Priority Mail and First Class, making First Class much more cost-effective, and we found that visible money increased the response rate to a mail survey from 42.6 to 46.9 percent, at no significant cost.


2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Michael G. Smith ◽  
Maryam Witte ◽  
Sarah Rocha ◽  
Mathias Basner

Abstract Background Questionnaires are valuable data collection instruments in public health research, and can serve to pre-screen respondents for suitability in future studies. Survey non-response leads to reduced effective sample sizes and can decrease representativeness of the study population, so high response rates are needed to minimize the risk of bias. Here we present results on the success of different postal questionnaire strategies at effecting response, and the effectiveness of these strategies at recruiting participants for a field study on the effects of aircraft noise on sleep. Methods In total, we mailed 17 rounds of 240 questionnaires (total n = 4080) to randomly selected households around Atlanta International Airport. Different mailing rounds were varied in the length of the questionnaire (11, 26 or 55 questions), survey incentive (gift card or $2 cash), number of follow-up waves (0, 2 or 3), incentive for participating in a 5-night in-home sleep study ($100, $150 or $200), and address personalization. Results We received completed questionnaires from 407 respondents (response rate 11.4%). Personalizing the address, enclosing a $2 cash incentive with the initial questionnaire mailing and repeated follow-up mailings were effective at increasing response rate. Despite the increased expense of these approaches in terms of each household mailed, the higher response rates meant that they were more cost-effective overall for obtaining an equivalent number of responses. Interest in participating in the field study decreased with age, but was unaffected by the mailing strategies or cash incentives for field study participation. The likelihood that a respondent would participate in the field study was unaffected by survey incentive, survey length, number of follow-up waves, field study incentive, age or sex. Conclusions Pre-issued cash incentives and sending follow-up waves could maximize the representativeness and numbers of people from which to recruit, and may be an effective strategy for improving recruitment into field studies.


2017 ◽  
Vol 107 (6) ◽  
pp. 516-521
Author(s):  
Jonathan Labovitz ◽  
Neil Patel ◽  
Israel Santander

Background: Patient experience is a critical component of continuous quality improvement and value-based health-care delivery. This study aimed to identify a simple, cost-effective means of administering a validated patient experience survey in ambulatory-care settings. Methods: Patients were randomly assigned to groups to complete the validated Consumer Assessment of Healthcare Providers and Systems (CAHPS) clinician and group patient satisfaction survey using a Web-based platform. The response rate was assessed for in-clinic and e-mail distribution and was compared with the historical response rates. Patients were able to change groups after randomization to assess effect on response rate and potential bias. The cost of survey administration was compared. Results: Of 132 participants, 87 completed surveys (65.9%), with no significant differences among distribution methods. Twenty-three participants self-selected the in-clinic survey after being randomized to the e-mail cohort. Survey responses were statistically significantly different in only three of 34 questions. Web-based survey administration costs two to four times less than standard mail, phone, and mixed-modal survey administration. Conclusions: We recommend that ambulatory clinics use Web-based technology to administer CAHPS clinician and group surveys, using both e-mail and in-clinic distribution to enhance the response rate.


Sign in / Sign up

Export Citation Format

Share Document