scholarly journals Effectiveness of incentives and follow-up on increasing survey response rates and participation in field studies

2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Michael G. Smith ◽  
Maryam Witte ◽  
Sarah Rocha ◽  
Mathias Basner

Abstract Background Questionnaires are valuable data collection instruments in public health research, and can serve to pre-screen respondents for suitability in future studies. Survey non-response leads to reduced effective sample sizes and can decrease representativeness of the study population, so high response rates are needed to minimize the risk of bias. Here we present results on the success of different postal questionnaire strategies at effecting response, and the effectiveness of these strategies at recruiting participants for a field study on the effects of aircraft noise on sleep. Methods In total, we mailed 17 rounds of 240 questionnaires (total n = 4080) to randomly selected households around Atlanta International Airport. Different mailing rounds were varied in the length of the questionnaire (11, 26 or 55 questions), survey incentive (gift card or $2 cash), number of follow-up waves (0, 2 or 3), incentive for participating in a 5-night in-home sleep study ($100, $150 or $200), and address personalization. Results We received completed questionnaires from 407 respondents (response rate 11.4%). Personalizing the address, enclosing a $2 cash incentive with the initial questionnaire mailing and repeated follow-up mailings were effective at increasing response rate. Despite the increased expense of these approaches in terms of each household mailed, the higher response rates meant that they were more cost-effective overall for obtaining an equivalent number of responses. Interest in participating in the field study decreased with age, but was unaffected by the mailing strategies or cash incentives for field study participation. The likelihood that a respondent would participate in the field study was unaffected by survey incentive, survey length, number of follow-up waves, field study incentive, age or sex. Conclusions Pre-issued cash incentives and sending follow-up waves could maximize the representativeness and numbers of people from which to recruit, and may be an effective strategy for improving recruitment into field studies.

2010 ◽  
Vol 3 (5) ◽  
pp. 1-6 ◽  
Author(s):  
Carolyn R Ahlers-Schmidt ◽  
Amy Chesser ◽  
Traci Hart ◽  
Jordan Jones ◽  
Katherine S Williams ◽  
...  

Background. It is important to minimize time and cost of physician surveys while still achieving a reasonable response rate. Mixed-mode survey administration appears to improve response rates and decrease bias. A literature review revealed physician response rates to mixed-mode surveys averaged about 68%. However, no identified studies used the combination of e-mail, fax, and telephone. The purpose of this study was to evaluate physician response rates based on surveys first administered by e-mail, then fax, then telephone. Methods. Surveys initially were administered by e-mail to 149 physicians utilizing SurveyMonkey©. Two follow-up reminder e-mails were sent to non-respondents at two-week intervals. Surveys then were faxed to physicians who had not responded. A follow-up fax was sent to non-respondents one week later. Finally, phone interviews were attempted with physicians who had not responded by e-mail or fax; each physician was called at least twice. Results. Of the 149 eligible physicians, 102 completed the survey for a response rate of 68.5%. Of those who responded, 49 (48%) responded by e-mail, 25 (24.5%) by fax, and 28 (27.5%) by phone. Mode of response did not differ by gender, specialization, or years in practice. In addition, mode of response was not related to the primary study question, physician willingness to use text messaging for immunization reminders. Conclusions. This mix of survey methodologies appeared to be a feasible combination for achieving physician responses and may be more cost effective than other mixed methods.


Author(s):  
Cristine D. Delnevo ◽  
Binu Singh

Abstract Background: Achieving a high response rate for physicians has been challenging and with response rates declining in recent years, innovative methods are needed to increase rates. An emerging concept in survey methodology has been web-push survey delivery. In this delivery method, contact is made by mail to request a response by web. This study explored the feasibility of a web-push survey on a national sample of physicians. Methods: 1000 physicians across six specialties were randomly assigned to a mail only or web-push survey delivery. Each mode consisted of four contacts including an initial mailing, reminder postcard, and two additional follow-ups. Response rates were calculated using AAPOR’s response rate 3 calculation. Data collection occurred between Febuary – April 2018 and analyzed March 2019. Results: Overall reponse rates for the mail only vs. web-push survey delivery were comparable (51.2% vs. 52.8%). Higher response rates across all demographics were seen in the web-push delivery with the exception of pulmonary/critical care and physicians over the age of 65. The web-push survey yielded a greater response after the first mailing requiring fewer follow-up contacts resulting in a more cost-effective delivery. Conclusions: A web-push mail survey is effective in achieveing a comparable response rate to traditional mail only delivery for physicians. The web-push survey was more efficient in terms of cost and in receiving responses in a more timely manner. Future research should explore the efficiency of a web-push survey delivery across various health care provider populations.


2017 ◽  
Vol 14 (4) ◽  
pp. 381-386 ◽  
Author(s):  
Amy J Morgan ◽  
Ronald M Rapee ◽  
Jordana K Bayer

Background/aims Achieving a high response rate to follow-up questionnaires in randomized controlled trials of interventions is important for study validity. Few studies have tested the value of incentives in increasing response rates to online questionnaires in clinical trials of health interventions. This study evaluated the effect of a gift card prize-draw incentive on response rates to follow-up questionnaires within a trial of an online health intervention. Method The study was embedded in a host randomized controlled trial of an online parenting program for child anxiety. A total of 433 participants were randomly allocated to one of two groups: (1) being informed that they would enter a gift card prize-draw if they completed the final study questionnaire (24-week follow-up) and (2) not informed about the prize-draw. All participants had a 1 in 20 chance of winning an AUD50 gift card after they completed the online questionnaire. Results The odds of the informed group completing the follow-up questionnaire were significantly higher than the uninformed group, (79.6% vs 68.5%, odds ratio = 1.79, 95% confidence interval = 1.15–2.79). This response rate increase of 11.1% (95% confidence interval = 2.8–19.1) occurred in both intervention and control groups in the host randomized controlled trial. The incentive was also effective in increasing questionnaire commencement (84.6% vs 75.9%, odds ratio = 1.74, 95% confidence interval = 1.07–2.84) and reducing the delay in completing the questionnaire (19.9 vs 22.6 days, hazard ratio = 1.34, 95% confidence interval = 1.07–1.67). Conclusion This study adds to evidence for the effectiveness of incentives to increase response rates to follow-up questionnaires in health intervention trials.


Blood ◽  
2004 ◽  
Vol 104 (11) ◽  
pp. 5294-5294
Author(s):  
Dharma R. Choudhary ◽  
Rajat Kumar ◽  
R. Saxena ◽  
Manoranjan Mahapatra ◽  
Atul Kotwal ◽  
...  

Abstract Background: There is very little published epidemiological data from developing countries regarding ITP and no large series from India. The aim of the study was to analyze the presenting features, response to different therapeutic options and suggest cost effective therapy. Method: The records of hematology department of All India Institute Of Medical Science were analyzed from January 1992 to June 2004. This is a premium tertiary care hospital in India. Diagnosis of ITP was made according to the standard criteria. Response criteria: complete response was defined as a platelet count increase to 100x109 /l or more, for at least 2 months: partial response was defined as doubling of platelet counts from initial levels and > 50x 109/l for at least 2 months; no response included none of the above. Statistical methods: Database was created in MS Access and SPSS ver 11 was used for statistical analysis. Descriptive statistics were calculated and appropriate tests of significance like Chi Square, repeated measure linear model were carried out. Results: During the study period, 1230 patients of ITP were seen in hematology department, with a median age of 19.6 years (range 0.9–80). Females were 51.1% and males 48.9%. Median follow-up was of 9 months (range 0–178). Presenting features were: skin bleed − 91.1%; mucosal bleed − 57.5%; hematuria − 7.2%; gastrointestinal bleed − 12.5% and intracraniall bleed − 2.8%. Per-vaginal bleeding − 31.2 % of females. History of preceding viral fever was seen in 13.1% and palpable spleen in 2.5%. The mean platelet counts at presentation were 34+ 18.3x109/l. There were 595 (48.4%) patients of acute ITP and 635 (51.6%) patients of chronic ITP. Childhood ITP (age ≤ 12 yr) was seen in 46.5% and adult ITP in 53.5%. Response to therapy: Prednisolone was given to 99.6% patients with response of 57.3 %; Intravenous gamma globulin was given to 8.9% with response in 63.6%. Splenectomy was performed in 5% of acute ITP and 15.1% of chronic ITP (p = 0.00). The overall number of splenectomies was 126, with a response rate of 83.3%. Of these 126, acute ITP constituted 23.8% while chronic ITP formed 76.2% of cases. There was no statistically significant difference in response rate in these two groups (p =0.575). Danazole was given to 66 patients with response in 44%. Various other modalities of treatment were given to 24 patients (Anti D-14; Dapsone-2; Cyclosporin-2; Azathioprine-5; and Vincristine with Cyclophosphamide -1 patient), with a response in 25% of patients. The overall response rate with all treatment modalities was 68%: in childhood ITP − 65% and in adult ITP − 70.5%. Childhood ITP did not respond as expected, possibly due to referral bias of more refractory cases being referred to the center. The values of platelets showed a continuous increase during follow up and this increase was statistically significant (P=0.000 for all, Repeated measure model). Conclusion: Pattern of ITP in India is similar to that seen in other centers. In this study Prednisolone was given as first line agent to almost all patients with response in 57.3%; Splenectomy were done in 10.2% of prednisolone refractory or dependent patients with a response in 83.3%. These should form the primary modalities of therapy in developing countries. Significant numbers of patients were refractory to above-mentioned modalities and thus there is a requirement for other cost-effective therapies.


Blood ◽  
2018 ◽  
Vol 132 (Supplement 1) ◽  
pp. 3301-3301
Author(s):  
Natalia Paola Schutz ◽  
Paola Ochoa ◽  
Patricio Duarte ◽  
Guillermina Remaggi ◽  
Sebastian Yantorno ◽  
...  

Abstract Introduction: There are scarce data regarding treatment outcomes and toxicity in Latin American countries. Argentina is the second largest country in the region and the fourth most populated one. National Guidelines from the Argentinean Society of Hematology (SAH) recommends the use of bortezomib based triplets for induction treatment in transplant eligible newly diagnosed Multiple Myeloma patients. Objective: To compare response rates and adverse events after induction treatment with Cyclophosphamide Bortezomib and Dexamethasone (CyBorD) or Bortezomib Thalidomide and Dexamethasone (VTD) outside of clinical trials in a Latin American country. Methods: Retrospective multicentric cohort study. All centers participating in the Argentinean Multiple Myeloma Study Group (GAMM) were invited to participate in the study. Eligible patients were 75 years of age or younger, with a diagnosis of Multiple Myeloma according to the IMWG 2014 criteria, transplant eligible, treated with at least one cycle of CyBorD or VTD as induction therapy in the time period from December 2012 until December 2017. Main exclusion criteria were amyloidosis, plasma cell leukemia and previous neuropathy. Patients were identified from local registries at each center and included consecutively in the study database. Epidemiological and clinical data were obtained from medical records and collected in a standardized clinical report form. Patients were followed from diagnosis until death or lost to follow up. Response was evaluated according to IMWG Response Criteria 2016. Adverse events were graded by CTCAE 4.3. Comparisons of response rates were performed using a Chi2 test and differences in rates were expressed as proportions with 95% confidence intervals (CI). Crude odds ratios (OR) and OR adjusted by potential confounders were calculated using a logistic regression model. Kaplan Meier method was used to estimate progression free survival (PFS) and overall survival (OS). Stata 13 software was used. Results: A total of 322 patients from 15 centers in Argentina were included in the study. The median age at diagnosis was 57 years (range 26-74), 52% (167) of the patients were male, 18% (58) had renal failure, 28% (85) ISS 3 , 7% (22) extramedullary disease, and 14% (46) high risk cytogenetics. Median time of follow up was 34 months (IQR 21-58). CyBorD was the most common treatment, indicated as induction therapy in 74% (238) of the cases. The characteristics of the patients were similar in both groups except age and LDH levels. The median number of cycles was 5 (range 1-12). Bortezomib was administered once per week in 85% (272) of the patients and subcutaneously in 86% (276) with no differences between both treatment arms. The median cumulative cyclophosphamide dose per month was 1.5 g (IQR 1.5-2.4) and thalidomide dose per day was 100 mg. In the VTD arm, 72,62% (61) of the patients achieved at least very good partial response (VGPR) vs 53.36% (127) with CyBorD [OR of 2.31 (CI 1.35 - 3.99) p=0.002]. The difference in VGPR was 19.26% (CI 15 - 24). Complete response rate (CR) was 35.92% in patients treated with VTD vs 22.55% with CyBorD [OR of 1.87 (CI 1.04 - 3.35) p=0.03). The difference in CR was 13,37% (CI 9.6 -17.53). There was no difference in overall response rate (ORR) with 94.05% vs 91.18% (p=0.406). Adverse events were more common with VTD (69.05% vs 55.46% p=0.030), especially neuropathy grade 3 - 4 (7.14% vs 1.26% p=0.005) and thrombosis (13.10 % vs 3.36 % p=0.001). Deep venous thrombosis prophylaxis was inadequate in 20.24% of the patients. Hematologic adverse events were more common with CyBorD, especially thrombocytopenia (5.95% vs 16.39% p=0.017). Autologous stem cell transplantation (ASCT) was performed in 78% (249) of patients. There was 5% (17) stem cell mobilization failure, all in the CyBorD arm. Response rates after ASCT with VTD and CyBorD induction treatment were: 76.19 vs 73.11% VGPR (p=0.580) and 48.53% vs 40% CR (p=0.20). Maintenance treatment was indicated in 67.86% (57) and 65.13% (155) patients respectively (p=0.650). The PFS at 24 months was 83% (CI 71-90) with VTD vs 72% (CI 66-78) [(HR 0.92 (CI 0.59 - 1.42) p 0.715] and OS 96% (CI 87-99) vs 91% (86-94) respectively [(HR 1.2 (CI 0.62 - 2.32) p 0.587]. Conclusions: VTD has better CR and VGPR compared to CyBorD. Nevertheless, CyBorD continues to be the preferred induction regimen in Argentina based on safety profile. The optimal number of induction treatment cycles remains to be determined. Disclosures Schutz: Takeda: Honoraria, Research Funding; Sanofi Aventis: Research Funding; Roche: Research Funding; Glaxo: Research Funding; Janssen: Honoraria, Research Funding; Varifarma: Honoraria. Shanley:Brystol Myers Squibb: Consultancy, Honoraria; Takeda: Consultancy, Honoraria. Fantl:Janssen: Consultancy, Honoraria, Research Funding; Varifarma/Amgen: Consultancy, Honoraria; Takeda: Consultancy, Honoraria, Research Funding; Sanofi: Research Funding; Roche: Research Funding; Tecnofarma: Honoraria; BMS: Consultancy, Honoraria; Glaxo: Research Funding.


2010 ◽  
Vol 92 (3) ◽  
pp. 236-239 ◽  
Author(s):  
Rhidian Jones ◽  
Sadie Burdett ◽  
Matthew Jefferies ◽  
Abhijit R Guha

INTRODUCTION There is no standardised treatment for fifth metacarpal neck fractures. Treatment of this common fracture can vary from immediate mobilisation to immobilisation in a plaster cast for 3 weeks. There is no literature identifying current practice amongst surgeons. SUBJECTS AND METHODS This survey's aim was to reveal current practice in Wales by means of a postal questionnaire sent to all Welsh orthopaedic consultants. RESULTS The questionnaire had a 60% response rate. Results demonstrated varied opinion regarding the degree of displacement warranting reduction. Overall, 10% of surgeons reduce the fracture at 30° of displacement, 29% at 40°, 18% at 50° and 20% at 60° of displacement. The treatment was also very varied. Most surgeons preferred to treat these fractures with neighbour strapping (43%,) while others preferred plaster immobilisation (39%) or immediate mobilisation (10%.) Only 22% of surgeons discharge these patients back to the community after their first visit to out-patients while 13% offer two follow-up appointments. CONCLUSIONS The treatment being offered for this common fracture in Wales is inconsistent. There is a need to develop evidence- based best practice guidelines which should standardise the treatment of this common injury. Perhaps, a large multicentre outcome study may enable this to be drawn up in the future.


Field Methods ◽  
2022 ◽  
pp. 1525822X2110696
Author(s):  
Philip S. Brenner ◽  
Trent D. Buskirk

We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive types (prepaid cash, prepaid giftcodes, and conditional giftcodes). Invitations were sent to a sample of 17,808 addresses in Boston, Massachusetts, recruiting for a new online panel study of city residents. We report response rates and costs for each condition. Findings suggest that letters achieve higher response rates than postcards and are more cost effective overall. We also find that conditional incentives achieve higher response rates and are more cost effective, although conflating factors do not permit clear inferences. Notably, the novel scratch-off postcard condition achieved the lowest response rate and the highest costs per completed survey.


2017 ◽  
Vol 5 ◽  
Author(s):  
H. Goei ◽  
B. F. M. Wijnen ◽  
S. Mans ◽  
M. A. C. de Jongh ◽  
C. H. van der Vlies ◽  
...  

Abstract Background Data on epidemiology, costs, and outcomes of burn-related injuries presenting at emergency departments (EDs) are scarce. To obtain such information, a questionnaire study with an adequate response rate is imperative. There is evidence that optimized strategies can increase patient participation. However, it is unclear whether this applies to burn patients in an ED setting. The objective of this feasibility study was to optimize and evaluate patient recruitment strategy and follow-up methods in patients with burn injuries presenting at EDs. Methods In a prospective cohort study with a 6-month follow-up, patients with burn-related injuries attending two large EDs during a 3-month study period were included. Eligible patients were quasi-randomly allocated to a standard or optimized recruitment strategy by week of the ED visit. The standard recruitment strategy consisted of an invitation letter to participate, an informed consent form, a questionnaire, and a franked return envelope. The optimized recruitment strategy was complemented by a stamped returned envelope, monetary incentive, sending a second copy of the questionnaire, and a reminder by telephone in non-responders. Response rates were calculated, and questionnaires were used to assess treatment, costs, and health-related quality of life. Results A total of 87 patients were included of which 85 were eligible for the follow-up study. There was a higher response rate at 2 months in the optimized versus the standard recruitment strategy (43.6% vs. 20.0%; OR = 3.1 (95% CI 1.1–8.8)), although overall response is low. Non-response analyses showed no significant differences in patient, burn injury or treatment characteristics between responders versus non-responders. Conclusions This study demonstrated that response rates can be increased with an optimized, but more labor-intensive recruitment strategy, although further optimization of recruitment and follow-up is needed. It is feasible to assess epidemiology, treatment, and costs after burn-related ED contacts.


2020 ◽  
Vol 9 (1) ◽  
Author(s):  
Adel Elfeky ◽  
Katie Gillies ◽  
Heidi Gardner ◽  
Cynthia Fraser ◽  
Timothy Ishaku ◽  
...  

Abstract Background Retention of participants is essential to ensure the statistical power and internal validity of clinical trials. Poor participant retention reduces power and can bias the estimates of intervention effect. There is sparse evidence from randomised comparisons of effective strategies to retain participants in randomised trials. Currently, non-randomised evaluations of trial retention interventions embedded in host clinical trials are rejected from the Cochrane review of strategies to improve retention because it only included randomised evaluations. However, the systematic assessment of non-randomised evaluations may inform trialists’ decision-making about retention methods that have been evaluated in a trial context.Therefore, we performed a systematic review to synthesise evidence from non-randomised evaluations of retention strategies in order to supplement existing randomised trial evidence. Methods We searched MEDLINE, EMBASE, and Cochrane CENTRAL from 2007 to October 2017. Two reviewers independently screened abstracts and full-text articles for non-randomised studies that compared two or more strategies to increase participant retention in randomised trials. The retention trials had to be nested in real ‘host’ trials ( including feasibility studies) but not hypothetical trials. Two investigators independently rated the risk of bias of included studies using the ROBINS-I tool and determined the certainty of evidence using GRADE (Grading of Recommendations Assessment, Development and Evaluation) framework. Results Fourteen non-randomised studies of retention were included in this review. Most retention strategies (in 10 studies) aimed to increase questionnaire response rate. Favourable strategies for increasing questionnaire response rate were telephone follow-up compared to postal questionnaire completion, online questionnaire follow-up compared to postal questionnaire, shortened version of questionnaires versus longer questionnaires, electronically transferred monetary incentives compared to cash incentives, cash compared with no incentive and reminders to non-responders (telephone or text messaging). However, each retention strategy was evaluated in a single observational study. This, together with risk of bias concerns, meant that the overall GRADE certainty was low or very low for all included studies. Conclusions This systematic review provides low or very low certainty evidence on the effectiveness of retention strategies evaluated in non-randomised studies. Some strategies need further evaluation to provide confidence around the size and direction of the underlying effect.


2019 ◽  
Vol 41 (2) ◽  
pp. 277-296 ◽  
Author(s):  
Chris L. S. Coryn ◽  
Lyssa W. Becho ◽  
Carl D. Westine ◽  
Pedro F. Mateu ◽  
Ruqayyah N. Abu-Obaid ◽  
...  

Internet surveys of American Evaluation Association (AEA) members are a common method for studying evaluation practice. Response rates obtained from Internet surveys of AEA members are, however, frequently very small. To investigate whether or not material incentives increase response rates to Internet surveys of AEA members, a between-subjects three-treatment and one control randomized experiment in which a randomly selected sample of AEA members were randomly assigned to a no-incentive control condition, lottery condition, token incentive condition, or philanthropic donation incentive condition was utilized. The overall response rate to the survey was 39.66% and the response rates for each of the four conditions were control = 36.24%, lottery = 44.39%, token incentive = 43.28%, and philanthropic donation = 34.67%, respectively. The cost-effectiveness of each of the four conditions also was examined, demonstrating that the lottery was the most cost-effective. Other factors potentially influencing response or nonresponse decisions also are discussed.


Sign in / Sign up

Export Citation Format

Share Document