scholarly journals Effect of Recruitment Methods on Response Rate in a Web-Based Study for Primary Care Physicians: Factorial Randomized Controlled Trial (Preprint)

2017 ◽  
Author(s):  
Ryuhei So ◽  
Kiyomi Shinohara ◽  
Takuya Aoki ◽  
Yasushi Tsujimoto ◽  
Aya M Suganuma ◽  
...  

BACKGROUND Low participation rates are one of the most serious disadvantages of Web-based studies. It is necessary to develop effective strategies to improve participation rates to obtain sufficient data. OBJECTIVE The objective of this trial was to investigate the effect of emphasizing the incentive in the subject line of the invitation email and the day of the week of sending the invitation email on the participation rate in a Web-based trial. METHODS We conducted a 2×2 factorial design randomized controlled trial. We contacted 2000 primary care physicians from members of the Japan Primary Care Association in January 2017 and randomly allocated them to 1 of 4 combinations of 2 subject lines (presence or absence of an emphasis on a lottery for an Amazon gift card worth 3000 yen or approximately US $30) and 2 delivery days (sending the invitation email on Tuesday or Friday). The primary outcome was the response rate defined as the number of participants answering the first page of the questionnaire divided by the number of invitation emails delivered. All outcomes were collected between January 17, 2017, and February 8, 2017. RESULTS We analyzed data from 1943 out of 2000 participants after excluding those whose email addresses were invalid. The overall response rate was 6.3% (123/1943). There was no significant difference in the response rates between the 2 groups regarding incentive in the subject line: the risk ratio was 1.12 (95% CI 0.80 to 1.58) and the risk difference was 0.7% (95% CI –1.5% to 2.9%). Similarly, there was no significant difference in the response rates between the 2 groups regarding sending the email on Tuesday or Friday: the risk ratio was 0.98 (95% CI 0.70 to 1.38) and the risk difference was –0.1% (95% CI –2.3% to 2.1%). CONCLUSIONS Neither emphasizing the incentive in the subject line of the invitation email nor varying the day of the week the invitation email was sent led to a meaningful increase in response rates in a Web-based trial with primary care physicians. CLINICALTRIAL University Hospital Medical Information Network Clinical Trials Registry UMIN000025317; https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000029121 (Archived by WebCite at http://www.webcitation. org/6wOo1jl9t)

2018 ◽  
Vol 64 (3) ◽  
pp. 272-280 ◽  
Author(s):  
Nuno Basílio ◽  
Sara Cardoso ◽  
José Mendes Nunes ◽  
Liliana Laranjo ◽  
Maria da Luz Antunes ◽  
...  

Summary Introduction: Surveys are a useful tool in primary care. However, low response rates can introduce selection bias, impairing both external and internal validity. The aim of this study was to assess the average response rate in surveys with Portuguese general practitioners (GPs). Method: We searched the Medline, Web of Science, Scopus, Embase, PsychInfo, SciELO, IndexRMP, RCAAP, Revista Portuguesa de Medicina Geral e Familiar, Acta Médica Portuguesa and the proceedings of conferences of general practice from incepton to December 2016. We included all postal, e-mail, telephone and personal surveys to primary care physicians without language restrictions. We did not assess risk of bias of included studies, since the main outcome was survey response rate. We performed planned subgroup analyses of the use of monetary incentives, the use of non-monetary incentives, survey delivery modes and prior contact with participants. Results: A total of 1,094 papers were identified and 37 studies were included in this review. The response rate in surveys done to Portuguese GPs was 56% (95CI 47-64%). There was substantial heterogeneity among included studies (I2=99%), but subgroup analysis did not explain this heterogeneity. Conclusion: Consistent with other published studies, the average response rate in surveys done with Portuguese GPs was 56%, with substantial variation among studies. Use of monetary incentives, one of the most effective strategies to increase response rates, was not present in any of the included studies.


BMJ Open ◽  
2017 ◽  
Vol 7 (12) ◽  
pp. e018355 ◽  
Author(s):  
Kiyomi Shinohara ◽  
Takuya Aoki ◽  
Ryuhei So ◽  
Yasushi Tsujimoto ◽  
Aya M Suganuma ◽  
...  

ObjectivesTo investigate whether overstatements in abstract conclusions influence primary care physicians’ evaluations when they read reports of randomised controlled trials (RCTs)DesignRCT setting: This study was a parallel-group randomised controlled survey, conducted online while masking the study hypothesis.ParticipantsVolunteers were recruited from members of the Japan Primary Care Association in January 2017. We sent email invitations to 7040 primary care physicians. Among the 787 individuals who accessed the website, 622 were eligible and automatically randomised into ‘without overstatement’ (n=307) and ‘with overstatement’ (n=315) groups.InterventionsWe selected five abstracts from published RCTs with at least one non-significant primary outcome and overstatement in the abstract conclusion. To construct a version without overstatement, we rewrote the conclusion sections. The methods and results sections were standardised to provide the necessary information of primary outcome information when it was missing in the original abstract. Participants were randomly assigned to read an abstract either with or without overstatements and asked to evaluate the benefit of the intervention.Outcome measuresThe primary outcome was the participants’ evaluation of the benefit of the intervention discussed in the abstract, on a scale from 0 to 10. A secondary outcome was the validity of the conclusion.ResultsThere was no significant difference between the groups with respect to their evaluation of the benefit of the intervention (mean difference: 0.07, 95% CI −0.28 to 0.42, p=0.69). Participants in the ‘without’ group considered the study conclusion to be more valid than those in the ‘with’ group (mean difference: 0.97, 95% CI 0.59 to 1.36, P<0.001).ConclusionThe overstatements in abstract conclusions did not significantly influence the primary care physicians’ evaluations of the intervention effect when necessary information about the primary outcomes was distinctly reported.Trial registration numberUMIN000025317; Pre-results.


1996 ◽  
Vol 14 (7) ◽  
pp. 2083-2090 ◽  
Author(s):  
J J Rusthoven ◽  
I C Quirt ◽  
N A Iscoe ◽  
P B McCulloch ◽  
K W James ◽  
...  

PURPOSE We designed and conducted a randomized, double-blind, placebo-controlled trial to compare the response rates and survival of patients with metastatic melanoma who received carmustine (BCNU), dacarbazine (DTIC), and cisplatin with tamoxifen, or the same chemotherapy with placebo. PATIENTS AND METHODS Eligible patients with metastatic melanoma received either BCNU 150 mg/m2 intravenously (i.v.) on day 1, DTIC 220 mg/m2 i.v. daily on days 1 to 3 and on days 22 to 24, and cisplatin 25 mg/m2 i.v. daily on days 1 to 3 and on days 22 to 24 with placebo every 6 weeks, or the same chemotherapy with tamoxifen 160 mg orally daily for 7 days before chemotherapy and 40 mg orally daily throughout the remainder of the treatment cycle. Patients were treated on protocol for up to three cycles depending on the type of response. Assuming that a minimum increase in response rate of 20% would be necessary to conclude that tamoxifen conferred a clinically important benefit, we designed the study with an 80% chance of detecting that difference at the 5% level (two-sided). RESULTS Between February 1992 and January 1995, 211 patients were accrued, 199 of whom were considered assessable for response and toxicity. The overall response rate was 21% in the placebo group and 30% in the tamoxifen group (P = .187). Complete and partial responses were 3% and 27%, respectively, for the tamoxifen group and 6% and 14%, respectively, for the placebo group. Poor performance status and liver involvement were associated with a reduced likelihood to respond to treatment. Major toxicities were similar in both groups with no statistically significant difference in the rates of deep vein thrombosis, pulmonary thromboembolus, grade 4 neutropenia, or grade 4 thrombocytopenia. CONCLUSION These results demonstrate that the addition of high doses of tamoxifen to this chemotherapy regimen does not increase the response rate compared with chemotherapy alone in unselected patients with metastatic melanoma.


2014 ◽  
Vol 9 (1) ◽  
pp. 4 ◽  
Author(s):  
Robert Janke

Objective – This study examined the effects that mentioning the survey incentive prize in the subject line of a reminder email had on the response rate and data quality. To date, manipulation of the subject line, specifically in terms of mentioning the incentive prize, has received limited attention in the survey design literature. Methods – The delivery of the survey invitation is discussed in terms of the timing of the launch and reminder emails. Particular emphasis is given to the design of the email subject line and justification of the format. Weekly response rates from four LibQUAL+TM surveys were compared. In addition, weekly responses for one year were analyzed using SPSS to investigate if there were any between means differences in terms of three elements of data quality. The three elements were: length of time it took to complete the survey, the number of core questions with an N/A response, and the number of illogical responses where minimum scores were higher than desired. Results – The response rates for the second week were grouped together based on the presence or absence of the subject line manipulation. There was a significant difference between these means (4.75%, p 0.033). There was no statistical difference in regards to the measures of data quality as determined by a one-way ANOVA test. Conclusions – Reminding survey participants with an email that mentions the incentive prize in the subject line appears to increase response rates with no deleterious effects on data quality. The results of this investigation are encouraging, and those running the LibQUAL+TM survey in their universities should consider implementing this method to increase response rates. Further research to replicate these findings in other contexts and using an experimental design would be beneficial.


Diabetes Care ◽  
2003 ◽  
Vol 26 (3) ◽  
pp. 750-757 ◽  
Author(s):  
J. B. Meigs ◽  
E. Cagliero ◽  
A. Dubey ◽  
P. Murphy-Sheehy ◽  
C. Gildesgame ◽  
...  

2020 ◽  
Author(s):  
Ryan Trevor Titus Rego ◽  
Samuel Watson ◽  
Philbert Ishengoma ◽  
Philemon Langat ◽  
Hezekiah Pireh Otieno ◽  
...  

Abstract Background Text messaging systems are used to collect data on symptom prevalence. Using a text messaging system, we evaluated the effects of question load, question frequency, and financial incentive on response rates and reported infant diarrhoea rates in an infant diarrhoea survey. Methods We performed a factorial cross-over randomised controlled trial of an SMS surveying system for infant diarrhoea surveillance with treatments: financial incentive (yes/no), question load (1-question/3-question), and questioning frequency (daily/fortnightly). Participants progressed through all treatment combinations over eight two-week rounds. Data were analysed using multivariable logistic regressions to determine the impacts of the treatments on the response rates and reported diarrhoea rates. Attitudes were explored through qualitative interviews. Results For the 141 participants, the mean response rate was 47%. In terms of percentage point differences (ppd), daily questioning was associated with a lower response rate than fortnightly (-1·2[95%CI:-4·9,2·5]); high (3-question) question loads were associated with a lower response rate than low (1-question) question loads (-7·0[95%CI:-10·8,-3·1]); and financial incentivisation was associated with a higher response rate than no financial incentivisation (6·4[95%CI:2·6,10·2]). The mean two-week diarrhoea rate was 36·4%. Daily questioning was associated with a higher reported diarrhoea rate than fortnightly (29·9[95%CI:22·8,36·9]); with little evidence for impact by incentivisation or question load. Conclusions Close to half of all participants responded to the SMS survey. Daily questioning evoked a statistically higher rate of reported diarrhoea, while financial incentivisation and low (1-question) question loads evoked higher response rates than no incentive and high (3-question) question loads respectively. Trial Registration The protocol was registered on ISRCTN on the 20 th of March 2019 under number ISRCTN11410773 .


PRiMER ◽  
2019 ◽  
Vol 3 ◽  
Author(s):  
Maribeth P. Williams ◽  
Denny Fe Agana ◽  
Benjamin J. Rooks ◽  
Grant Harrell ◽  
Rosemary A. Klassen ◽  
...  

Introduction: With the estimated future shortage of primary care physicians there is a need to recruit more medical students into family medicine. Longitudinal programs or primary care tracks in medical schools have been shown to successfully recruit students into primary care. The aim of this study was to examine the characteristics of primary care tracks in departments of family medicine.  Methods: Data were collected as part of the 2016 CERA Family Medicine Clerkship Director Survey. The survey included questions regarding the presence and description of available primary care tracks as well as the clerkship director’s perception of impact. The survey was distributed via email to 125 US and 16 Canadian family medicine clerkship directors.  Results: The response rate was 86%. Thirty-five respondents (29%) reported offering a longitudinal primary care track. The majority of tracks select students on a competitive basis, are directed by family medicine educators, and include a wide variety of activities. Longitudinal experience in primary care ambulatory settings and primary care faculty mentorship were the most common activities. Almost 70% of clerkship directors believe there is a positive impact on students entering primary care.  Conclusions: The current tracks are diverse in what they offer and could be tailored to the missions of individual medical schools. The majority of clerkship directors reported that they do have a positive impact on students entering primary care.


2017 ◽  
Vol 14 (4) ◽  
pp. 381-386 ◽  
Author(s):  
Amy J Morgan ◽  
Ronald M Rapee ◽  
Jordana K Bayer

Background/aims Achieving a high response rate to follow-up questionnaires in randomized controlled trials of interventions is important for study validity. Few studies have tested the value of incentives in increasing response rates to online questionnaires in clinical trials of health interventions. This study evaluated the effect of a gift card prize-draw incentive on response rates to follow-up questionnaires within a trial of an online health intervention. Method The study was embedded in a host randomized controlled trial of an online parenting program for child anxiety. A total of 433 participants were randomly allocated to one of two groups: (1) being informed that they would enter a gift card prize-draw if they completed the final study questionnaire (24-week follow-up) and (2) not informed about the prize-draw. All participants had a 1 in 20 chance of winning an AUD50 gift card after they completed the online questionnaire. Results The odds of the informed group completing the follow-up questionnaire were significantly higher than the uninformed group, (79.6% vs 68.5%, odds ratio = 1.79, 95% confidence interval = 1.15–2.79). This response rate increase of 11.1% (95% confidence interval = 2.8–19.1) occurred in both intervention and control groups in the host randomized controlled trial. The incentive was also effective in increasing questionnaire commencement (84.6% vs 75.9%, odds ratio = 1.74, 95% confidence interval = 1.07–2.84) and reducing the delay in completing the questionnaire (19.9 vs 22.6 days, hazard ratio = 1.34, 95% confidence interval = 1.07–1.67). Conclusion This study adds to evidence for the effectiveness of incentives to increase response rates to follow-up questionnaires in health intervention trials.


Sign in / Sign up

Export Citation Format

Share Document