scholarly journals Web mode as part of mixed-mode surveys of the general population

2015 ◽  
Vol 12 (2) ◽  
Author(s):  
Nejc Berzelak ◽  
Vasja Vehovar ◽  
Katja Lozar Manfreda
Keyword(s):  
General Population ◽  
Mixed Mode ◽  
Response Rate ◽  
Cost Savings ◽  
Response Rates ◽  
Web Surveys ◽  
Face To Face ◽  
Survey Modes ◽  
Survey Designs ◽  
The Web

Lower data collection costs make web surveys a promising alternative to conventional face-to-face and telephone surveys. A transition to the new mode has already been widely initiated in commercial research, but web surveys remains limited in academic and official research projects that typically require probability samples and high response rates. Various design approaches for coping with the problems of sampling frames, incomplete Internet use, and nonresponse in web surveys have been proposed. Mixed-mode designs and incentives are two common strategies to reach Internet non-users and increase the response rates in web surveys. However, such survey designs can substantially increase the costs, the complexity of administration and the possibility of uncontrolled measurement effects. This paper presents and demonstrates an approach to the evaluation of various survey designs with simultaneous consideration of the errors and costs. It focuses on the designs involving the web mode and discusses their potential to replace traditional modes for probability surveys of the general population. The main idea of this approach is that part of the cost savings enabled by the web mode can be allocated to incentives and complementary survey modes to compensate for the Internet non-coverage and the higher nonresponse. The described approach is demonstrated in an experimental case study that compares the performance of mixed-mode designs with the web mode and prepaid cash incentive with that of an official survey conducted using the face-to-face and telephone modes. The results show that the mixed-mode designs with the web mode and incentives can greatly increase the response rate, which even surpasses that of the conventional survey modes, but still offer substantial cost savings. However, the results also show that higher response rate does not necessary translate to higher data quality, especially when the main aim is to obtain estimates that are highly comparable with those of the reference survey.

scholarly journals Web Versus Other Survey Modes: An Updated and Extended Meta-Analysis Comparing Response Rates

2019 ◽  
Vol 8 (3) ◽  
pp. 513-539 ◽  
Author(s):  
Jessica Daikeler ◽  
Michael Bošnjak ◽  
Katja Lozar Manfreda
Keyword(s):  
Survey Methodology ◽  
Response Rate ◽  
Meta Analysis ◽  
Response Rates ◽  
Recruitment Strategy ◽  
Web Surveys ◽  
Lower Response ◽  
Percentage Points ◽  
Survey Modes ◽  
Experimental Comparisons

Abstract Do web surveys still yield lower response rates compared with other survey modes? To answer this question, we replicated and extended a meta-analysis done in 2008 which found that, based on 45 experimental comparisons, web surveys had an 11 percentage points lower response rate compared with other survey modes. Fundamental changes in internet accessibility and use since the publication of the original meta-analysis would suggest that people’s propensity to participate in web surveys has changed considerably in the meantime. However, in our replication and extension study, which comprised 114 experimental comparisons between web and other survey modes, we found almost no change: web surveys still yielded lower response rates than other modes (a difference of 12 percentage points in response rates). Furthermore, we found that prenotifications, the sample recruitment strategy, the survey’s solicitation mode, the type of target population, the number of contact attempts, and the country in which the survey was conducted moderated the magnitude of the response rate differences. These findings have substantial implications for web survey methodology and operations.

scholarly journals The effect of a web-push survey on physician survey response rates: a randomized experiment.

2019 ◽  
Author(s):  
Cristine D. Delnevo ◽  
Binu Singh
Keyword(s):  
Survey Methodology ◽  
Response Rate ◽  
Mail Survey ◽  
Cost Effective ◽  
Response Rates ◽  
National Sample ◽  
High Response Rate ◽  
Future Research ◽  
Effective Delivery ◽  
The Web

Abstract Background: Achieving a high response rate for physicians has been challenging and with response rates declining in recent years, innovative methods are needed to increase rates. An emerging concept in survey methodology has been web-push survey delivery. In this delivery method, contact is made by mail to request a response by web. This study explored the feasibility of a web-push survey on a national sample of physicians. Methods: 1000 physicians across six specialties were randomly assigned to a mail only or web-push survey delivery. Each mode consisted of four contacts including an initial mailing, reminder postcard, and two additional follow-ups. Response rates were calculated using AAPOR’s response rate 3 calculation. Data collection occurred between Febuary – April 2018 and analyzed March 2019. Results: Overall reponse rates for the mail only vs. web-push survey delivery were comparable (51.2% vs. 52.8%). Higher response rates across all demographics were seen in the web-push delivery with the exception of pulmonary/critical care and physicians over the age of 65. The web-push survey yielded a greater response after the first mailing requiring fewer follow-up contacts resulting in a more cost-effective delivery. Conclusions: A web-push mail survey is effective in achieveing a comparable response rate to traditional mail only delivery for physicians. The web-push survey was more efficient in terms of cost and in receiving responses in a more timely manner. Future research should explore the efficiency of a web-push survey delivery across various health care provider populations.

scholarly journals What’s the Benefit of a Video? The Effect of Nonmaterial Incentives on Response Rate and Bias in Web Surveys

2020 ◽  
pp. 089443932091831 ◽  
Author(s):  
Fabian Kalleitner ◽  
Monika Mühlböck ◽  
Bernhard Kittel
Keyword(s):  
Employment Status ◽  
Response Rate ◽  
Response Rates ◽  
Situation Analysis ◽  
Web Surveys ◽  
Additional Information ◽  
Survey Participation ◽  
Gender And Migration ◽  
Technological Developments ◽  
And Migration

Traditional survey research faces declining response rates due to changing cultural habits and technological developments. Researchers have developed novel approaches to increase respondents’ likelihood of participating in web surveys. However, we lack information about whether these methods indeed increase response rates and, if so, whether they bias the resulting data. This article focuses on the use of nonmaterial incentives in the form of a video that provides the invitees with information tailored to their life situation. Analysis of our experimental data shows that instead of increasing respondents’ probability of starting the survey, the video treatments actually decrease it. We provide evidence that the lower salience of the intrinsic benefits of survey participation in the invitation email significantly contributes to this reduction. Additionally, the effect of the nonmaterial incentive differs across subgroups, affecting nonresponse biases in line with employment status, gender, and migration background. We therefore conclude that using additional information in the form of a video as a nonmaterial survey incentive is only suitable under specific conditions.

scholarly journals Self-reported data in environmental health studies: mail vs. web-based surveys

2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Manuella Lech Cantuaria ◽  
Victoria Blanes-Vidal
Keyword(s):  
Mixed Mode ◽  
Demographic Characteristics ◽  
Environmental Stressors ◽  
Web Surveys ◽  
Negative Attitudes ◽  
Web Based ◽  
Health Symptoms ◽  
Survey Modes ◽  
Reminder Letters ◽  
The Impact

Abstract Background Internet has been broadly employed as a facilitator for epidemiological surveys, as a way to provide a more economical and practical alternative to traditional survey modes. A current trend in survey research is to combine Web-based surveys with other survey modes by offering the participant the possibility of choosing his/her preferred response method (i.e. mixed-mode approach). However, studies have also demonstrated that the use of different survey modes may produce different responses to the same questions, posing potential challenges on the use of mixed-mode approaches. Methods In this paper, we have implemented a statistical comparison between mixed-mode survey responses collected via mail (i.e. paper) and Web methods obtained from a cross-sectional study in non-urban areas of Denmark. Responses provided by mail and Web participants were compared in terms of: 1) the impact of reminder letters in increasing response rates; 2) differences in socio-demographic characteristics between response groups; 3) changes on the likelihood of reporting health symptoms and negative attitudes towards environmental stressors. Comparisons were mainly performed by two sample t-test, Pearson’s Chi-squared test and multinomial logistic regression models. Results Among 3104 contacted households, 1066 residents decided to participate on the study. Out of those, 971 selected to respond via mail, whereas 275 preferred the Web method. The majority of socio-demographic characteristics between these two groups of respondents were shown to be statistically different. The use of mailed surveys increased the likelihood of reporting health symptoms and negative attitudes towards environmental stressors, even after controlling for demographic characteristics. Furthermore, the use of reminder letters had a higher positive impact in increasing responses of Web surveys when compared to mail surveys. Conclusions Our main findings suggest that the use of mail and Web surveys may produce different responses to the same questions posed to participants, but, at the same time, may reach different groups of respondents, given that the overall characteristics of both groups considerably differ. Therefore, the tradeoff between using mixed-mode survey as a way to increase response rate and obtaining undesirable measurement changes may be attentively considered in future survey studies.

scholarly journals The factors affecting response rate in survey on well-being among people with foreign origin

2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
E Lilja ◽  
A Seppänen ◽  
H Kuusio
Keyword(s):  
Online Survey ◽  
Response Rate ◽  
Age Groups ◽  
Response Rates ◽  
Well Being ◽  
Migrant Population ◽  
Population Surveys ◽  
Cross Sectional ◽  
Factors Affecting ◽  
Face To Face

Abstract Background Previous population surveys among people with foreign background (PFB) in Finland have had successful response rates (62%-66%) when using mainly face-to-face interviews. A cross-sectional population survey (FinMONIK) explored more cost-efficient ways to collect the data on PFB. Methods The data collection was conducted in Finland between May 2018 and January 2019. The random sample consisted of 12 877 (after removing over-coverage) 18-64-year-olds stratified by region. First, a letter containing a link to the online survey with 18 different language options was sent to the participants. After two reminders, the questionnaire was sent twice on paper to the non-respondents. Finally, supplementary phone interviews were carried out by multi-lingual interviewers. All the participants were able to enter in a draw to win gift cards. Results The response rate (RR) for the online survey was 34%. RR was highest for those who had lived in Finland 5 years or less (43%) and lowest among the divorced (23%) and Estonians (27%). The paper questionnaire was mostly preferred by older age groups, increasing the RR of 40-64 year-olds from 31% to 48%. Telephone interviews increased the RR by five percent points, thus making the final RR for the survey 53%. Persons born in the EU and North-America responded the most frequently (58%) whereas RR was lowest amongst the Sub-Saharan African origin migrants (47%). RR was particularly low (42%) for those who had moved to Finland at ages 0-6. Conclusions In surveys conducted amongst PFB, relatively good response rates can be obtained by using alternate methods for gathering data instead of costly and time-consuming face-to-face interview. Age and marital status seemed to affect the preference of survey format. The overall RR varied by country of origin. Key messages A good response rate can be obtained without face-to-face interviews in migrant population surveys. Migrant population surveys can be conducted more efficiently by combining a variety of methods.

scholarly journals Building on a Sequential Mixed-Mode Research Design in the Monitoring the Future Study

2020 ◽  
Author(s):  
Megan E Patrick ◽  
Mick P Couper ◽  
Bohyun Joy Jang ◽  
Virginia Laetz ◽  
John E Schulenberg ◽  
...  
Keyword(s):  
Mixed Mode ◽  
Survey Design ◽  
Response Rates ◽  
Control Group ◽  
Web Survey ◽  
12Th Grade ◽  
Monitoring The Future ◽  
E Mail ◽  
Mailed Survey ◽  
The Web

Abstract Given the promise of the web push plus e-mail survey design for providing cost-effective and high-quality data (Patrick et al. 2018, 2019) as an alternative to a paper-and-pencil mailed survey design for the longitudinal Monitoring the Future (MTF) study, the current study sought to further enhance the web push condition. The MTF sample is based on US nationally representative samples of 12th grade students surveyed annually. The MTF control group for the current study included participants who completed the in-school baseline survey in the 12th grade and were selected to participate in their first follow-up survey in 2017 via mailed surveys (N = 1,222). A supplementary sample (N = ∼2,450) was assigned to one of the two sequential mixed-mode conditions. Those in condition 1 (N = 1,198), or mail push, were invited to complete mailed surveys and later given a web survey option. Those in condition 2 (N = 1,173), or enhanced web push, were invited to complete a web survey (the same as in the 2014 study, but with the addition of text messages and quick response (QR) codes and the web survey was optimized for mobile devices) and then later given a mailed survey option. Research aims were to examine response rates across conditions, as well as how responses were distributed across mode (paper, web), devices (computer, smartphone, table), and method of accessing the web survey (hand-entered URL, QR code, e-mail link, SMS link). Response rates differed significantly: the MTF control group was 34.2 percent, mail push was 35.4 percent, and enhanced web push was 42.05 percent. The higher response rate in the enhanced web push condition suggests that the additional strategies were effective at bringing in more respondents. Key estimates produced by the enhanced web push condition did not differ from those of the MTF control group.

scholarly journals Do Physicians Prefer to Complete Online or Mail Surveys? Findings From a National Longitudinal Survey

2018 ◽  
Vol 42 (1) ◽  
pp. 41-70 ◽  
Author(s):  
Tamara Taylor ◽  
Anthony Scott
Keyword(s):  
Response Rate ◽  
Response Rates ◽  
Longitudinal Survey ◽  
Free Text ◽  
Response Patterns ◽  
Medical Specialist ◽  
Mail Surveys ◽  
Cast Doubt ◽  
Survey Designs ◽  
Mode Response

Survey response rates for physicians are falling generally, and surveys of physicians tend to have lower response rates than those of the general population. To maximize response, respondents are often given a choice of modes in which to respond. The aim of this article is to describe mode response patterns and identify factors related to physicians’ decisions to complete surveys online rather than by mail. The data are from the fifth annual wave of the Medicine in Australia: Balancing Employment and Life longitudinal survey of physicians, in which there was a 43.5% response rate (10,746/24,711) and 33.7% of respondents completed the survey online. Online completion was more likely when the physician had completed the survey online in the previous wave, was a general practitioner rather than other medical specialist or doctor-in-training, worked in a remote location, and was young and male. Free-text spontaneous comments from respondents indicated that mode choice was based on a combination of preference, previous experience, and feasibility. These results provide support for the use of mixed mode survey designs, which can accommodate doctors with different mode preferences and cast doubt over the possibility of tailoring mode based on respondent characteristics.

Factors Affecting Interview Duration in Web-Based Travel Surveys

2018 ◽  
Vol 2672 (42) ◽  
pp. 33-44
Author(s):  
Pierre-Léo Bourbonnais ◽  
Catherine Morency
Keyword(s):  
Poor Response ◽  
Multiple Regression Model ◽  
Web Surveys ◽  
Web Based ◽  
Factors Affecting ◽  
Face To Face ◽  
Precise Evaluation ◽  
Collection Phase ◽  
Small Screen ◽  
The Web

Historically, travel surveys have been conducted face-to-face, by mail, or by phone. With the increasing share of households having access to the Internet, other survey modes have been deployed. This paper focuses on web surveys. Among other advantages, using the web to conduct surveys reduces costs and helps mitigate poor response rates among young households. Very few studies have been conducted on interview duration and its determinant using paradata from web travel surveys. Such knowledge is necessary to validate the context in which travel data are gathered and can be used to understand sample and data quality. Interview duration modeling is also essential for allocating survey servers and monitoring interviews during the data collection phase. This paper models interview duration using paradata from nine web surveys conducted in the Quebec province from 2010 to 2014. The main objectives of the model are to assist the monitoring of interviews by detecting outliers, provide a better estimate of the interview duration to respondents and survey managers during the interview, and allow a more precise evaluation of the server performance needed before conducting web travel surveys. Using a multiple regression model, we observed that the most important variables in explaining interview duration were number of car and transit trips as well as number of unique places visited during a day. Conducting the interview on a small-screen device also increased interview duration. The model also provides a baseline estimate of interview duration on the basis of demographic features and questionnaire design.

High Response Rate to Epoetin Beta in Elderly Patients with Myelodysplasia (MDS): Results of a Prospective Study.

Blood ◽  
2005 ◽  
Vol 106 (11) ◽  
pp. 2538-2538 ◽  
Author(s):  
Pascal Chaibi ◽  
Isabelle Gouin ◽  
Sylvie Berigaud ◽  
Virginie Siguret ◽  
Eric Pautas ◽  
...  
Keyword(s):  
General Population ◽  
Elderly Patients ◽  
Prospective Study ◽  
Response Rate ◽  
Response Rates ◽  
Similar Response ◽  
Epoetin Beta ◽  
A Prospective Study ◽  
Beta Dose ◽  
Pretreatment Serum

Abstract Background: Anemia of MDS is common in elderly patients. Recombinant Erythopoietin (EPO) alfa or beta, when used alone, improves anemia in 20 to 30 % of MDS in general population. In older patients with MDS, anemia is usually treated by transfusion supportive regimens. We report the results of a prospective study we conducted on the use of Epoetin Beta in anemic elderly patients with MDS. Patients and Treatment: Inclusion criteria were patient aged 75 years and over with MDS chronic anemia requiring transfusion or Hb < 10g/dl exclusion of other causes of anemia. Patients were treated with Epoetin beta 150 IU/ kg x 3/week during at least 8 weeks. In the absence of response, Epoetin beta dose was increased to 300 IU/ kg x 3/week and a new evaluation made after 8 weeks. Response was evaluated based on IWG criteria. In patients responding to Epoetin Beta, intervals between injections were adjusted to maintain Hb levels between 11 and 13g/dl. Seventy five patients (25 men, 50 women), median age 87.7 years (75 – 103), median creatinine clearance (CrCl) 36 ml/min (15 – 86) were included. They were classified as follows, 1 RARS, 54 RCMD, 17 RAEB1, 2 RAEB2, 1 5q- syndrome. There was not statistically significant correlation between pretreatment serum epo level and CrCl. Anemia was associated with neutropenia and/or thrombopenia in 19 patients and required transfusion in 44 patients. Karyotype was not performed in most of the patients. The median interval between onset of anemia and study treatment was 9 months (range 4 – 48). None of the patients had previously received EPO alfa or beta or Darbopoetin. Results: Sixty one of the 75 patients (81 %), including the patient with 5q- syndrome, had major erythroid haematological improvement (EHI) (transfusion independence in formerly transfused patients or rise of at least 2 g/dl of haemoglobin level in formerly non transfused patients). EHI was obtained with Epoetin beta lowest dose in 50/61 patients. No effect was seen on granulocytes and platelets. No side effects were observed. The response rates were 85 %, 68.5 % for RCMD and RAEB, respectively (p=NS). Pretreatment serum epo level was lower in responding patients than in non responding patients (median level 34 and 104 UI/l respectively, p< 0.05). Response rate was lower in transfused than in non transfused patients (72 and 93 % respectively, p <0.05). Similar response rates were found in patients with CrCl> or < to 40 ml/min (88 and 78 % respectively). Median response duration was not reached with a median follow up of 13 months (4 – 36). In responding patients, median adjusted Epoetin Beta dose was 190 IU/kg /week Conclusion: In elderly patients with MDS, EPO appears to be an effective treatment to correct anemia. Our results may be superior to those obtained in general population because of lowest pretreatment serum EPO levels and more frequent low risk MDS in elderly patients. In studies evaluating the effect of EPO on the anemia of MDS patients, response rates should be analyzed according to age especially if old and very old patients are included.

scholarly journals Mixing mixed-mode designs in a national health interview survey: a pilot study to assess the impact on the self-administered questionnaire non-response

2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Elise Braekman ◽  
Sabine Drieskens ◽  
Rana Charafeddine ◽  
Stefaan Demarest ◽  
Finaba Berete ◽  
...  
Keyword(s):  
Logistic Regression ◽  
Regression Analysis ◽  
Item Response ◽  
Mixed Mode ◽  
Response Rate ◽  
Unit Response ◽  
User Friendliness ◽  
Interview Survey ◽  
Self Administered Questionnaire ◽  
The Web

Abstract Background Many population health surveys consist of a mixed-mode design that includes a face-to-face (F2F) interview followed by a paper-and-pencil (P&P) self-administered questionnaire (SAQ) for the sensitive topics. In order to alleviate the burden of a supplementary P&P questioning after the interview, a mixed-mode SAQ design including a web and P&P option was tested for the Belgian health interview survey. Methods A pilot study (n = 266, age 15+) was organized using a mixed-mode SAQ design following the F2F interview. Respondents were invited to complete a web SAQ either immediately after the interview or at a later time. The P&P option was offered in case respondents refused or had previously declared having no computer access, no internet connection or no recent usage of computers. The unit response rate for the web SAQ and the overall unit response rate for the SAQ independent of the mode were evaluated. A logistic regression analysis was conducted to explore the association of socio-demographic characteristics and interviewer effects with the completed SAQ mode. Furthermore, a logistic regression analysis assessed the differential user-friendliness of the SAQ modes. Finally, a logistic multilevel model was used to evaluate the item non-response in the two SAQ modes while controlling for respondents’ characteristics. Results Of the eligible F2F respondents in this study, 76% (107/140) agreed to complete the web SAQ. Yet among those, only 78.5% (84/107) actually did. At the end, the overall (web and P&P) SAQ unit response rate reached 73.5%. In this study older people were less likely to complete the web SAQ. Indications for an interviewer effect were observed as regard the number of web respondents, P&P respondents and respondents who refused to complete the SAQ. The web SAQ scored better in terms of user-friendliness and presented higher item response than the P&P SAQ. Conclusions The web SAQ performed better regarding user-friendliness and item response than the P&P SAQ but the overall SAQ unit response rate was low. Therefore, future research is recommended to further assess which type of SAQ design implemented after a F2F interview is the most beneficial to obtain high unit and item response rates.

Sign in / Sign up

Export Citation Format

Share Document