Addressing Data Collection Problems in Web-Mediated Surveys

Author(s):  
Nicholas Meese ◽  
Juani Swart ◽  
Richard Vidgen ◽  
Philip Powell ◽  
Chris McMahon

Web-based approaches are increasingly being used for carrying out surveys, for example in research or to obtain user feedback in product and systems development. However, the drawbacks of web surveying are often overlooked. Errors in web surveys can be related to sampling, coverage, measurement, and non-response issues. Low response rates and non-response bias are particularly important for web-based surveys. This paper reports on a web-based survey in an international engineering consultancy, aimed at eliciting feedback on the development of systems to support sustainable engineering, that produced a low response rate. To investigate the reasons for this, a follow-up survey was conducted by telephone. The majority of those questioned were unaware of the original survey. The telephone survey showed that reasons for non-completion by those who were aware may be categorized as resources issues, relevance, and fatigue. Differences between those who were aware of the original survey and those who were not are explored and a gap is found between action and intention, i.e. good intentions to complete a survey are very unlikely to translate into action and completed surveys. The paper concludes with practical guidance for administering web-based surveys and observations on the merits of telephone surveys.

Author(s):  
Michael Lang

This chapter encapsulates the main findings of an in-depth study of Web development practices in Ireland. The essential research objective was to build a richer understanding of the modern context of Web development and of how that context influences design practices. At the outset, a conceptual framework was derived through a synthesis of issues in the literature and an analysis of existing models of IS development. Data was then gathered through a dual-mode (Web and postal) quantitative survey which yielded 165 usable responses, and later through a series of 14 semi-structured qualitative interviews in a follow-up field study. Following an interpretive approach, elementary statistics and grounded theory were used to iteratively analyze the data until a reasonably comprehensive and stable explanation emerged. This is presented in the form of an elaborated conceptual framework of Web-based systems development as “situated action.”


2012 ◽  
Vol 27 (6) ◽  
pp. 991-1004 ◽  
Author(s):  
Nadia M. Wager

This study investigated respondents’ experiences of completing a retrospective web-based survey exploring sexual revictimization. The original survey provided a link to a separate mixed-methods survey assessing the impact of participation. Of the original 481 respondents, 234 completed this follow-up survey. Eighty percent were female and 52% reported histories of sexual victimization (SV). Newman, Willard, Sinclair, and Kaloupek’s (2001) Reactions to Research Participation Questionnaire was adapted to suit this web-based design, and several open-ended questions were included. The statistical analysis revealed that those who experienced SV reported higher levels of distress and personal benefit and were less likely to be inconvenienced by participation. However, higher levels of benefit did not always compensate for greater levels of distress, particularly for those with more recent and more extensive histories of SV. The thematic analysis of the qualitative responses is discussed and suggestions are offered for the design of more ethically sensitive research protocols and practices.


1995 ◽  
Vol 214 (4) ◽  
Author(s):  
Gösta Foreman

SummaryData from omnibus surveys are analyzed for the purpose of studying the effects of substitution in telephone surveys. Substitutions occur at two selection stages here: first in the selection of telephone numbers, second in the selection of household respondents. For both stages, sample distributions of demographic and socio-economic characteristics are compared with official statistics. Disparities indicate the presence of a substitution bias due to a relatively low response rate. A major portion of the study focuses on the second sampling stage. In a follow-up study, substitutes within households are compared with the persons originally selected for interview.


2011 ◽  
Vol 29 (1) ◽  
pp. 14-24 ◽  
Author(s):  
Charles R. Hall ◽  
Alan W. Hodges ◽  
Marco A. Palma

Abstract This article provides an overview of marketing and production practices of the U.S. nursery and greenhouse industry in 2008, based on information collected through the 2009 National Nursery Survey, the fifth such survey since 1988. Lists of nursery firms for each state were assembled from the respective Department of Agriculture (Plant Health Board) offices responsible for licensing nursery producers. The compiled state lists resulted in a combined listing of 38,000 certified nursery operations. A total of 3,044 usable questionnaires were returned from a sample of 17,019 firms for an effective 17.9 % response rate. The survey was administered through both mail and internet questionnaires, with repeated contacts attempted, and a follow-up telephone survey on non-respondents. Survey respondents reported total annual sales of $4.45 billion in 2008, or an average of $1.73 million per firm, and total employment of 48,833 permanent and temporary jobs. Based on an adjusted population of validated active firms (19,803), total U.S. nursery industry sales were estimated at $27.14 billion, and total employment was estimated at 262,941 jobs. The highest sales and employment were in the Pacific and Southeast regions, led by the states of California and Florida. Overall, 77 percent of sales were made through wholesale outlets including landscape firms, single-location garden centers, and re-wholesalers.


1994 ◽  
Vol 23 (2) ◽  
pp. 200-206 ◽  
Author(s):  
Sharon I. Gripp ◽  
A.E. Luloff ◽  
Robert D. Yonkers

Response rates are one indicator of a survey's data quality, as a great deal of importance has been placed on the mail survey's response rate. However, a telephone survey's response rate usually is not reported. Even if one is reported, the numbers used in the calculation are rarely defined making the response rate interpretation unclear. Using a recent telephone survey of Pennsylvania dairy managers, this paper demonstrates how telephone survey data should be reported. Essentially, every research report should include a discussion of how the survey was conducted, a disposition table, and well-defined formulas used to calculate response rates.


2021 ◽  
pp. 016327872110194
Author(s):  
Brendan J. Barnhart ◽  
Siddharta G. Reddy ◽  
Gerald K. Arnold

For survey researchers, physicians in the United States are a difficult-to-reach subgroup. The purpose of this study is to quantify the effect of email reminders on web-based survey response rates targeting physicians. We conducted a retrospective analysis of 11 American Board of Internal Medicine surveys from 2017 to 2019. We compute aggregate response rates for the periods between weekly email contacts across the 11 surveys, while controlling for survey time to complete, physician age, gender, region, board certification status, and initial exam performance. The overall predicted response rate after six weekly email contacts was 23.7%, 95% CI: (17.1%, 33.0%). Across the 11 surveys, we found response rate for the first period to be 8.9%, 95% CI: (6.5%, 12.2%). We observed a 50% decrease in response from the first to the second period, which had a 4.4%, 95% CI: (3.2%, 6.2%), response rate. The third and fourth response periods yielded similar response rates of 3.0%, 95% CI: (2.3%, 3.9%) and 3.3%, 95%CI: (2.4%, 4.6%), respectively. The fifth and sixth response periods yielded similar response rates of 2.2%, 95%CI: (1.5%, 3.3%) and 1.9%, 95% CI: (1.3%, 2.7%), respectively. The results were further stratified into different levels of participant survey interest, and are helpful for cost and sample size considerations when designing a physician survey.


2001 ◽  
Vol 43 (4) ◽  
pp. 1-15 ◽  
Author(s):  
Cihan Cobanoglu ◽  
Patrick J Moreo ◽  
Bill Warde

This study compares mail, fax and web-based surveys in a university setting for response speed, response rate and costs. The survey was distributed to 300 hospitality professors randomly chosen from the Council on Hotel, Restaurant, and Institutional Education members listed in the organisation's online directory as of April 2000. It was found that the fastest method was fax, with an average of 4.0 days to respond, followed by web surveys with 5.97 days. The slowest method, as expected, was mail surveys, with 16.46 days to respond. On average, the response rate was 28.91%: 26.27% for mail, 17.0% for fax, and 44.21% for web surveys. An LSD-type z-test shows significant differences between mail and email/web and between fax and email/web, but no significant difference between mail and fax. In addition, data were analysed for data consistency and cost.


2003 ◽  
Author(s):  
Lori Foster Thompson ◽  
Eric A. Surface ◽  
Don L. Martin ◽  
Gary B. Barrett
Keyword(s):  

2020 ◽  
Author(s):  
Ignacio Garitano ◽  
Manuel Linares ◽  
Laura Santos ◽  
Ruth Gil ◽  
Elena Lapuente ◽  
...  

UNSTRUCTURED On 28th February a case of COVID-19 was declared in Araba-Álava province, Spain. In Spain, a confinement and movement restrictions were established by Spanish Government at 14th March 2020. We implemented a web-based tool to estimate number of cases during the pandemic. We present the results in Áraba-Álava province. We reached a response rate of 10,3% out a 331.549 population. We found that 22,4 % fulfilled the case definition. This tool rendered useful to inform public health action.


2019 ◽  
Vol 25 (14) ◽  
pp. 1696-1716 ◽  
Author(s):  
Ida Frugaard Stroem ◽  
Helene Flood Aakvaag ◽  
Tore Wentzel-Larsen

This study investigates the relationship between the characteristics of different types of childhood violence and adult victimization using two waves of data from a community telephone survey (T1) and a follow-up survey, including 505 cases and 506 controls, aged 17-35 years (T2). The logistic regression analyses showed that exposure to childhood abuse, regardless of type, was associated with adult victimization. Exposure to multiple types of abuse, victimization both in childhood and in young adulthood, and recency of abuse increased these odds. Our findings emphasize the importance of assessing multiple forms of violence when studying revictimization. Practitioners working with children and young adults should be attentive to the number of victimization types experienced and recent victimization to prevent further abuse.


Sign in / Sign up

Export Citation Format

Share Document