Intervening to Reduce Satisficing Behaviors in Web Surveys

2016 ◽  
Vol 36 (1) ◽  
pp. 57-81 ◽  
Author(s):  
Chan Zhang ◽  
Frederick G. Conrad
Keyword(s):  
Online Survey ◽  
Underlying Mechanism ◽  
Item Nonresponse ◽  
Web Surveys ◽  
Online Surveys ◽  
General Increase ◽  
Shed Light ◽  
The Web ◽  
Interactive Medium

Most online surveys still look and feel much like paper questionnaires. In particular, although the web is an interactive medium, web surveys rarely exploit this interactive capability. One exception is a series of demonstrations that online survey respondents seem to become more conscientious when prompted (usually with a brief textual message) in response to behaviors like item nonresponse, nondifferentiation, and answering very quickly. While these earlier studies have found that interactive intervention can reduce the occurrence of these behaviors, the underlying mechanism—why the intervention works—remains unclear. To shed light on this, we conducted two experiments to explore why respondents might change their behavior after being prompted. Part of the explanation lies in whether the benefits of the intervention are specific to the targeted behavior or lead to a general increase in conscientious responding. The findings show that intervention can lead to genuine improvement in respondent behaviors, but it also runs the risk of producing socially desirable bias in survey answers.

scholarly journals Mode and Interviewer Effects in Egocentric Network Research

Field Methods ◽  
2019 ◽  
Vol 31 (3) ◽  
pp. 195-213 ◽  
Author(s):  
Claude S. Fischer ◽  
Lindsay Bayham
Keyword(s):  
Online Survey ◽  
Quality Data ◽  
Web Surveys ◽  
Egocentric Networks ◽  
Face To Face ◽  
Interviewer Effects ◽  
Audio Recordings ◽  
Egocentric Network ◽  
To Receive ◽  
The Web

Surveys of egocentric networks are especially vulnerable to methods effects. This study combines a true experiment—random assignment of respondents to receive essentially identical questions from either an in-person interviewer or an online survey—with audio recordings of the in-person interviews. We asked over 850 respondents from a general population several different name-eliciting questions. Face-to-face interviews yielded more cooperation and higher-quality data but fewer names than did the web surveys. Exploring several explanations, we determine that interviewer differences account for the mode difference: Interviewers who consistently prompted respondents elicited as many alters as did the web survey and substantially more than did less active interviewers. Although both methods effects substantially influenced the volume of alters listed, they did not substantially modify associations of other variables with volume.

scholarly journals The Impact of Pictures on Best-Worst Scaling in Web Surveys

2012 ◽  
Vol 2 (3) ◽  
pp. 79-93
Author(s):  
Marinică Bărbulescu ◽  
Alexandru Cernat
Keyword(s):  
Experimental Design ◽  
Response Rates ◽  
Control Group ◽  
Web Surveys ◽  
Online Surveys ◽  
Best Worst Scaling ◽  
Influence Measurement ◽  
The Impact ◽  
Experimental Group ◽  
The Web

Abstract: Motivation and burden are two of the most important aspects that influence response rates and dropouts in online surveys. As a result, we focus our analyses on how pictures and Best Worst Scaling (BWS), two solutions for each problem, interact in the Web medium. We use an experimental design that compares a BWS with pictures, the experimental group, and BWS without pictures, the control group. Results show that pictures influence measurement of BWS in six out of 16 items. We also observe that Couper's (2001) conclusion that concordant text and images have an accentuation effect while a discordant relationship between the two has an interference impact is partly true in our data. Eight out of the 16 items are at least partially influenced by the concordant/discordant variable while four fully respect this model. We conclude by discussing the impact of our findings and its limitations.

Mobile and Dirty

2017 ◽  
Vol 36 (2) ◽  
pp. 212-230 ◽  
Author(s):  
Stephan Schlosser ◽  
Anja Mays
Keyword(s):  
Data Quality ◽  
Mobile Devices ◽  
Completion Time ◽  
Online Survey ◽  
Measure Data ◽  
Item Nonresponse ◽  
Comparable Data ◽  
Online Surveys ◽  
Response Properties ◽  
Internet Connection

In this article, we present a study on the data quality and the response process of mobile online surveys using an experimental design as compared to a standard computer. We used the following indicators to measure data quality and response properties: reaction time to survey invitation, break-off rate, item nonresponse, length of responses to open-ended questions and survey transmission, processing, and completion time. With regard to completion time, we also explored the significance of the place as well as the situation in which the survey was completed, the kind of Internet connection the respondents had as well as the hardware properties of the devices used to answer the online survey. Our results suggest comparable data quality and response properties in most aspects: There were no noticeable differences between computer and mobile users as regards break-off rate, item nonresponse, and length of responses to open-ended questions, nor the place where the survey was completed. However, it took respondents in the mobile group longer to complete the survey as compared to respondents answering the online survey on their computer. In terms of the completion time, there was a significant decrease in the differences between mobile devices and PCs when respondents used technically advanced mobile devices and had access to a fast Internet connection.

Can Student Populations in Developing Countries Be Reached by Online Surveys? The Case of the National Service Scheme Survey (N3S) in Ghana

Field Methods ◽  
2016 ◽  
Vol 29 (2) ◽  
pp. 154-170 ◽  
Author(s):  
Arnim Langer ◽  
Bart Meuleman ◽  
Abdul-Gafar Tobi Oshodi ◽  
Maarten Schroyens
Keyword(s):  
Developing Countries ◽  
University Students ◽  
Online Survey ◽  
Target Group ◽  
National Service ◽  
Online Surveys ◽  
Online Strategies

This article tackles the question whether it is a viable strategy to conduct online surveys among university students in developing countries. By documenting the methodology of the National Service Scheme Survey conducted in Ghana, we set out to answer three questions: (1) How can a sample of university students be obtained? (2) How can students be motivated to cooperate in online surveys? (3) What kind of devices do students use for completing an online survey? Our results indicate that online strategies can be very useful to reach this particular target group, if the necessary precautions are taken.

Translating like a conduit? A sociosemiotic analysis of modality in Chinese government press conference interpreting

Semiotica ◽  
2018 ◽  
Vol 2018 (221) ◽  
pp. 175-198 ◽  
Author(s):  
Rongbo Fu
Keyword(s):  
Systemic Functional Linguistics ◽  
Chinese Government ◽  
Press Conference ◽  
General Increase ◽  
Chinese Context ◽  
Research Results ◽  
Concordance Analysis ◽  
Institutional Settings ◽  
Shed Light ◽  
Language Pair

AbstractThis paper is a corpus-based sociosemiotic inquiry into the translation of linguistic modality in government press conferences in the Chinese context, with an eye to its indication of interpreter’s identity. Viewing translation (including interpreting) as a process of social semiosis, the paper draws on theoretical insights from Systemic Functional Linguistics (SFL) and applies them to the analysis of modality in both English and Chinese – the language pair that concerns the present research. Results of the study show that, while modality distribution in the two languages are basically maintained at the same level, interchangeable uses between volitive and obligatory subtypes of modality plus the general increase of modality value in interpreted vis-à-vis source speeches indicate that interpreters are not deprived of mediating latitude which is believed to contradict their prescriptive stereotypes. Also, exemplary parallel concordance analysis of modality reveals that interpreters adopt various solutions to translating the same modal element. Further, the paper proposes a taxonomy for the analysis of modality shifts in interpreter-mediated encounters, with illustrative cases of each subclass examined and discussed. The findings are expected to shed light on the interpreter’s identity in political institutional settings.

scholarly journals Going web or staying paper? The use of web-surveys among older people

2020 ◽  
Author(s):  
Susanne Kelfve ◽  
Marie Kivi ◽  
Boo Johansson ◽  
Magnus Lindwall
Keyword(s):  
Older People ◽  
Good Alternative ◽  
Web Survey ◽  
Response Patterns ◽  
Older Individuals ◽  
Web Surveys ◽  
Paper Questionnaire ◽  
Age Range ◽  
Web Questionnaire ◽  
The Web

Abstract Background: Web-surveys are increasingly used in population studies. Yet, web-surveys targeting older individuals are still uncommon for various reasons. However, with younger cohorts approaching older age, the potentials for web-surveys among older people might be improved. In this study, we investigated response patterns in a web-survey targeting older adults and the potential importance of offering a paper questionnaire as an alternative to the web questionnaire. Methods: We analyzed data from three waves of a retirement study, in which a web-push methodology was used and a paper questionnaire was offered as an alternative to the web questionnaire in the last reminder. We mapped the response patterns, compared web- and paper respondents and compared different key outcomes resulting from the sample with and without the paper respondents, both at baseline and after two follow-ups.Results: Paper-respondents, that is, those that did not answer until they got a paper questionnaire with the last reminder, were more likely to be female, retired, single, and to report a lower level of education, higher levels of depression and lower self-reported health, compared to web-respondents. The association between retirement status and depression was only present among web-respondents. The differences between web and paper respondents were stronger in the longitudinal sample (after two follow-ups) than at baseline.Conclusions: We conclude that a web-survey might be a feasible and good alternative in surveys targeting people in the retirement age range. However, without offering a paper questionnaire, a small but important group will likely be missing with potential biased estimates as the result.

scholarly journals The Mood of the Nation in 2020: The Stuff/Massey pre-election online survey

2021 ◽  
Vol 1 ◽  
Author(s):  
Grant Duncan ◽  
James H Liu ◽  
Sarah Y Choi
Keyword(s):  
New Zealand ◽  
Online Survey ◽  
Social Issues ◽  
The Political ◽  
Online Surveys ◽  
Conspiracy Theories ◽  
The Public ◽  
Large Samples ◽  
Academic Researchers ◽  
Political Spectrum

Leading up to the 2017 New Zealand general election, Stuff.co.nz and Massey University collaborated in two online surveys of public opinion to test the mood of the nation and seek opinions about a range of relevant political and social issues. Given their success, two more surveys were conducted in 2020. This article summarises results from the 2020 data, and reflects on the methodological advantages, disadvantages and challenges of conducting people-driven online surveys that need to meet the differing needs of academic researchers, journalists and the public. While the surveys produced very large samples, they were not representative. Moreover, the choices of items were influenced by what happened to be newsworthy at the time. Naturally, Covid-19 was a significant theme during the 2020 surveys. The results reveal predictable left–right polarization of opinions, a minority support for conspiracy theories, some areas of wide agreement across the political spectrum, and some unexpected nuances of opinions within and across ethnic groups.

scholarly journals The Ethics of Outsourcing Online Survey Research

2012 ◽  
pp. 160-175
Author(s):  
Peter J. Allen ◽  
Lynne D. Roberts
Keyword(s):  
Survey Research ◽  
Online Survey ◽  
Ethical Issues ◽  
Service Providers ◽  
Academic Research ◽  
Limited Attention ◽  
Web Surveys ◽  
Web Based ◽  
Research Software ◽  
Research Students

The increasing level of Internet penetration over the last decade has made web surveying a viable option for data collection in academic research. Software tools and services have been developed to facilitate the development and deployment of web surveys. Many academics and research students are outsourcing the design and/or hosting of their web surveys to external service providers, yet ethical issues associated with this use have received limited attention in academic literature. In this article, the authors focus on specific ethical concerns associated with the outsourcing of web surveys with particular reference to external commercial web survey service providers. These include threats to confidentiality and anonymity, the potential for loss of control over decisions about research data, and the reduced credibility of research. Suggested guidelines for academic institutions and researchers in relation to outsourcing aspects of web-based survey research are provided.

The value of online surveys: a look back and a look ahead

2018 ◽  
Vol 28 (4) ◽  
pp. 854-887 ◽  
Author(s):  
Joel R. Evans ◽  
Anil Mathur
Keyword(s):  
Survey Research ◽  
Online Survey ◽  
New Technologies ◽  
Actual Behavior ◽  
Online Surveys ◽  
Content Type ◽  
Look Ahead ◽  
Look Back ◽  
The Future ◽  
The Look

Purpose The purpose of this paper is to present a detailed and critical look at the evolution of online survey research since Evans and Mathur’s (2005) article on the value of online surveys. At that time, online survey research was in its early stages. Also covered are the present and future states of online research. Many conclusions and recommendations are presented. Design/methodology/approach The look back focuses on online surveys, strengths and weaknesses of online surveys, the literature on several aspects of online surveys and online survey best practices. The look ahead focuses on emerging survey technologies and methodologies, and new non-survey technologies and methodologies. Conclusions and recommendations are provided. Findings Online survey research is used more frequently and better accepted by researchers than in 2005. Yet, survey techniques are still regularly transformed by new technologies. Non-survey digital research is also more prominent than in 2005 and can better track actual behavior than surveys can. Hybrid surveys will be widespread in the future. Practical implications The paper aims to provide insights for researchers with different levels of online survey experience. And both academics and practitioners should gain insights. Social implications Adhering to a strong ethics code is vital to gain respondents’ trust and to produce valid results. Originality/value Conclusions and recommendations are offered in these specific areas: defining concepts, understanding the future role of surveys, developing and implementing surveys and a survey code of ethics. The literature review cites more than 200 sources.

Why we need a new approach to teaching digital literacy

2018 ◽  
Vol 99 (6) ◽  
pp. 27-32 ◽  
Author(s):  
Joel Breakstone ◽  
Sarah McGrew ◽  
Mark Smith ◽  
Teresa Ortega ◽  
Sam Wineburg
Keyword(s):  
Higher Education ◽  
Presidential Election ◽  
Digital Literacy ◽  
Web Searching ◽  
Main Approach ◽  
New Approach ◽  
Approach To Teaching ◽  
K 12 ◽  
Shed Light ◽  
The Web

In recent years — and especially since the 2016 presidential election — numerous media organizations, newspapers, and policy advocates have made efforts to help Americans become more careful consumers of the information they see online. In K-12 and higher education, the main approach has been to provide students with checklists they can use to assess the credibility of individual websites. However, the checklist approach is outdated. It would be far better to teach young people to follow the lead of professional fact-checkers: When confronted by a new and unfamiliar website, they begin by looking elsewhere on the web, searching for any information that might shed light on who created the site in question and for what purpose.

Sign in / Sign up

Export Citation Format

Share Document