scholarly journals Comparison of response patterns in different survey designs: a longitudinal panel with mixed-mode and online-only design

2017 ◽  
Vol 14 (1) ◽  
Author(s):  
Nicole Rübsamen ◽  
Manas K. Akmatov ◽  
Stefanie Castell ◽  
André Karch ◽  
Rafael T. Mikolajczyk
2018 ◽  
Vol 42 (1) ◽  
pp. 41-70 ◽  
Author(s):  
Tamara Taylor ◽  
Anthony Scott

Survey response rates for physicians are falling generally, and surveys of physicians tend to have lower response rates than those of the general population. To maximize response, respondents are often given a choice of modes in which to respond. The aim of this article is to describe mode response patterns and identify factors related to physicians’ decisions to complete surveys online rather than by mail. The data are from the fifth annual wave of the Medicine in Australia: Balancing Employment and Life longitudinal survey of physicians, in which there was a 43.5% response rate (10,746/24,711) and 33.7% of respondents completed the survey online. Online completion was more likely when the physician had completed the survey online in the previous wave, was a general practitioner rather than other medical specialist or doctor-in-training, worked in a remote location, and was young and male. Free-text spontaneous comments from respondents indicated that mode choice was based on a combination of preference, previous experience, and feasibility. These results provide support for the use of mixed mode survey designs, which can accommodate doctors with different mode preferences and cast doubt over the possibility of tailoring mode based on respondent characteristics.


2014 ◽  
Vol 22 (3) ◽  
pp. 304-320 ◽  
Author(s):  
Lonna Rae Atkeson ◽  
Alex N. Adams ◽  
R. Michael Alvarez

We examine the quality of two probability-based polls, one interviewer administered (telephone) and one self-administered (Internet and mail mixed mode survey). The polls use the same sampling frame (registered voters) and the same questions. First, we examine the representativeness of both surveys using information known about the population, and although we find important differences between the two in terms of sampling and nonresponse bias, we also find that both surveys represent the underlying population despite low response rates. We also test for mode effects between surveys due to social desirability and how it influences nondifferentiation or satisficing. Using a variety of methods (t-tests, multivariate regression, and genetic propensity matching), we find evidence that the presence of an interviewer alters response patterns on ego-driven questions. The implications of our work are important, due to the increasing popularity of mixed mode surveys. Researchers need to be methodologically sensitive to these differences when analyzing surveys that allow for different response modes.


2015 ◽  
Vol 12 (2) ◽  
Author(s):  
Nejc Berzelak ◽  
Vasja Vehovar ◽  
Katja Lozar Manfreda

Lower data collection costs make web surveys a promising alternative to conventional face-to-face and telephone surveys. A transition to the new mode has already been widely initiated in commercial research, but web surveys remains limited in academic and official research projects that typically require probability samples and high response rates. Various design approaches for coping with the problems of sampling frames, incomplete Internet use, and nonresponse in web surveys have been proposed. Mixed-mode designs and incentives are two common strategies to reach Internet non-users and increase the response rates in web surveys. However, such survey designs can substantially increase the costs, the complexity of administration and the possibility of uncontrolled measurement effects. This paper presents and demonstrates an approach to the evaluation of various survey designs with simultaneous consideration of the errors and costs. It focuses on the designs involving the web mode and discusses their potential to replace traditional modes for probability surveys of the general population. The main idea of this approach is that part of the cost savings enabled by the web mode can be allocated to incentives and complementary survey modes to compensate for the Internet non-coverage and the higher nonresponse. The described approach is demonstrated in an experimental case study that compares the performance of mixed-mode designs with the web mode and prepaid cash incentive with that of an official survey conducted using the face-to-face and telephone modes. The results show that the mixed-mode designs with the web mode and incentives can greatly increase the response rate, which even surpasses that of the conventional survey modes, but still offer substantial cost savings. However, the results also show that higher response rate does not necessary translate to higher data quality, especially when the main aim is to obtain estimates that are highly comparable with those of the reference survey.


2021 ◽  
pp. 251-272
Author(s):  
Barry Schouten ◽  
Jan van den Brakel ◽  
Bart Buelens ◽  
Deirdre Giesen ◽  
Annemieke Luiten ◽  
...  
Keyword(s):  

1991 ◽  
Vol 34 (3) ◽  
pp. 671-678 ◽  
Author(s):  
Joan E. Sussman

This investigation examined the response strategies and discrimination accuracy of adults and children aged 5–10 as the ratio of same to different trials was varied across three conditions of a “change/no-change” discrimination task. The conditions varied as follows: (a) a ratio of one-third same to two-thirds different trials (33% same), (b) an equal ratio of same to different trials (50% same), and (c) a ratio of two-thirds same to one-third different trials (67% same). Stimuli were synthetic consonant-vowel syllables that changed along a place of articulation dimension by formant frequency transition. Results showed that all subjects changed their response strategies depending on the ratio of same-to-different trials. The most lax response pattern was observed for the 50% same condition, and the most conservative pattern was observed for the 67% same condition. Adult response patterns were most conservative across condition. Differences in discrimination accuracy as measured by P(C) were found, with the largest difference in the 5- to 6-year-old group and the smallest change in the adult group. These findings suggest that children’s response strategies, like those of adults, can be manipulated by changing the ratio of same-to-different trials. Furthermore, interpretation of sensitivity measures must be referenced to task variables such as the ratio of same-to-different trials.


Author(s):  
Barbara Kronsteiner ◽  
Panjaporn Chaichana ◽  
Manutsanun Sumonwiriya ◽  
Kemajitra Jenjaroen ◽  
Fazle Rabbi Chowdhury ◽  
...  

2011 ◽  
Vol 27 (1) ◽  
pp. 65-70 ◽  
Author(s):  
Marleen M. Rijkeboer ◽  
Huub van den Bergh ◽  
Jan van den Bout

This study examines the construct validity of the Young Schema-Questionnaire at the item level in a Dutch population. Possible bias of items in relation to the presence or absence of psychopathology, gender, and educational level was analyzed, using a cross-validation design. None of the items of the YSQ exhibited differential item functioning (DIF) for gender, and only one item showed DIF for educational level. Furthermore, item bias analysis did not identify DIF for the presence or absence of psychopathology in as much as 195 of the 205 items comprising the YSQ. Ten items, however, spread over the questionnaire, were found to yield relatively inconsistent response patterns for patients and nonclinical participants.


Sign in / Sign up

Export Citation Format

Share Document