Moving from Face-to-Face to a Web Panel: Impacts on Measurement Quality

2020 ◽  
Author(s):  
Alexandru Cernat ◽  
Melanie Revilla
Keyword(s):  
Data Quality ◽  
Online Survey ◽  
Measurement Equivalence ◽  
European Social Survey ◽  
Measurement Quality ◽  
Main Research ◽  
Individual Level ◽  
Face To Face ◽  
Measurement Mode ◽  
Alternative Sources

Abstract Time and cost pressures, the availability of alternative sources of data, and societal changes are leading to a move from traditional face-to-face surveys to web or mixed-mode data collection. While we know that there are mode differences between web and face-to-face (presence of an interviewer or not, type of stimuli, etc.), it is not clear to what extent these differences could threaten the comparability of data collected in face-to-face and web surveys. In this article, we investigate the differences in measurement quality between the European Social Survey (ESS) Round 8 and the CROss-National Online Survey (CRONOS) panel. We address three main research questions: (1) Do we observe differences in terms of measurement quality across face-to-face and web for the same people and questions? (2) Can we explain individual-level differences in data quality using respondents’ characteristics? and (3) Does measurement equivalence (metric and scalar) hold across the ESS Round 8 and the CRONOS panel? The results suggest that: (1) in terms of data quality, the measurement mode effect between web and face-to-face as implemented in the ESS (i.e., using show cards) is not very large, (2) none of the variables considered consistently explain individual differences in mode effects, and (3) measurement equivalence often holds for the topics studied.

scholarly journals Improving Data Quality with Sociodemographic Matching?: About the Effects and Implications of Age and Gender Matching in Face-to-Face Interviews

2021 ◽  
pp. 193672442199825
Author(s):  
Felix Bittmann
Keyword(s):  
Data Quality ◽  
European Social Survey ◽  
Item Nonresponse ◽  
Age And Gender ◽  
Social Survey ◽  
Face To Face ◽  
Dependent Variables ◽  
And Gender ◽  
High Degree ◽  
Gender Matching

According to the theory of liking, data quality might be improved in face-to-face survey settings when there is a high degree of similarity between respondents and interviewers, for example, with regard to gender or age. Using two rounds of European Social Survey data from 25 countries including more than 70,000 respondents, this concept is tested for the dependent variables amount of item nonresponse, reluctance to answer, and the probability that a third adult person is interfering with the interview. The match between respondents and interviewers is operationalized using the variables age and gender and their statistical interactions to analyze how this relates to the outcomes. While previous studies can be corroborated, overall effect sizes are small. In general, item nonresponse is lower when a male interviewer is conducting the interview. For reluctance, there are no matching effects at all. Regarding the presence of other adults, only female respondents profit from a gender match, while age is without any effect. The results indicate that future surveys should weigh the costs and benefits of sociodemographic matching as advantages are probably small.

Do Interviewer Assessments of Respondents’ Performance Accurately Reflect Response Behavior?

Field Methods ◽  
2019 ◽  
Vol 32 (2) ◽  
pp. 193-212 ◽  
Author(s):  
Laura Jacobs ◽  
Geert Loosveldt ◽  
Koen Beullens
Keyword(s):  
Data Quality ◽  
European Social Survey ◽  
Response Styles ◽  
Actual Behavior ◽  
Item Nonresponse ◽  
Response Behavior ◽  
Face To Face ◽  
Using Data ◽  
The Relationship ◽  
Interviewer Observations

A growing body of literature points to the possibilities offered by postsurvey interviewer observations as a source of paradata to obtain insights into data quality. However, their utility in predicting actual behavior of respondents has attracted limited scholarly attention so far. Using data from Round 7 of the European Social Survey, we aim to clarify the relationship between interviewer observations and response styles (straightlining, item nonresponse, use of middle and extreme categories). We contribute to previous research by empirically verifying whether interviewer observations in face-to-face interviews can be effectively used as accurate predictors of data quality. Findings suggest that interviewers’ assessments of response behavior to some extent reflect response styles and can potentially be a valuable tool for the evaluation and improvement of survey data quality, although this seems mainly restricted to the most overt (i.e., easily observable) response styles.

scholarly journals Social Attitudes towards Homosexuality in Hungary and Romania

Intersections ◽  
2019 ◽  
Vol 5 (1) ◽  
Author(s):  
Judit Takács ◽  
Ivett Szalma
Keyword(s):  
Catholic Church ◽  
Research Question ◽  
Social Attitudes ◽  
European Social Survey ◽  
Family Status ◽  
Main Research ◽  
Individual Level ◽  
Negative Effect ◽  
European Values ◽  
And Gender

This study examines social attitudes towards homosexuality in two Central-Eastern European neighbouring countries – Romania and Hungary – with many common points, but that do differ in their religious traditions.  Our main research question is whether the main religious denomination can influence social attitudes towards homosexuality, after controlling for all the important individual level variables (gender, age, education, type of settlement, family status, employment background, and attitudes related to family and gender norms). Among the examined variables we especially focus on the religious ones since the dominant denominations are different in these otherwise similar societies. The empirical base of our study comprises two longitudinal databases: the European Social Survey (ESS) and the European Values Study (EVS). We use data from two ESS rounds (of 2006 and 2008) and three EVS rounds (of 1990, 1999 and 2008). Since Romania participated only in the 3rd and the 4th rounds of the ESS (in 2006 and 2008), the Romanian results from 2008 are the most recent ones. We apply descriptive statistics and regression models. Our main conclusion is that belonging to the Orthodox Church had a more negative effect on social attitudes towards homosexuality than belonging to the Catholic Church (as previous studies have also found).

scholarly journals Interviewer Involvement in Sample Selection Shapes the Relationship Between Response Rates and Data Quality

2019 ◽  
Vol 83 (2) ◽  
pp. 313-337 ◽  
Author(s):  
Stephanie Eckman ◽  
Achim Koch
Keyword(s):  
Data Quality ◽  
Selection Bias ◽  
Sampling Method ◽  
Sample Selection ◽  
Positive Association ◽  
Response Rates ◽  
European Social Survey ◽  
Face To Face ◽  
Using Data ◽  
The Relationship

Abstract Several studies have shown that high response rates are not associated with low bias in survey data. This paper shows that, for face-to-face surveys, the relationship between response rates and bias is moderated by the type of sampling method used. Using data from Rounds 1 through 7 of the European Social Survey, we develop two measures of selection bias, then build models to explore how sampling method, response rate, and their interaction affect selection bias. When interviewers are involved in selecting the sample of households or respondents for the survey, high reported response rates can in fact be a sign of poor data quality. We speculate that the positive association detected between response rates and selection bias is because of interviewers’ incentives to select households and respondents who are likely to complete the survey.

scholarly journals A Better Learning Community: Mixed-Methods Reveal Medical Student Preferences with Implications for Learning Community Design and Implementation

2021 ◽  
Vol 8 ◽  
pp. 238212052110148
Author(s):  
Jasna Vuk ◽  
Steven McKee ◽  
Sara Tariq ◽  
Priya Mendiratta
Keyword(s):  
Mixed Methods ◽  
Learning Community ◽  
Online Survey ◽  
Free Form ◽  
University Of Arkansas ◽  
Medical Sciences ◽  
Face To Face ◽  
Personal Support ◽  
School Learning ◽  
The University

Background: Medical school learning communities benefit students. The College of Medicine (COM) at the University of Arkansas for Medical Sciences (UAMS) provides medical students with academic, professional, and personal support through a learning community (LC) made of 7 academic houses. Objectives: To evaluate the effectiveness of the academic house model at UAMS utilizing a mixed-methods survey. The aims were to: (1) assess student experience and satisfaction with academic houses, (2) describe the realms of advising and guidance, and (3) identify areas for improvement. Method: An online survey was assigned to 723 COM students (all students enrolled, first through fourth years) at UAMS in March 2019. The survey was comprised of 25 items (10 multiple-choice, 8 on the Likert scale, and 7 open-ended questions). Data was depicted using frequency and percentages and/or thematic review of free-form responses. Results: The survey response rate was 31% (227 students). The majority of students responding (132, 58.1%) attended 2 or more face-to-face meetings with the faculty advisor within the preceding year. However, 27 (11.9%) students did not have any meetings. Approximately two-thirds of the respondents were satisfied or very satisfied with the guidance and direction provided by their advisors [very satisfied (n = 83; 36.6%); satisfied (n = 77; 33.9%)]. Themes that emerged from student generated areas for improvement include time constraints, advisor/advisee interest mismatch, and perceived inadequacy of advising content/connections. Conclusions: This study confirms the effectiveness of the LC model for advising and mentoring in the COM at UAMS. Uniquely, this study identifies not only learners’ satisfaction with their LC but also highlights areas for improvement which are widely generalizable and important to consider for institutions with or planning to start an LC.

scholarly journals Are telephone consultations here to stay in rheumatology?

2020 ◽  
Author(s):  
Sabrina R Raizada ◽  
Natasha Cleaton ◽  
James Bateman ◽  
Diarmuid M Mulherin ◽  
Nick Barkham
Keyword(s):  
Older Patients ◽  
Online Survey ◽  
Vulnerable Groups ◽  
Age Group ◽  
Telephone Consultation ◽  
Survey Tool ◽  
Face To Face ◽  
Vulnerable Patients ◽  
Number Of Patients

Abstract Objectives During the COVID-19 pandemic, face-to-face rheumatology follow-up appointments were mostly replaced with telephone or virtual consultations in order to protect vulnerable patients. We aimed to investigate the perspectives of rheumatology patients on the use of telephone consultations compared with the traditional face-to-face consultation. Methods We carried out a retrospective survey of all rheumatology follow-up patients at the Royal Wolverhampton Trust who had received a telephone consultation from a rheumatology consultant during a 4-week period via an online survey tool. Results Surveys were distributed to 1213 patients, of whom 336 (27.7%) responded, and 306 (91.1%) patients completed all components of the survey. Overall, an equal number of patients would prefer telephone clinics or face-to-face consultations for their next routine appointment. When divided by age group, the majority who preferred the telephone clinics were <50 years old [χ2 (d.f. = 3) = 10.075, P = 0.018]. Prevalence of a smartphone was higher among younger patients (<50 years old: 46 of 47, 97.9%) than among older patients (≥50 years old: 209 of 259, 80.7%) [χ2 (d.f. = 3) = 20.919, P < 0.001]. More patients reported that they would prefer a telephone call for urgent advice (168, 54.9%). Conclusion Most patients interviewed were happy with their routine face-to-face appointment being switched to a telephone consultation. Of those interviewed, patients >50 years old were less likely than their younger counterparts to want telephone consultations in place of face-to-face appointments. Most patients in our study would prefer a telephone consultation for urgent advice. We must ensure that older patients and those in vulnerable groups who value in-person contact are not excluded. Telephone clinics in some form are here to stay in rheumatology for the foreseeable future.

scholarly journals Utilizing asynchronous email interviews for health research: overview of benefits and drawbacks

2021 ◽  
Vol 14 (1) ◽  
Author(s):  
Michelle Amri ◽  
Christina Angelakis ◽  
Dilani Logan
Keyword(s):  
Public Health ◽  
Data Collection ◽  
Data Quality ◽  
Health Research ◽  
Geographic Location ◽  
Public Health Research ◽  
Data Accuracy ◽  
Global Public Health ◽  
Snowball Sampling ◽  
Face To Face

Abstract Objective Through collating observations from various studies and complementing these findings with one author’s study, a detailed overview of the benefits and drawbacks of asynchronous email interviewing is provided. Through this overview, it is evident there is great potential for asynchronous email interviews in the broad field of health, particularly for studies drawing on expertise from participants in academia or professional settings, those across varied geographical settings (i.e. potential for global public health research), and/or in circumstances when face-to-face interactions are not possible (e.g. COVID-19). Results Benefits of asynchronous email interviewing and additional considerations for researchers are discussed around: (i) access transcending geographic location and during restricted face-to-face communications; (ii) feasibility and cost; (iii) sampling and inclusion of diverse participants; (iv) facilitating snowball sampling and increased transparency; (v) data collection with working professionals; (vi) anonymity; (vii) verification of participants; (viii) data quality and enhanced data accuracy; and (ix) overcoming language barriers. Similarly, potential drawbacks of asynchronous email interviews are also discussed with suggested remedies, which centre around: (i) time; (ii) participant verification and confidentiality; (iii) technology and sampling concerns; (iv) data quality and availability; and (v) need for enhanced clarity and precision.

scholarly journals Conducting Population Health Research during the COVID-19 Pandemic: Impacts and Recommendations

2021 ◽  
Vol 13 (6) ◽  
pp. 3320
Author(s):  
Amy R. Villarosa ◽  
Lucie M. Ramjan ◽  
Della Maneze ◽  
Ajesh George
Keyword(s):  
Data Collection ◽  
Health Services ◽  
Data Quality ◽  
Population Health ◽  
Health Research ◽  
Alternative Methods ◽  
Residential Aged Care ◽  
Recruitment Methods ◽  
Face To Face ◽  
The Impact

The COVID-19 pandemic has resulted in many changes, including restrictions on indoor gatherings and visitation to residential aged care facilities, hospitals and certain communities. Coupled with potential restrictions imposed by health services and academic institutions, these changes may significantly impact the conduct of population health research. However, the continuance of population health research is beneficial for the provision of health services and sometimes imperative. This paper discusses the impact of COVID-19 restrictions on the conduct of population health research. This discussion unveils important ethical considerations, as well as potential impacts on recruitment methods, face-to-face data collection, data quality and validity. In addition, this paper explores potential recruitment and data collection methods that could replace face-to-face methods. The discussion is accompanied by reflections on the challenges experienced by the authors in their own research at an oral health service during the COVID-19 pandemic and alternative methods that were utilised in place of face-to-face methods. This paper concludes that, although COVID-19 presents challenges to the conduct of population health research, there is a range of alternative methods to face-to-face recruitment and data collection. These alternative methods should be considered in light of project aims to ensure data quality is not compromised.

scholarly journals Prevalence of Wheat/Gluten-Related Disorders and Gluten-Free Diet in Paraguay: An Online Survey-Based Study

Nutrients ◽  
2021 ◽  
Vol 13 (2) ◽  
pp. 396
Author(s):  
Noé Ontiveros ◽  
Raúl Emilio Real-Delor ◽  
José Antonio Mora-Melgem ◽  
Carlos Eduardo Beltrán-Cárdenas ◽  
Oscar Gerardo Figueroa-Salcido ◽  
...  
Keyword(s):  
Latin American ◽  
Weight Control ◽  
Online Survey ◽  
Adult Population ◽  
Wheat Gluten ◽  
Gluten Free Diet ◽  
Gluten Free ◽  
Questionnaire Response ◽  
Face To Face ◽  
Validated Questionnaire

Gluten-related disorders (GRDs) are increasing around the world, but their magnitude and relevance remain unknown in most Latin American countries. Thus, an online survey was conducted to estimate the prevalence of GRDs as well as adherence to a gluten-free diet (GFD) in Paraguayan adult population. There were 1058 individuals surveyed using a validated questionnaire (response rate of 93.9%). The self-reported prevalence rates were as follows (95% CI): gluten sensitivity (GS), 10.30% (8.53–12.29); non-celiac GS (NCGS), 5.19% (3.94–6.71); physician-diagnosed celiac disease (PD-CD), 3.11% (2.15–4.35); wheat allergy (WA), 2.07% (1.30–3.13); and adherence to GFD, 15.69% (13.55–18.02). Excluding CD, more women than men met the criteria for GRDs, adverse food reactions, and GFD (p < 0.05). Eight respondents reported the coexistence of NCGS with PD-CD and/or WA. Most cases on a GFD indicated medical/dietitian advice for following the diet (68.07%). Non-self-reported GS individuals indicated weight control (46.4%) and the notion that the GFD is healthier (20.2%) as the main motivations for following the diet. GRDs are not uncommon in Paraguayan adult population. It seems that there is awareness about GRDs and the GFD, but training about the diagnosis of GRDs is desirable because of the informed overlapping diagnoses of CD or WA with NCGS. Future studies involving face-to-face interviews are necessary.

scholarly journals Individual-Level Determinants of Lifestyle Behavioral Changes during COVID-19 Lockdown in the United States: Results of an Online Survey

2021 ◽  
Vol 18 (8) ◽  
pp. 4364
Author(s):  
Xiaotao Zhang ◽  
Abiodun Oluyomi ◽  
LeChauncy Woodard ◽  
Syed Ahsan Raza ◽  
Maral Adel Fahmideh ◽  
...  
Keyword(s):  
Physical Activity ◽  
Alcohol Use ◽  
Online Survey ◽  
Healthy Lifestyle ◽  
The United States ◽  
Lifestyle Changes ◽  
Lifestyle Behaviors ◽  
Individual Level ◽  
Diet And Physical Activity ◽  
Healthy Lifestyle Behaviors

This study examined individual-level determinants of self-reported changes in healthy (diet and physical activity) and addictive (alcohol use, smoking, and vaping) lifestyle behaviors during the initial COVID-19 lockdown period in the USA. A national online survey was administered between May and June 2020 that targeted a representative U.S. sample and yielded data from 1276 respondents, including 58% male and 50% racial/ethnic minorities. We used univariate and multivariable linear regression models to examine the associations of sociodemographic, mental health, and behavioral determinants with self-reported changes in lifestyle behaviors. Some study participants reported increases in healthy lifestyle behaviors since the pandemic (i.e., 36% increased healthy eating behaviors, and 33% increased physical activity). However, they also reported increases in addictive lifestyle behaviors including alcohol use (40%), tobacco use (41%), and vaping (46%). With regard to individual-level determinants, individuals who reported adhering to social distancing guidelines were also more likely to report increases in healthy lifestyle behaviors (β = 0.12, 95% CI 0.04 to 0.21). Conversely, women (β = −0.37, 95% CI −0.62 to −0.12), and unemployed individuals (β = −0.33, 95% CI −0.64 to −0.02) were less likely to report increases in healthy lifestyle behaviors. In addition, individuals reporting anxiety were more likely to report increases in addictive behaviors (β = 0.26, 95% CI 0.09 to 0.43). Taken together, these findings suggest that women and unemployed individuals may benefit from interventions targeting diet and physical activity, and that individuals reporting anxiety may benefit from interventions targeting smoking and alcohol cessation to address lifestyle changes during the pandemic.

Sign in / Sign up

Export Citation Format

Share Document