scholarly journals Collecting Online Survey Data: A Comparison of Data Quality among a Commercial Panel & MTurk

2020 ◽  
Vol 13 (1) ◽  
pp. 1-10 ◽  
Author(s):  
Bingbing Zhang ◽  
Sherice Gearhart
2021 ◽  
pp. 000276422110216
Author(s):  
Kazimierz M. Slomczynski ◽  
Irina Tomescu-Dubrow ◽  
Ilona Wysmulek

This article proposes a new approach to analyze protest participation measured in surveys of uneven quality. Because single international survey projects cover only a fraction of the world’s nations in specific periods, researchers increasingly turn to ex-post harmonization of different survey data sets not a priori designed as comparable. However, very few scholars systematically examine the impact of the survey data quality on substantive results. We argue that the variation in source data, especially deviations from standards of survey documentation, data processing, and computer files—proposed by methodologists of Total Survey Error, Survey Quality Monitoring, and Fitness for Intended Use—is important for analyzing protest behavior. In particular, we apply the Survey Data Recycling framework to investigate the extent to which indicators of attending demonstrations and signing petitions in 1,184 national survey projects are associated with measures of data quality, controlling for variability in the questionnaire items. We demonstrate that the null hypothesis of no impact of measures of survey quality on indicators of protest participation must be rejected. Measures of survey documentation, data processing, and computer records, taken together, explain over 5% of the intersurvey variance in the proportions of the populations attending demonstrations or signing petitions.


2020 ◽  
Vol 11 ◽  
Author(s):  
Hollis C. Karoly ◽  
Raeghan L. Mueller ◽  
Chrysta C. Andrade ◽  
Kent E. Hutchison

Cannabis is commonly used among people who drink alcohol, but findings are mixed regarding the direction of this relationship. The type of cannabis used [high-cannabidiol (CBD) vs. high-delta-9tetrahydrocannabinol (THC)] and motives for use (i.e., whether cannabis is used to treat a medical condition) may influence the relationship between cannabis and drinking. Specifically, CBD has shown preclinical promise in reducing alcohol consumption, and medical cannabis users report using cannabis to reduce drinking. This study leverages survey data from cannabis users who drink alcohol (N = 533). Respondents were categorized as using cannabis to treat (CTT) a medical condition or as individuals whose cannabis use is not intended to treat (NCTT) a medical condition and grouped based on the THC/CBD ratio of the flower or edible cannabis they typically use (e.g., “High-THC/CBD,” “Medium-THC/CBD” and “Low-THC/CBD”). The CTT group (n = 412) reported drinking significantly less frequently than the NCTT group (n = 121). Cannabinoid content of flower cannabis was associated with alcohol consumed on cannabis-use days, such that individuals in the High-THC/CBD group drink more on cannabis-use days compared to the Medium-THC/CBD group. Cannabinoid content of edible cannabis was associated with drinks per drinking occasion, such that the High-THC/CBD group consumed the most drinks and the Low-THC/CBD group consumed the fewest. For both edible and flower groupings, higher-THC/CBD cannabis was associated with more frequent co-use than lower-THC/CBD cannabis. Results suggest that whether someone uses cannabis to treat a medical condition may impact their drinking frequency, and the cannabinoid content in flower and edible cannabis impacts alcohol consumption.


2021 ◽  
pp. 147078532098679
Author(s):  
Kylie Brosnan ◽  
Bettina Grün ◽  
Sara Dolnicar

Survey data quality suffers when respondents have difficulty completing complex tasks in questionnaires. Cognitive load theory informed the development of strategies for educators to reduce the cognitive load of learning tasks. We investigate whether these cognitive load reduction strategies can be used in questionnaire design to reduce task difficulty and, in so doing, improve survey data quality. We find that this is not the case and conclude that some of the traditional survey answer formats, such as grid questions, which have been criticized in the past lead to equally good data and do not frustrate respondents more than alternative formats.


2021 ◽  
pp. 1689-1698
Author(s):  
Abdul Hafaz Ngah ◽  
Nurul Izni Kamalrulzaman ◽  
Fauzayani Ibrahim ◽  
Noor Azuan Abu Osman ◽  
Nur Asma Ariffin

This study aims to investigate the effect of soft skills and ethics and value on the employers’ willingness to continue recruiting Universiti Malaysia Terengganu (UMT) graduates, together with the moderating effect of knowledge on the relationship between soft skills and the employers’ willingness to continue recruiting UMT graduates. The study’s respondents comprised of 208 employers in Malaysia who responded through an online survey using Google Forms. The survey data was then analyzed using the Partial Least Squares Structural Equation Modelling (PLS-SEM), indicating that soft skills positively affected the employers’ willingness to continue recruiting UMT graduates. Nevertheless, ethics and value were found to be insignificant factors on the employers’ willingness to continue recruiting UMT graduates. It was also revealed that knowledge had the moderating effect on the relationship between soft skills and the employers’ willingness to continue recruiting UMT graduates. Therefore, universities were recommended to invest in soft skills and knowledge education to ensure that graduates met the employers’ professional recruitment standards in areas of expertise.


2020 ◽  
Vol 2 (2) ◽  
pp. 233-248
Author(s):  
Abednego Stephen ◽  
◽  
Athluna Canthika ◽  
Davin Subrata ◽  
Devina Veronika ◽  
...  

Advertisement is one of the most common way to promote and create awareness of a product. However it is still uncertain to measure the effect of advertisement, especially on customer’s buying decision. The objective of this paper is to identify how much advertisement impacts on consumers buying decision. The research uses quantitative analysis by analyzing online survey data gathered from 280 respondent across Jabodetabek (Jakarta, Bogor, Depok, Tangerang, Bekasi). Statistical method such as correlation analysis, descriptive statistics, and regression analysis was used and the result from 244 valid respondents showed that the independent variable brand recall and stimulation have an impact on consumers’ buying decision while the other three variables which are necessity, pleasure, and dominance do not have an impact on consumers’ buying decision.


Author(s):  
Kristina M. Kays ◽  
Tashina L. Keith ◽  
Michael T. Broughal

This chapter addresses the main considerations in online survey research with sensitive topics. Advances in technology have allowed numerous options in addressing survey design, and thus created a need to evaluate and consider best approaches when using online survey research. This chapter identifies subjects such as item non-response in online survey research. In addition, this chapter includes a description of the differences in researching non-sensitive topics versus sensitive topics, and then lists a number of best practice strategies to reduce item non-response and improve the quality of survey data obtained. Included are specific considerations for defining sensitive topics and addressing gender differences when surveying more sensitive material. Additional resources in online survey research design are recommended.


2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Anna Graves ◽  
Deirdre McLaughlin ◽  
Janni Leung ◽  
Jennifer Powers

Abstract Background Consent to link survey data with health-related administrative datasets is increasingly being sought but little is known about the influence of recruiting via online technologies on participants’ consents. The goal of this paper is to examine what factors (sociodemographic, recruitment, incentives, data linkage information, health) are associated with opt-in consent to link online survey data to administrative datasets (referred to as consent to data linkage). Methods The Australian Longitudinal Study on Women’s Health is a prospective study of factors affecting the health and well-being of women. We report on factors associated with opt-in consent to data linkage at the end of an online survey of a new cohort of 18–23 year old Australian women recruited in 2012–13. Classification and Regression Tree analysis with decision trees was used to predict consent. Results In this study 69% consented to data linkage. The provision of residential address by the individual, or not (as a measure of attitudes towards privacy), was the most important factor in classifying the data into similar groups of consenters (76% consenters versus 47% respectively). Thereafter, for those who did not provide their residential address, the incentives and data linkage information that was offered was the next most important factor, with incentive 2: limited-edition designer leggings and additional information about confidentiality showing increases in consent rates over Incentive 1: AUD50 gift voucher: 60% versus 37%. Conclusions In young Australian women, attitudes towards privacy was strongly associated with consenting to data linkage. Providing additional details about data confidentiality was successful in increasing consent and so was cohort appropriate incentives. Ensuring that prospective participants understand the consent and privacy protocols in place to protect their confidential information builds confidence in consenting to data linkage.


Sign in / Sign up

Export Citation Format

Share Document