Split-Sample Design with Parallel Protocols to Reduce Cost and Nonresponse Bias in Surveys

2019 ◽  
Vol 8 (4) ◽  
pp. 748-771
Author(s):  
Andy Peytchev
Keyword(s):  
Variance Estimation ◽  
Survey Methods ◽  
Bias Reduction ◽  
Nonresponse Bias ◽  
Future Research ◽  
Monetary Incentives ◽  
Survey Costs ◽  
Survey Estimates ◽  
Using Data ◽  
Main Barrier

Abstract Response rates in household surveys are declining, increasing the risk of nonresponse bias in survey estimates. Survey costs are increasing. As a result, design features such as higher monetary incentives are needed but often cannot be afforded. Two or more survey protocols could be implemented in parallel, where some have lower nonresponse while others have lower cost, as long as the data can be combined in a way that reflects the reduced potential for nonresponse bias under the more intensive protocol. We describe the main barrier to the use of such an approach—that traditional methods ignore the expected lower bias in one condition. The proposed approach includes random assignment of sample members to a data collection protocol and adjustment of survey estimates to the superior protocol, based on key survey variables—if differences in estimates are found. This represents a major departure from the current practice in constructing nonresponse adjustments and leverages the use of the same sampling design, survey instrument, and measurement procedures in each condition. An illustrative example is presented using data from a national survey. Methods to address both bias reduction and variance estimation are described. We end with limitations and suggestions for future research.

Using Response Propensity Modeling to Allocate Noncontingent Incentives in an Address-Based Sample: Evidence from a National Experiment

2019 ◽  
Vol 8 (2) ◽  
pp. 385-411
Author(s):  
Michael T Jackson ◽  
Cameron B McPhee ◽  
Paul J Lavrakas
Keyword(s):  
Response Rate ◽  
Survey Response ◽  
Nonresponse Bias ◽  
Monetary Incentives ◽  
Entire Sample ◽  
Ethical Concerns ◽  
Response Propensity ◽  
Using Data ◽  
National Household Education Survey ◽  
Probability Of Response

Abstract Monetary incentives are frequently used to improve survey response rates. While it is common to use a single incentive amount for an entire sample, allowing the incentive to vary inversely with the expected probability of response may help to mitigate nonresponse and/or nonresponse bias. Using data from the 2016 National Household Education Survey (NHES:2016), an address-based sample (ABS) of US households, this article evaluates an experiment in which the noncontingent incentive amount was determined by a household’s predicted response propensity (RP). Households with the lowest RP received $10, those with the highest received $2 or $0, and those in between received the standard NHES incentive of $5. Relative to a uniform $5 protocol, this “tailored” incentive protocol slightly reduced the response rate and had no impact on observable nonresponse bias. These results serve as an important caution to researchers considering the targeting of incentives or other interventions based on predicted RP. While preferable in theory to “one-size-fits-all” approaches, such differential designs may not improve recruitment outcomes without a dramatic increase in the resources devoted to low RP cases. If budget and/or ethical concerns limit the resources that can be devoted to such cases, RP-based targeting could have little practical benefit.

scholarly journals Heritability and genetic variance estimation of Osteosarcoma (OSA) in Irish Wolfhound, using deep pedigree information

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Mehdi Momen ◽  
Nyah L. Kohler ◽  
Emily E. Binversie ◽  
Mariellen Dentino ◽  
Susannah J. Sample
Keyword(s):  
Genetic Variance ◽  
Variance Estimation ◽  
Pedigree Information ◽  
Future Research ◽  
Genetic Mutations ◽  
Using Data ◽  
Estimated Heritability

Abstract Background Osteosarcoma (OSA) is a devastating disease that is common in the Irish Wolfhound breed. The aim of this study was to use a pedigree-based approach to determine the heritability of OSA in the Irish Wolfhound using data from a large publically available database. Results The pedigree used for this study included 5110 pure-bred Irish Wolfhounds, including 332 dogs diagnosed with OSA and 360 control dogs; dogs were considered controls if they lived over 10 years of age and were not reported to have developed OSA. The estimated heritability of OSA in the Irish Wolfhound was 0.65. Conclusion The results of this study indicate that OSA in the Irish Wolfhound is highly heritable, and support the need for future research investigating associated genetic mutations.

Consequences of Survey Nonresponse

2012 ◽  
Vol 645 (1) ◽  
pp. 88-111 ◽  
Author(s):  
Andy Peytchev
Keyword(s):  
Survey Data ◽  
Mixed Mode ◽  
Nonresponse Bias ◽  
Sample Surveys ◽  
Survey Nonresponse ◽  
Auxiliary Data ◽  
Sources Of Error ◽  
Survey Costs ◽  
Survey Estimates

Nonresponse is a prominent problem in sample surveys. At face value, it reduces the trust in survey estimates. Nonresponse undermines the probability-based inferential mechanism and introduces the potential for nonresponse bias. In addition, there are other important consequences. The effort to limit increasing nonresponse has led to higher survey costs—allocation of greater resources to measure and reduce nonresponse. Nonresponse has also led to greater survey complexity in terms of design, implementation, and processing of survey data, such as the use of multiphase and responsive designs. The use of mixed-mode and multiframe designs to address nonresponse increases complexity but also introduces other sources of error. Surveys have to rely to a greater extent on statistical adjustments and auxiliary data. This article describes the major consequences of survey nonresponse, with particular attention to recent years.

scholarly journals Inconsistent Regression and Nonresponse Bias: Exploring Their Relationship as a Function of Response Imbalance

2017 ◽  
Vol 33 (3) ◽  
pp. 709-734 ◽  
Author(s):  
Carl-Erik Särndal ◽  
Peter Lundquist
Keyword(s):  
Data Collection ◽  
Survey Design ◽  
Empirical Work ◽  
Auxiliary Information ◽  
Response Strength ◽  
Bias Reduction ◽  
Point Of View ◽  
Nonresponse Bias ◽  
Survey Estimates ◽  
Adaptive Data Collection

Abstract One objective of adaptive data collection is to secure a better balanced survey response. Methods exist for this purpose, including balancing with respect to selected auxiliary variables. Such variables are also used at the estimation stage for (calibrated) nonresponse weighting adjustment. Earlier research has shown that the use of auxiliary information at the estimation stage can reduce bias, perhaps considerably, but without eliminating it. The question is: would it have contributed further to bias reduction if, prior to estimation, that information had also been used in data collection, to secure a more balanced set of respondents? If the answer is yes, there is clear incentive, from the point of view of better accuracy in the estimates, to practice adaptive survey design, otherwise perhaps not. A key question is how the regression relationship between the survey variable and the auxiliary vector presents itself in the sample as opposed to the response. Strength in the relationship is helpful but is not the only consideration. The dilemma with nonresponse is one of inconsistent regression: a regression model appropriate for the sample often fails for the responding subset, because nonresponse is selective, non-random. In this article, we examine how nonresponse bias in survey estimates depends on regression inconsistency, both seen as functions of response imbalance. As a measure of bias we use the deviation of the calibration adjusted estimator from the unbiased estimate under full response. We study how the deviation and the regression inconsistency depend on the imbalance. We observe in empirical work that both can be reduced, to a degree, by efforts to reduce imbalance by an adaptive data collection.

Workplace Ostracism and Its Negative Outcomes

2016 ◽  
Vol 15 (4) ◽  
pp. 143-151 ◽  
Author(s):  
Xiaoming Zheng ◽  
Jun Yang ◽  
Hang-Yue Ngo ◽  
Xiao-Yu Liu ◽  
Wengjuan Jiao
Keyword(s):  
Affective Commitment ◽  
Psychological Capital ◽  
Intention To Leave ◽  
Future Research ◽  
Conservation Of Resources ◽  
Negative Consequences ◽  
Negative Outcomes ◽  
Workplace Ostracism ◽  
Using Data ◽  
The Relationship

Abstract. Workplace ostracism, conceived as to being ignored or excluded by others, has attracted the attention of researchers in recent years. One essential topic in this area is how to reduce or even eliminate the negative consequences of workplace ostracism. Based on conservation of resources (COR) theory, the current study assesses the relationship between workplace ostracism and its negative outcomes, as well as the moderating role played by psychological capital, using data collected from 256 employees in three companies in the northern part of China. The study yields two important findings: (1) workplace ostracism is positively related to intention to leave and (2) psychological capital moderates the effect of workplace ostracism on affective commitment and intention to leave. This paper concludes by discussing the implications of these findings for organizations and employees, along with recommendations for future research.

Siblings and Illness

2011 ◽  
Vol 7 ◽  
Author(s):  
Leah Sawyer Vanderwerp
Keyword(s):  
Depressive Symptoms ◽  
Birth Order ◽  
Family Size ◽  
Multivariate Analyses ◽  
Social Role ◽  
Chronically Ill ◽  
Demographic Variables ◽  
Future Research ◽  
Mother And Child ◽  
Using Data

Using data from the National Longitudinal Survey of Youth-Mother and Child samples, I investigated the relationships among child and adolescent depressive symptoms, having a chronically ill sibling, and other child and familial demographic variables. From research on social support and social role transitions, with the Stress Process as a theoretical model, I hypothesized that children with chronically ill siblings experience more depressive symptoms. Specifically, I looked at age, gender, birth order and family size as potentially reducing the effect size of having a chronically ill sibling. Findings showed that having a chronically ill sibling is associated with demonstrating more depressive symptoms both in the bivariate and multivariate analyses. Although age, gender, birth order and family size do not interact significantly with having a chronically ill sibling in predicting depressive symptoms, they do present interesting findings about childhood depressive symptoms in general. Thus, the results of this study suggest specific and meaningful paths for future research.

Reaching Spanish-Speakers in Self-Administered Surveys

2019 ◽  
Vol 3 (4) ◽  
Author(s):  
J Michael Brick ◽  
Andrew Caporaso ◽  
Douglas Williams ◽  
David Cantor
Keyword(s):  
Single Phase ◽  
Spanish Language ◽  
Spanish Speakers ◽  
English Speakers ◽  
Future Research ◽  
The Internet ◽  
English Only ◽  
Eligible Population ◽  
The Us ◽  
Survey Estimates

Decisions on public policy can be affected if important segments of the population are systematically excluded from the data used to drive the decisions. In the US, Spanishspeakers make up an important subgroup that surveys conducted in English-only underrepresent. This subgroup differs in a variety of characteristics and they are less likely to respond to surveys in English-only. These factors lead to nonresponse biases that are problematic for survey estimates. For surveys conducted by mail, one solution is to include both English and Spanish materials in the survey package. For addresses in the US where Spanish-speakers are likely to be living, this approach is effective, but it still may omit some non-English-speakers. Traditionally, including both English and Spanish materials for addresses not identified as likely to have Spanish-speakers was considered problematic due to concerns of a backlash effect. The backlash effect is that predominantly English-speakers might respond at a lower rate because of the inclusion of Spanish materials. Prior research found no evidence of a backlash, but used a twophase approach with a short screener questionnaire to identify the eligible population for an education survey. In this paper, we report on experiments in two surveys that extend the previous research to criminal victimization and health communication single-phase surveys. These experiments test the effect of the inclusion of Spanish language materials for addresses not identified as likely to have Spanish-speakers. Our findings confirm most results of the previous research; however we find no substantial increase in Spanish-only participation when the materials are offered in both languages for addresses that are not likely to have Spanish-speakers. We offer some thoughts on these results and directions for future research, especially with respect to collecting data by the Internet.

scholarly journals Secondary School Teachers’ Professional Development in Australia and Shanghai: Needs, Support, and Barriers

SAGE Open ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. 215824402110269
Author(s):  
Guangbao Fang ◽  
Philip Wing Keung Chan ◽  
Penelope Kalogeropoulos
Keyword(s):  
Professional Development ◽  
Teaching And Learning ◽  
Secondary School Teachers ◽  
New Technology ◽  
Development Program ◽  
Future Research ◽  
Information And Communication ◽  
Using Data ◽  
Teachers Professional Development ◽  
Scheduled Time

Using data from the Teaching and Learning International Survey (TALIS; 2013), this article explores teachers’ needs, support, and barriers in their professional development. The research finds that Australian teachers expressed greater needs in information and communication technology (ICT) use and new technology training for teaching, while Shanghai teachers required more assistance to satisfy students’ individual learning and pedagogical competencies. More than 80% of Australian and Shanghai teachers received scheduled time to support their participation in professional development, whereas less than 20% of Australian and Shanghai teachers received monetary or nonmonetary support. In terms of barriers, Australian and Shanghai teachers reported two significant barriers that conflicted with their participation in professional development: “working schedule” and “a lack of incentives to take part.” This article reveals implications of the study in the design of an effective professional development program for Australian and Shanghai teachers and ends with discussing the limitations of the research and future research directions.

How Collective-Action Failure Shapes Group Heterogeneity and Engagement in Conventional and Radical Action Over Time

2021 ◽  
pp. 095679762097056
Author(s):  
Morgana Lizzio-Wilson ◽  
Emma F. Thomas ◽  
Winnifred R. Louis ◽  
Brittany Wilcockson ◽  
Catherine E. Amiot ◽  
...  
Keyword(s):  
Social Movements ◽  
Collective Action ◽  
Latent Profile Analysis ◽  
Profile Analysis ◽  
Social Identification ◽  
Future Research ◽  
Group Efficacy ◽  
Before And After ◽  
Using Data ◽  
Over Time

Extensive research has identified factors influencing collective-action participation. However, less is known about how collective-action outcomes (i.e., success and failure) shape engagement in social movements over time. Using data collected before and after the 2017 marriage-equality debate in Australia, we conducted a latent profile analysis that indicated that success unified supporters of change ( n = 420), whereas failure created subgroups among opponents ( n = 419), reflecting four divergent responses: disengagement (resigned acceptors), moderate disengagement and continued investment (moderates), and renewed commitment to the cause using similar strategies (stay-the-course opponents) or new strategies (innovators). Resigned acceptors were least inclined to act following failure, whereas innovators were generally more likely to engage in conventional action and justify using radical action relative to the other profiles. These divergent reactions were predicted by differing baseline levels of social identification, group efficacy, and anger. Collective-action outcomes dynamically shape participation in social movements; this is an important direction for future research.

xtgeebcv: A command for bias-corrected sandwich variance estimation for GEE analyses of cluster randomized trials

2020 ◽  
Vol 20 (2) ◽  
pp. 363-381 ◽  
Author(s):  
John A. Gallis ◽  
Fan Li ◽  
Elizabeth L. Turner
Keyword(s):  
Randomized Trials ◽  
Variance Estimation ◽  
Public Health Education ◽  
Standard Errors ◽  
Future Research ◽  
Type I ◽  
Cluster Randomized Trials ◽  
Finite Sample ◽  
Individual Level ◽  
Cluster Randomized

Cluster randomized trials, where clusters (for example, schools or clinics) are randomized to comparison arms but measurements are taken on individuals, are commonly used to evaluate interventions in public health, education, and the social sciences. Analysis is often conducted on individual-level outcomes, and such analysis methods must consider that outcomes for members of the same cluster tend to be more similar than outcomes for members of other clusters. A popular individual-level analysis technique is generalized estimating equations (GEE). However, it is common to randomize a small number of clusters (for example, 30 or fewer), and in this case, the GEE standard errors obtained from the sandwich variance estimator will be biased, leading to inflated type I errors. Some bias-corrected standard errors have been proposed and studied to account for this finite-sample bias, but none has yet been implemented in Stata. In this article, we describe several popular bias corrections to the robust sandwich variance. We then introduce our newly created command, xtgeebcv, which will allow Stata users to easily apply finite-sample corrections to standard errors obtained from GEE models. We then provide examples to demonstrate the use of xtgeebcv. Finally, we discuss suggestions about which finite-sample corrections to use in which situations and consider areas of future research that may improve xtgeebcv.

Sign in / Sign up

Export Citation Format

Share Document