How Errors Cumulate: Two Examples

2019 ◽  
Vol 8 (3) ◽  
pp. 413-432
Author(s):  
Roger Tourangeau

Abstract This article examines the relationship among different types of nonobservation errors (all of which affect estimates from nonprobability internet samples) and between nonresponse and measurement errors. Both are examples of how different error sources can interact. Estimates from nonprobability samples seem to have more total error than estimates from probability samples, even ones with very low response rates. This finding suggests that the combination of coverage, selection, and nonresponse errors has greater cumulative effects than nonresponse error alone. The probabilities of having internet access, joining an internet panel, and responding to a particular survey request are probably correlated and, as a result, may lead to greater covariances with survey variables than response propensities alone; the biases accentuate one another. With nonresponse and measurement error, the two sources seem more or less uncorrelated, with one exception—those most prone to social desirability bias (those in the undesirable categories) are also less likely to respond. In addition, the propensity for unit nonresponse seems to be related to item nonresponse.

Field Methods ◽  
2019 ◽  
Vol 31 (2) ◽  
pp. 95-115
Author(s):  
Aigul Mavletova ◽  
Peter Lynn

The article examines two important aspects of data quality in self-completion surveys of young people, taking advantage of a unique data source: Understanding Society: the United Kingdom Household Longitudinal Study. Young persons aged 10–15 are asked to complete a self-administered paper questionnaire at annual intervals. The number of completed interviews varies over waves from 4,049 to 5,020. Data are also collected from parents, providing important explanatory covariates for our analysis. Stronger parent–child relationship and higher mother’s involvement in education were associated with lower item nonresponse rate and lower inconsistency throughout waves. We also found some evidence for a negative panel conditioning effect with an increase of social desirability bias and measurement errors in the subsequent waves. There was a higher level of inconsistent responses and a higher probability of social desirability bias throughout waves in more sensitive items.


2019 ◽  
Vol 8 (3) ◽  
pp. 442-452
Author(s):  
Kristen Olson

Abstract This paper provides a discussion of the Tourangeau (2019) Morris Hansen Lecture paper. I address issues related to compounding errors in web surveys and the relationship between nonresponse and measurement errors. I provide a potential model for understanding when error sources in nonprobability web surveys may compound or counteract one other. I also provide three conceptual models that help explicate the joint relationship between nonresponse and measurement errors.


2019 ◽  
Vol 8 (5) ◽  
pp. 877-902 ◽  
Author(s):  
Mengyao Hu ◽  
John A Kirlin ◽  
Brady T West ◽  
Wenyi He ◽  
Ai Rene Ong ◽  
...  

Abstract Diary surveys are used to collect data on a variety of topics, including health, time use, nutrition, and expenditures. The US National Household Food Acquisition and Purchase Survey (FoodAPS) is a nationally representative diary survey, providing an important data source for decision-makers to design policies and programs for promoting healthy lifestyles. Unfortunately, a multiday diary survey like the FoodAPS can be subject to various survey errors, especially item nonresponse error occurring at the day level. The FoodAPS public-use data set provides survey weights that adjust only for unit nonresponse. Due to the lack of day-level weights (which could possibly adjust for the item nonresponse that arises from refusals on particular days), the adjustments for unit nonresponse are unlikely to correct any bias in estimates arising from households that initially agree to participate in FoodAPS but then fail to report on particular days. This article develops a general methodology for estimating the extent of underreporting due to this type of item nonresponse error in diary surveys, using FoodAPS as a case study. We describe a methodology combining bootstrap replicate sampling for complex samples and imputation based on a Heckman selection model to predict food expenditures for person-days with missing expenditures. We estimated the item nonresponse error by comparing weighted estimates according to only reported expenditures and both reported expenditures and predictions for missing values. Results indicate that ignoring the missing data would lead to consistent overestimation of the mean expenditures and events per person per day and underestimation of the total expenditures and events. Our study suggests that the household-level weights, which generally account for unit nonresponse, may not be entirely sufficient for addressing the nonresponse occurring at the day level in diary surveys, and proper imputation methods will be important for estimating the size of the underreporting.


2019 ◽  
Vol 8 (1) ◽  
pp. 62-88
Author(s):  
Jennifer Unangst ◽  
Ashley E Amaya ◽  
Herschel L Sanders ◽  
Jennifer Howard ◽  
Abigail Ferrell ◽  
...  

Abstract As survey methods evolve, researchers require a comprehensive understanding of the error sources in their data. Comparative studies, which assess differences between the estimates from emerging survey methods and those from traditional surveys, are a popular tool for evaluating total error; however, they do not provide insight on the contributing error sources themselves. The Total Survey Error (TSE) framework is a natural fit for evaluations that examine survey error components across multiple data sources. In this article, we present a case study that demonstrates how the TSE framework can support both qualitative and quantitative evaluations comparing probability and nonprobability surveys. Our case study focuses on five internet panels that are intended to represent the US population and are used to measure health statistics. For these panels, we analyze the total survey error in two ways: (1) using a qualitative assessment that describes how panel construction and management methods may introduce error and (2) using a quantitative assessment that estimates and partitions the total error for two probability-based panels into coverage error and nonresponse error. This work can serve as a “proof of concept” for how the TSE framework may be applied to understand and compare the error structure of probability and nonprobability surveys. For those working specifically with internet panels, our findings will further provide an example of how researchers may choose the panel option best suited to their study aims and help vendors prioritize areas of improvement.


2020 ◽  
Vol 3 (2) ◽  
pp. 342-350
Author(s):  
Suparna Parwodiwiyono

Abstrak: Bagi generasi pasca milenial penggunaan internet sangat akrab tetapi dengan berbagai tujuan penggunaan. Penelitian ini ingin melihat keterkaitan penggunaan internet oleh penduduk yang sedang sekolah untuk kepentingan penyelesaian tugas sekolah di Indonesia untuk mendapatkan hasil belajar yang baik. Analisis berdasarkan data sekunder dari Survei Sosial Ekonomi Nasional tahun 2018. Hanya saja data yang didapatkan tidak simetris dengan adanya pencilan. Regresi kuantil digunakan untuk meminimumkan pengaruh dari pencilan yang ada. Penelitian mendapatkan hasil bahwa terdapat kaitan yang erat antara akses internet dari penduduk yang sedang sekolah dengan penyelesaian tugas sekolah.  Hasil regresi kuantil menunjukkan bahwa proporsi akses internet untuk penyelesaian tugas sekolah berbeda antar golongan proporsi penggunaan internet. Proporsi penggunaan internet yang tinggi akan digunakan untuk penyelesaian tugas sekolah yang lebih tinggi pula. Abstract: For the post millennial generation the use of the internet is very familiar but with various purposes of use. This study wants to look at the relationship between the use of the internet by residents who are currently in school for the sake of completing school work in Indonesia to get good learning outcomes. Analysis based on secondary data from the 2018 National Socio-Economic Survey. It's just that the data obtained is not symmetrical with outliers. Quantile regression is used to minimize the effect of outliers. The study found that there was a close relationship between internet access from residents who were in school and completion of school work. The quantile regression results show that the proportion of internet access for completing school work differs between groups of proportions of internet use. A high proportion of internet use will be used for completing higher school work.


Author(s):  
Вадим Леонидович Афанасьевский

В статье анализируется проблема взаимоотношений философии права и научной теории права. Рассматриваемая проблема стала особенно актуальной в российском образовательном пространстве в связи с введением после длительного перерыва в государственный образовательный стандарт магистратуры по юриспруденции учебной дисциплины «Философия права». Автор статьи в качестве базисного принимает тезис, согласно которому философия права, являясь сферой философской мысли, и теория права как область научного социогуманитарного знания представляют собой разные типы теоретического дискурса. Исходя из этого, в статье выстраивается теоретическая концепция, согласно которой задачей философии права как философского типа мышления является конструирование или экспликация онтологических, эпистемологических, аксиологических, феноменологических оснований для формирования и функционирования научных теоретико-правовых и историко-правовых построений. Для реализации поставленной в статье задачи подробно рассматриваются ключевые характеристики как теории философского типа, так и идеалов, норм и характеристик научного знания. Выявленное различие экстраполируется на взаимоотношение теории права как продукта научного творчества и философии права как конструкции, задающей базовые мировоззренческие смыслы. В качестве примера выработанных философией права и государства оснований научных теорий прогресса, государства, морали и права, автор приводит взгляды мыслителей западноевропейской философской классики: Т. Гоббса, Ж.-Ж. Руссо, И. Канта, Г.В.Ф. Гегеля. Именно их философские концепции предопределили образы теоретико- и историко-правовых учений XVIII, XIX, XX и даже начала XXI в. Таким образом, отношение философии права и теории права выстраивается по «вертикали»: от онтологического основания к возведению теоретико-правовых и историко-правовых научных построений. The article analyzes the problem of the relationship between the philosophy of law and the scientific theory of law. The problem under consideration has become especially urgent in the Russian educational space in connection with the introduction of the Philosophy of Law discipline master's degree in law after a long break. The author of the article takes as the basis the thesis that the philosophy of law, being the sphere of philosophical thought, and the theory of law as a field of scientific socio-humanitarian knowledge are different types of theoretical discourse. Based on this, the article builds a theoretical concept according to which the task of the philosophy of law as a philosophical type of thinking is the construction or explication of ontological, epistemological, axiological, phenomenological grounds for the formation and functioning of concrete scientific theoretical and legal and historical and legal constructions. To implement the task posed in the article, the key characteristics of both a theory of a philosophical type and ideals, norms and characteristics of scientific knowledge are examined in detail. The revealed difference is extrapolated to the relationship between the theory of law as a product of scientific creativity and the philosophy of law as a construction that sets basic philosophical meanings. As an example of the foundations of the scientific theories of progress, state, morality and law developed by the philosophy of law and the state, the author gives the views and thinkers of the West European philosophical classics T. Hobbes, J.-J. Russo, I. Kant, G.V.F. Hegel. It was their philosophical concepts that predetermined the images of theoretical and historical-legal doctrines of the XVIII, XIX, XX and even the beginning of the XXI centuries. Thus, the attitude of the philosophy of law and the theory of law is built along the «vertical»: from the ontological foundation to the construction of theoretical and historical and historical legal scientific constructions.


Author(s):  
Mary Kay Gugerty ◽  
Dean Karlan

Without high-quality data, even the best-designed monitoring and evaluation systems will collapse. Chapter 7 introduces some the basics of collecting high-quality data and discusses how to address challenges that frequently arise. High-quality data must be clearly defined and have an indicator that validly and reliably measures the intended concept. The chapter then explains how to avoid common biases and measurement errors like anchoring, social desirability bias, the experimenter demand effect, unclear wording, long recall periods, and translation context. It then guides organizations on how to find indicators, test data collection instruments, manage surveys, and train staff appropriately for data collection and entry.


2019 ◽  
Vol 25 (14) ◽  
pp. 1696-1716 ◽  
Author(s):  
Ida Frugaard Stroem ◽  
Helene Flood Aakvaag ◽  
Tore Wentzel-Larsen

This study investigates the relationship between the characteristics of different types of childhood violence and adult victimization using two waves of data from a community telephone survey (T1) and a follow-up survey, including 505 cases and 506 controls, aged 17-35 years (T2). The logistic regression analyses showed that exposure to childhood abuse, regardless of type, was associated with adult victimization. Exposure to multiple types of abuse, victimization both in childhood and in young adulthood, and recency of abuse increased these odds. Our findings emphasize the importance of assessing multiple forms of violence when studying revictimization. Practitioners working with children and young adults should be attentive to the number of victimization types experienced and recent victimization to prevent further abuse.


Biomolecules ◽  
2021 ◽  
Vol 11 (7) ◽  
pp. 1021
Author(s):  
Carla Abrahamian ◽  
Christian Grimm

Microphthalmia-associated transcription factor (MITF) is the principal transcription factor regulating pivotal processes in melanoma cell development, growth, survival, proliferation, differentiation and invasion. In recent years, convincing evidence has been provided attesting key roles of endolysosomal cation channels, specifically TPCs and TRPMLs, in cancer, including breast cancer, glioblastoma, bladder cancer, hepatocellular carcinoma and melanoma. In this review, we provide a gene expression profile of these channels in different types of cancers and decipher their roles, in particular the roles of two-pore channel 2 (TPC2) and TRPML1 in melanocytes and melanoma. We specifically discuss the signaling cascades regulating MITF and the relationship between endolysosomal cation channels, MAPK, canonical Wnt/GSK3 pathways and MITF.


2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Sarah E. Knowles ◽  
Dawn Allen ◽  
Ailsa Donnelly ◽  
Jackie Flynn ◽  
Kay Gallacher ◽  
...  

Abstract Background Knowledge mobilisation requires the effective elicitation and blending of different types of knowledge or ways of knowing, to produce hybrid knowledge outputs that are valuable to both knowledge producers (researchers) and knowledge users (health care stakeholders). Patients and service users are a neglected user group, and there is a need for transparent reporting and critical review of methods used to co-produce knowledge with patients. This study aimed to explore the potential of participatory codesign methods as a mechanism of supporting knowledge sharing, and to evaluate this from the perspective of both researchers and patients. Methods A knowledge mobilisation research project using participatory codesign workshops to explore patient involvement in using health data to improve services. To evaluate involvement in the project, multiple qualitative data sources were collected throughout, including a survey informed by the Generic Learning Outcomes framework, an evaluation focus group, and field notes. Analysis was a collective dialogic reflection on project processes and impacts, including comparing and contrasting the key issues from the researcher and contributor perspectives. Results Authentic involvement was seen as the result of “space to talk” and “space to change”. "Space to talk" refers to creating space for shared dialogue, including space for tension and disagreement, and recognising contributor and researcher expertise as equally valuable to the discussion. ‘Space to change’ refers to space to adapt in response to contributor feedback. These were partly facilitated by the use of codesign methods which emphasise visual and iterative working, but contributors emphasised that relational openness was more crucial, and that this needed to apply to the study overall (specifically, how contributors were reimbursed as a demonstration of how their input was valued) to build trust, not just to processes within the workshops. Conclusions Specific methods used within involvement are only one component of effective involvement practice. The relationship between researcher and contributors, and particularly researcher willingness to change their approach in response to feedback, were considered most important by contributors. Productive tension was emphasised as a key mechanism in leading to genuinely hybrid outputs that combined contributor insight and experience with academic knowledge and understanding.


Sign in / Sign up

Export Citation Format

Share Document