1376Modern concepts in the handling and reporting of missing data

Abstract Focus and outcomes for participants Missing data are ubiquitous in observational studies, and the simple solution of restricting the analyses to the subset with complete records will often result in bias and loss of power. The seriousness of these issues for resulting inferences depends on both the mechanism causing the missing data and the form of the substantive question and associated model. The methodological literature on methods for the analysis of partially observed data has grown substantially over the last twenty years, and although there is increasing guidance on how to handle missing data, practice is changing slowly and misapprehensions abound, particularly in observational research. Importantly, the lack of transparency around methodological decisions regarding the analysis is threatening the validity and reproducibility of modern research. In this symposium leading researchers in missing data methodology will present practical guidance on how to select an appropriate method to handle missing data, describe how to report the results from such an analysis and describe how to conduct sensitivity analyses in the multiple imputation framework. Rationale for the symposium, including for its inclusion in the Congress One of the sub-themes of WCE 2021 is “Translation from research to policy and practice”. Although there is a growing body of literature surrounding missing data methodology, evidence from systematic reviews suggests that missing data is still often not handled appropriately. If practice is to change, it is important to educate applied researchers regarding the available methodology and provide practical guidance on how to determine the best method for handling missing data. An important part of this is providing guidance on the reporting of results from analyses with missing data. This is particularly pertinent given the current emphasis on reproducibility of research findings. In this symposium we bring some of the latest research from the Missing Data Topic Group of the STRengthening Analytical Thinking for Observational Studies (STRATOS) initiative whose aim is to provide accessible and accurate guidance in the design and analysis of observational studies in order to increasie the reliability and validity of observational research. Presentation program Names of presenters

Download Full-text

98Framework for the Treatment And Reporting of Missing data in Observational Studies: The TARMOS framework

International Journal of Epidemiology ◽

10.1093/ije/dyab168.141 ◽

2021 ◽

Vol 50 (Supplement_1) ◽

Author(s):

Rosie Cornish ◽

Kate Tilling ◽

Rosie Cornish ◽

James Carpenter

Keyword(s):

Missing Data ◽

Observational Studies ◽

Potential Effect ◽

Observational Research ◽

Analysis Model ◽

Parents And Children ◽

Alternative Approach ◽

Study Results ◽

Data Checking

Abstract Focus of presentation Missing data are ubiquitous in medical research. Although there is increasing guidance on how to handle missing data, practice is changing slowly and misapprehensions abound, particularly in observational research. We present a practical framework for handling and reporting the analysis of incomplete data in observational studies, which we illustrate using a case study from the Avon Longitudinal Study of Parents and Children. Findings The framework consists of three steps: 1) Develop an analysis plan specifying the analysis model and how missing data are going to be addressed. Important considerations are whether a complete records analysis is likely to be valid, whether multiple imputation or an alternative approach is likely to offer benefits, and whether a sensitivity analysis regarding the missingness mechanism is required. 2) Explore the data, checking the methods outlined in the analysis plan are appropriate, and conduct the pre-planned analysis. 3) Report the results, including a description of the missing data, details on how missing data were addressed, and the results from all analyses, interpreted in light of the missing data and clinical relevance. Conclusions/Implications This framework encourages researchers to think carefully about their missing data and be transparent about the potential effect on the study results. This will increase confidence in the reliability and reproducibility of results from published papers. Key messages Researchers need to develop a plan for missing data prior to conducting their analysis, and be transparent about how they handled the missing data and its potential effect when reporting their results.

Download Full-text

98Framework for the Treatment And Reporting of Missing data in Observational Studies: The TARMOS framework

International Journal of Epidemiology ◽

10.1093/ije/dyab168.371 ◽

2021 ◽

Vol 50 (Supplement_1) ◽

Author(s):

Katherine Lee ◽

Kate Tilling ◽

Rosie Cornish ◽

James Carpenter

Keyword(s):

Missing Data ◽

Observational Studies ◽

Potential Effect ◽

Observational Research ◽

Analysis Model ◽

Parents And Children ◽

Alternative Approach ◽

Study Results ◽

Data Checking

Download Full-text

The association between vitamin D concentration and pain: a systematic review and meta-analysis

Public Health Nutrition ◽

10.1017/s1368980018000551 ◽

2018 ◽

Vol 21 (11) ◽

pp. 2022-2037 ◽

Cited By ~ 13

Author(s):

Zhenqiang Wu ◽

Zarintaj Malihi ◽

Alistair W Stewart ◽

Carlene MM Lawes ◽

Robert Scragg

Keyword(s):

Vitamin D ◽

Muscle Pain ◽

Observational Studies ◽

Meta Analysis ◽

Hypovitaminosis D ◽

Chronic Widespread Pain ◽

Sensitivity Analyses ◽

Observational Research ◽

Cochrane Central Register ◽

Widespread Pain

AbstractObjectivePain-related conditions, such as chronic widespread pain and fibromyalgia, are major burdens for individuals and the health system. Evidence from previous research on the association between circulating 25-hydroxyvitamin D (25(OH)D) concentrations and pain is conflicting. Thus, we aimed to determine if there is an association between mean 25(OH)D concentration (primary aim), or proportion of hypovitaminosis D (secondary aim), and pain conditions in observational studies.DesignPublished observational research on 25(OH)D concentration and pain-related conditions was systematically searched for in electronic sources (MEDLINE, EMBASE and Cochrane Central Register of Controlled Trials) and a random-effects meta-analysis was conducted on included studies.ResultsEighty-one observational studies with a total of 50 834 participants were identified. Compared with controls, mean 25(OH)D concentration was significantly lower in patients with arthritis (mean difference (MD): −12·34 nmol/l;P<0·001), muscle pain (MD: −8·97 nmol/l;P=0·003) and chronic widespread pain (MD: −7·77 nmol/l;P<0·001), but not in patients with headache or migraine (MD: −2·53 nmol/l;P=0·06). The odds of vitamin D deficiency was increased for arthritis, muscle pain and chronic widespread pain, but not for headache or migraine, compared with controls. Sensitivity analyses revealed similar results.ConclusionsA significantly lower 25(OH)D concentration was observed in patients with arthritis, muscle pain and chronic widespread pain, compared with those without. These results suggest that low 25(OH)D concentrations may be associated with pain conditions.

Download Full-text

Focus on Function in Hospitalized Persons With Dementia: The Impact of Hospital-Acquired Complications

Innovation in Aging ◽

10.1093/geroni/igaa057.2750 ◽

2020 ◽

Vol 4 (Supplement_1) ◽

pp. 762-762

Author(s):

Marie Boltz ◽

Lorraine Mion

Keyword(s):

Acute Care ◽

Goal Attainment ◽

Functional Decline ◽

Policy And Practice ◽

Increased Risk ◽

Research Findings ◽

Pharmacologic Management ◽

Hospitalized Older Adults ◽

Hospital Acquired ◽

The Impact

Abstract Persons with dementia (PWD) are two-three times more likely to be hospitalized as persons without dementia and comprise one fourth of hospitalized older adults. Hospitalization often has a dramatic impact upon the health and disposition of the older PWD. They are at increased risk for hospital acquired complications (HAC) such as functional decline, behavioral symptoms of distress, and delirium, all of which contribute to increased disability, mortality, and long-term nursing home stays. Despite the unprecedented number of PWD admitted to acute care, little attention has focused on their specialized needs and HAC, and how they impact functional recovery. The purpose of this symposium is to describe the incidence of common HACs, and factors that influence their occurrence and presentation in PWD. Utilizing baseline findings from the Family-centered Function-focused Care (Fam-FFC) trial, the presentations will address this objective and discuss the ramifications for functional and cognitive post-acute recovery in PWD. The first presentation will describe the incidence and pharmacologic management of pain in PWD, and its association with common HACs. The second presentation will describe physical activity in PWD on medical units and the validity of the Motionwatch8 actigraphy. The third session will describe differences in common HACs between white and black PWD. The final presentation will examine function-focused goals developed in collaboration with family caregivers and patients, and the functional outcomes associated with goal attainment. Our discussant, Dr. Lorraine Mion, will synthesize the research findings and lead a discussion of future directions for policy and practice in dementia-capable acute care.

Download Full-text

Framework for the treatment and reporting of missing data in observational studies: The Treatment And Reporting of Missing data in Observational Studies framework

Journal of Clinical Epidemiology ◽

10.1016/j.jclinepi.2021.01.008 ◽

2021 ◽

Vol 134 ◽

pp. 79-88 ◽

Cited By ~ 1

Author(s):

Katherine J. Lee ◽

Kate M. Tilling ◽

Rosie P. Cornish ◽

Roderick J.A. Little ◽

Melanie L. Bell ◽

...

Keyword(s):

Missing Data ◽

Observational Studies

Download Full-text

Open science reforms: Strengths, challenges, and future directions

10.35542/osf.io/sgfy8 ◽

2021 ◽

Author(s):

Kathryn R. Wentzel

Keyword(s):

Research Design ◽

Educational Psychology ◽

Open Science ◽

Policy And Practice ◽

Future Directions ◽

Science Practices ◽

Research Findings ◽

Potential Benefits ◽

The Impact

In this article, I comment on the potential benefits and limitations of open science reforms for improving the transparency and accountability of research, and enhancing the credibility of research findings within communities of policy and practice. Specifically, I discuss the role of replication and reproducibility of research in promoting better quality studies, the identification of generalizable principles, and relevance for practitioners and policymakers. Second, I suggest that greater attention to theory might contribute to the impact of open science practices, and discuss ways in which theory has implications for sampling, measurement and research design. Ambiguities concerning the aims of preregistration and registered reports also are highlighted. In conclusion, I discuss structural roadblocks to open science reform and reflect on the relevance of these reforms for educational psychology.

Download Full-text

School Readiness Assessments for Class Placements and Academic Sorting in Kindergarten

Educational Policy ◽

10.1177/0895904818802109 ◽

2018 ◽

Vol 34 (3) ◽

pp. 518-547 ◽

Cited By ~ 1

Author(s):

F. Chris Curran ◽

Michael H. Little ◽

Lora Cohen-Vogel ◽

Thurston Domina

Keyword(s):

Language Arts ◽

School Readiness ◽

English Language ◽

Multilevel Models ◽

Kindergarten Readiness ◽

Academic Ability ◽

Sensitivity Analyses ◽

Policy And Practice ◽

Placement Decisions ◽

Class Placement

Kindergarten readiness assessments are commonly used in schools nationwide. Prior work shows that the use of such assessments for class placement decisions has increased in recent years. This article uses the Early Childhood Longitudinal Study of 2011 to explore whether the use of readiness assessments for such purpose predicts differential sorting of students across classrooms by prior academic ability. Results from multilevel models as well as other sensitivity analyses suggest that the use of readiness assessments for classroom placements is predictive of slightly higher cross-class ability sorting, particularly in English/language arts. The implications for policy and practice are discussed.

Download Full-text

Use of Statins and Breast Cancer: A Meta-Analysis of Seven Randomized Clinical Trials and Nine Observational Studies

Journal of Clinical Oncology ◽

10.1200/jco.2005.02.7045 ◽

2005 ◽

Vol 23 (34) ◽

pp. 8606-8612 ◽

Cited By ~ 139

Author(s):

Stefanos Bonovas ◽

Kalitsa Filioussi ◽

Nikolaos Tsavaris ◽

Nikolaos M. Sitaras

Keyword(s):

Breast Cancer ◽

Breast Cancer Risk ◽

Cancer Risk ◽

Publication Bias ◽

Observational Studies ◽

Fixed Effects ◽

Randomized Clinical Trials ◽

Meta Analysis ◽

Sensitivity Analyses ◽

Fixed Effects Model

Purpose A growing body of evidence suggests that statins may have chemopreventive potential against breast cancer. Laboratory studies demonstrate that statins induce apoptosis and reduce cell invasiveness in various cell lines, including breast carcinoma cells. However, the clinical relevance of these data remains unclear. The nonconclusive nature of the epidemiologic data prompted us to conduct a detailed meta-analysis of the studies published on the subject in peer-reviewed literature. Patients and Methods A comprehensive search for articles published up until 2005 was performed; reviews of each study were conducted; and data were abstracted. Before meta-analysis, the studies were evaluated for publication bias and heterogeneity. Pooled relative risk (RR) estimates and 95% CIs were calculated using the random and the fixed-effects models. Subgroup and sensitivity analyses were also performed. Results Seven large randomized trials and nine observational studies (five case-control and four cohort studies) contributed to the analysis. We found no evidence of publication bias or heterogeneity among the studies. Statin use did not significantly affect breast cancer risk (fixed effects model: RR = 1.03; 95% CI, 0.93 to 1.14; random effects model: RR = 1.02; 95% CI, 0.89 to 1.18). When the analyses were stratified into subgroups, there was no evidence that study design substantially influenced the estimate of effects. Furthermore, the sensitivity analysis confirmed the stability of our results. Conclusion Our meta-analysis findings do not support a protective effect of statins against breast cancer. However, this conclusion is limited by the relatively short follow-up times of the studies analyzed. Further studies are required to investigate the potential decrease in breast cancer risk among long-term statin users.

Download Full-text