Reporting Practice in Multilevel Modeling: A Revisit After 10 Years

2021 ◽  
pp. 003465432199122
Author(s):  
Wen Luo ◽  
Haoran Li ◽  
Eunkyeng Baek ◽  
Siqi Chen ◽  
Kwok Hap Lam ◽  
...  

Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results. Ten years have passed since the guidelines for reporting multilevel studies were initially published. This study reviewed new advancements in MLM and revisited the reporting practice in MLM in the past decade. A total of 301 articles from 19 journals representing different subdisciplines in education and psychology were included in the systematic review. The results showed improvement in some areas of the reporting practices, such as the number of models tested, centering of predictors, missing data treatment, software, and estimates of variance components. However, poor practices persist in terms of model specification, description of a missing mechanism, power analysis, assumption checking, model comparisons, and effect sizes. Updates on the guidelines for reporting multilevel studies and recommendations for future methodological research in MLM are presented.

Author(s):  
John Turner ◽  
Kristin Firmery Petrunin ◽  
Jeff Allen

In the past, a large number of research efforts concentrated on single-level analysis; however, researchers who only conduct this level of analysis are finding it harder to justify due to the advancements in statistical software and research techniques. The validation of research findings comes partially from others replicating existing studies as well as building onto theories. Through replication and validation, the research process becomes cyclical in nature, and each iteration builds upon the next. Each succession of tests sets new boundaries, further verification, or falsification. For a model to be correctly specified, the level of analysis needs to be in congruence with the level of measurement. This chapter provides an overview of multilevel modeling for researchers and provides guides for the development and investigation of these models.


2020 ◽  
Vol 26 (3) ◽  
pp. 229-239
Author(s):  
Karen S. Lyons ◽  
Christopher S. Lee

Over the past two decades, there has been movement toward a dyadic perspective of the illness experience. Although multilevel models have led to great insights into how dyads are affected by illness as family units, these models are still underutilized for understanding incongruent illness appraisals. Such incongruent appraisals can have implications for how the dyad collaborates to manage illness, the health of the dyad, and clinical outcomes. The focus of this article is to describe and promote the application of multilevel models to longitudinal dyadic data to understand incongruent illness appraisals over time. In particular, we present a data exemplar so researchers can apply these models to their own data and clinical questions to understand the ways care dyads converge and diverge in their appraisals and determine factors associated with such variability. We comment on the implications and extensions of these models for family nursing research and practice.


2020 ◽  
Vol 7 (Supplement_1) ◽  
pp. S175-S175
Author(s):  
Shannon Hunter ◽  
Diana Garbinsky ◽  
Elizabeth M La ◽  
Sara Poston ◽  
Cosmina Hogea

Abstract Background Previous studies on adult vaccination coverage found inter-state variability that persists after adjusting for individual demographic factors. Assessing the impact of state-level factors may help improve uptake strategies. This study aimed to: • Update previous estimates of state-level, model-adjusted coverage rates for influenza; pneumococcal; tetanus, diphtheria, and acellular pertussis (Tdap); and herpes zoster (HZ) vaccines (individually and in compliance with all age-appropriate recommended vaccinations) • Evaluate effects of individual and state-level factors on adult vaccination coverage using a multilevel modeling framework. Methods Behavioral Risk Factor Surveillance System (BRFSS) survey data (2015–2017) were retrospectively analyzed. Multivariable logistic regression models estimated state vaccination coverage and compliance using predicted marginal proportions. BRFSS data were then combined with external state-level data to estimate multilevel models evaluating effects of state-level factors on coverage. Weighted odds ratios and measures of cluster variation were estimated. Results Adult vaccination coverage and compliance varied by state, even after adjusting for individual characteristics, with coverage ranging as follows: • Influenza (2017): 35.1–48.1% • Pneumococcal (2017): 68.2–80.8% • Tdap (2016): 21.9–46.5% • HZ (2017): 30.5–50.9% Few state-level variables were retained in final multilevel models, and measures of cluster variation suggested substantial residual variation unexplained by individual and state-level variables. Key state-level variables positively associated with vaccination included health insurance coverage rates (influenza/HZ), pharmacists’ vaccination authority (HZ), presence of childhood vaccination exemptions (pneumococcal/Tdap), and adult immunization information system participation (Tdap/HZ). Conclusion Adult vaccination coverage and compliance continue to show substantial variation by state even after adjusting for individual and state-level characteristics associated with vaccination. Further research is needed to assess additional state or local factors impacting vaccination disparities. Funding GlaxoSmithKline Biologicals SA (study identifier: HO-18-19794) Disclosures Shannon Hunter, MS, GSK (Other Financial or Material Support, Ms. Hunter is an employee of RTI Health Solutions, who received consultancy fees from GSK for conduct of the study. Ms. Hunter received no direct compensation from the Sponsor.) Diana Garbinsky, MS, GSK (Other Financial or Material Support, The study was conducted by RTI Health Solutions, which received consultancy fees from GSK. I am a salaried employee at RTI Health Solutions and received no direct compensation from GSK for the conduct of this study..) Elizabeth M. La, PhD, RTI Health Solutions (Employee) Sara Poston, PharmD, The GlaxoSmithKline group of companies (Employee, Shareholder) Cosmina Hogea, PhD, GlaxoSmithKline (Employee, Shareholder)


2019 ◽  
Vol 14 (3) ◽  
pp. 583-608 ◽  
Author(s):  
Johannes Slacik ◽  
Dorothea Greiling

Purpose Materiality as an emerging trend aims to make sustainability reports (SR) more relevant for stakeholders. This paper aims to investigate whether the reporting practice of electric utility companies (EUC) is in compliance with the materiality principle of the Global Reporting Initiative (GRI) when disclosing SR. Design/methodology/approach A twofold content analysis focusing on material aspects (MAs) is conducted, followed by correlation analysis. Logic and conversation theory (LCT) serves to evaluate the communication quality of documented materiality in SR by EUC. Findings The coverage and quality of documented MAs in SR by EUC do not meet the requirements for relevant and transparent communication. Materiality does not guide the reporting practice and is not taken seriously. Research limitations/implications Mediocre quality of coverage and communication in SR shows that stakeholders’ information needs are not considered adequately. The content analysis is limited in focusing on merely documented aspects rather than on actual performance. Originality/value This study considers the quality of communication of documented materiality through the lens of LCT. It contributes to the academic debate by introducing LCT as a viable theoretical perspective for analyzing SR. The paper evaluates GRI-G4 reporting practices in the electricity sector, which, while under-researched is crucial for sustainability. It also contributes to the emerging body of empirical research on the relevance of materiality as a guiding principle for sustainability reporting.


2021 ◽  
pp. tobaccocontrol-2020-056455
Author(s):  
Shivani Mathur Gaiha ◽  
Lisa Henriksen ◽  
Bonnie Halpern-Felsher ◽  
Todd Rogers ◽  
Ashley L Feld ◽  
...  

PurposeThis study compares access to flavoured JUUL and other e-cigarettes from retail, online and social sources among underage and young adult e-cigarette users who live in California jurisdictions that restrict sales of flavoured tobacco with the rest of the state.MethodsAn online survey used social media advertisements to recruit participants (n=3075, ages 15–29) who lived in one of nine jurisdictions that restrict sales (n=1539) or in the rest of state, and oversampled flavoured tobacco users. Focusing on past-month e-cigarette users (n=908), multilevel models tested whether access to flavoured JUUL and other e-cigarettes from retail, online and social sources differed by local law (yes/no) and age group (15–20 or older), controlling for other individual characteristics.ResultsThe percent of underage users who obtained flavoured JUUL and other e-cigarettes in the past month was 33.6% and 31.2% from retail, 11.6% and 12.7% online, and 76.0% and 70.9% from social sources, respectively. Compared with underage and young adult users in the rest of California, those in localities that restrict the sales of flavoured tobacco were less likely to obtain flavoured JUUL from retail sources (Adjusted OR=0.54, 95% CI 0.36 to 0.80), but more likely to obtain it from social sources (Adjusted OR=1.55, 95% CI 1.02 to 2.35). The same pattern was observed for other brands of flavoured e-cigarettes.ConclusionAlthough local laws may reduce access to flavoured e-cigarettes from retail sources, more comprehensive state or federal restrictions are recommended to close the loopholes for online sources. Dedicated efforts to curtail access from social sources are needed.


TEME ◽  
2018 ◽  
pp. 167
Author(s):  
Dejan Spasić ◽  
Anton Vorina

The aim of the research is to achieve a conclusion what is the level of the reporting practice on intangible assets in two countries - in the Republic of Serbia and in the Republic of Slovenia trough a comparative descriptive statistics. Consolidated financial statements of listed companies in these two countries were used from the Belgrade Stock Exchange (Serbia) and the Ljubljana Stock Exchange (Slovenia). The reason for the use of consolidated financial statements lies in the fact that they can contain unconsolidated intangible assets already recognized in the separate financial statements of the companies included in the group, as well as internally generated intangible assets that meet the conditions for recognition in a business combination (including Goodwill). The general assessment is that the survey results indicate a very low level of reporting practice of intangible assets in Serbia and relatively satisfactory level of reporting practice in Slovenia. Individual results are given in the fourth part of the paper. 


2021 ◽  
Author(s):  
Megan Reavis ◽  
Jenny Ahlen ◽  
Joe Rudek ◽  
Kusum Naithani

Abstract The dramatic increase of emitted greenhouse gases (GHGs) by humans over the past century and a half has created an urgency for monitoring, reporting, and verifying GHG emissions as a first step towards mitigating the effects of climate change. Fifteen percent of global GHG emissions come from agriculture, and companies in the food and beverage industry are starting to set climate goals. We evaluated the GHG emissions reporting practices and climate goals of the top 100 global food and beverage companies and determined whether or not their goals are aligned with the science of reducing climate warming to less than 2 °C. We found that two thirds of the top 100 (as ranked by Food Engineering) global food and beverage companies are setting some sort of climate goals, but fewer than half included scope 3 emissions in their goals. Only four companies have goals that are aligned with the goal of the 3% Solution: a 4.3% annual emission reduction until 2050. While an increasing number of companies are disclosing and setting targets that include scope 3 emissions, many still do not disclose or report any of their emissions. Our results highlight an urgent need to develop protocols for monitoring, reporting, and verifying GHG emissions and to provide transparent information on climate goals and targets.


2021 ◽  
Author(s):  
Lin Shen ◽  
Joshua F. Wiley ◽  
Bei Bei

Study Objectives: To describe trajectories of daily perceived sleep need (PSNeed) and sleep deficit across 28 consecutive days, and examine if cumulative sleep deficit predicts next-day affect.Methods: Daily sleep and affect were measured over 2 weeks of school and 2 weeks of vacation in 205 adolescents (54.1% females, Mage = 16.9 years). Each day, participants wore actigraphs and self-reported the amount of sleep needed to function well the next day (i.e., perceived sleep need), sleep duration, and high- and low-arousal positive and negative affect (PA, NA). Cumulative actigraphy and diary sleep deficit were calculated as the weighted average of the difference between PSNeed and sleep duration over the past 3 days. Cross-lagged, multilevel models were used to test cumulative sleep deficit as a predictor of next-day affect. Lagged affect, day of the week, study day, and sociodemographics were controlled.Results: PSNeed was lower early in the school week, before increasing in the second half of the week. Adolescents accumulated sleep deficit across school days and reduced it during weekends. During weekends and vacations, adolescents’ self-reported, but not actigraphy sleep duration, met PSNeed. Higher cumulative actigraphy sleep deficit predicted higher next-day high arousal NA; higher cumulative diary sleep deficit predicted higher NA (regardless of arousal), and lower low arousal PA the following day.Conclusions: Adolescents experienced sustained cumulative sleep deficit across school days. Non-school nights appeared to be opportunities for reducing sleep deficit. Trajectories of sleep deficit during vacation suggested recovery from school-related sleep restriction.


2019 ◽  
Vol 4 (3) ◽  
pp. e001418 ◽  
Author(s):  
Thomas Butt ◽  
Gordon G Liu ◽  
David D Kim ◽  
Peter J Neumann

IntroductionCost-effectiveness analysis (CEA) is playing an increasingly important role in informing healthcare decision-making in China. This study aims to review the published literature on CEA in mainland China and describe its characteristics and evolution. We provide recommendations on the future direction of CEA as a methodology and as a tool to support healthcare decision-making in China.MethodsEnglish-language cost-per-quality-adjusted life-year (QALY) and cost-per-disability-adjusted life-year (DALY) publications relating to mainland China were reviewed using the Tufts Medical Center Cost-Effectiveness Analysis Registry and Global Health Cost-Effectiveness Analysis Registry through 2017. Study features were summarised using descriptive statistics. Changes in study methodology over time were analysed by trend test, and study characteristics influencing the incremental cost-effectiveness ratio (ICER) of cost-per-QALY studies were investigated using logistic regression.Results170 studies were identified reporting CEA for mainland China (cost/QALY=125, cost/DALY=45) since 1998. The number and quality of studies has increased over the past two decades, with significantly more cost-per-QALY studies compared with cost-per-DALY studies (p<0.0001) and more studies with authors affiliated with Chinese institutions (p=0.0002). The average quality score was 5.04 out of 7 for cost-per-QALY and 4.70 for cost-per-DALY studies based on Registry reviewers’ subjective assessment of overall quality (methods, assumptions and reporting practices). The median ICER reported for interventions for oncology patients was higher (US$26 694 per QALY) than the median ICER reported for all interventions (US$11 503 per QALY). Oncology interventions were associated with the likelihood of reporting higher ICERs than the median ICER (p=0.003).ConclusionThe number of English-language published CEA studies relating to China has grown rapidly over the past 20 years. In terms of quality, the China studies compare favourably with international studies, although they remain a small proportion of studies globally.


2003 ◽  
Vol 25 (4) ◽  
pp. 187-191 ◽  
Author(s):  
O. Tsybrovskyy ◽  
A. Berghold

Multilevel organization of morphometric data (cells are “nested” within patients) requires special methods for studying correlations between karyometric features. The most distinct feature of these methods is that separate correlation (covariance) matrices are produced for every level in the hierarchy. In karyometric research, the cell‐level (i.e., within‐tumor) correlations seem to be of major interest. Beside their biological importance, these correlation coefficients (CC) are compulsory when dimensionality reduction is required. Using MLwiN, a dedicated program for multilevel modeling, we show how to use multivariate multilevel models (MMM) to obtain and interpret CC in each of the levels. A comparison with two usual, “single‐level” statistics shows that MMM represent the only way to obtain correct cell‐level correlation coefficients. The summary statistics method (take average values across each patient) produces patient‐level CC only, and the “pooling” method (merge all cells together and ignore patients as units of analysis) yields incorrect CC at all. We conclude that multilevel modeling is an indispensable tool for studying correlations between morphometric variables.


Sign in / Sign up

Export Citation Format

Share Document