scholarly journals Testing heterogeneity in inter-rater reliability

2020 ◽  
Author(s):  
František Bartoš ◽  
Patrícia Martinková ◽  
Marek Brabec
Keyword(s):  
Variance Components ◽  
Generalized Additive Models ◽  
Mixed Effects ◽  
Additive Models ◽  
Mixed Effects Models ◽  
Rater Reliability ◽  
Linear Mixed Effects Models ◽  
Linear Mixed Effects ◽  
Wide Range

Estimating the inter-rater reliability (IRR) is important for assessing and improving the quality of ratings. In some cases, the IRR may differ between groups due to their features. To test heterogeneity in IRR, the second-order generalized estimating equations (GEE2) and linear mixed-effects models (LME) were already used. Another method capable of estimating the components for IRR is generalized additive models (GAM). This paper presents a simulation study evaluating the performance of these methods in estimating variance components and in testing heterogeneity in IRR. We consider a wide range of sample sizes and various scenarios leading to heterogenous IRR. The results show, that while the LME and GAM models perform similarly and yield reliable estimates, the GEE2 models may lead to incorrect results.

scholarly journals Testing multiple variance components in linear mixed-effects models

Biostatistics ◽  
2012 ◽  
Vol 14 (1) ◽  
pp. 144-159 ◽  
Author(s):  
R. Drikvandi ◽  
G. Verbeke ◽  
A. Khodadadi ◽  
V. Partovi Nia
Keyword(s):  
Variance Components ◽  
Mixed Effects ◽  
Mixed Effects Models ◽  
Linear Mixed Effects Models ◽  
Linear Mixed Effects

scholarly journals Stochastic Lanczos estimation of genomic variance components for linear mixed-effects models

2019 ◽  
Author(s):  
Richard Border ◽  
Stephen Becker
Keyword(s):  
Variance Components ◽  
Mixed Effects ◽  
Mixed Effects Models ◽  
Stochastic Methods ◽  
Linear Mixed Effects Models ◽  
Linear Mixed Effects ◽  
Matrix Operations ◽  
Novel Algorithms ◽  
Reml Estimation ◽  
Estimation Of Variance

AbstractBackgroundLinear mixed-effects models (LMM) are a leading method in conducting genome-wide association studies (GWAS) but require residual maximum likelihood (REML) estimation of variance components, which is computationally demanding. Previous work has reduced the computational burden of variance component estimation by replacing direct matrix operations with iterative and stochastic methods and by employing loose tolerances to limit the number of iterations in the REML optimization procedure. Here, we introduce two novel algorithms,stochastic Lanczos derivative-free REML(SLDF_REML) andLanczos first-order Monte Carlo REML(L_FOMC_REML), that exploit problem structure via the principle of Krylov subspace shift-invariance to speed computation beyond existing methods. Both novel algorithms only require a single round of computation involving iterative matrix operations, after which their respective objectives can be repeatedly evaluated using vector operations. Further, in contrast to existing stochastic methods,SLDF_REMLcan exploit precomputed genomic relatedness matrices (GRMs), when available, to further speed computation.ResultsResults of numerical experiments are congruent with theory and demonstrate that interpreted-language implementations of both algorithms match or exceed existing compiled-language software packages in speed, accuracy, and flexibility.ConclusionsBoth theSLDF_REMLandL_FOMC_REMLalgorithms outperform existing methods for REML estimation of variance components for LMM and are suitable for incorporation into existing GWAS LMM software implementations.Full list of author information is available at the end of the article

scholarly journals Generalized Confidence Intervals for Intra- and Inter-subject Coefficients of Variation in Linear Mixed-effects Models

2017 ◽  
Vol 13 (2) ◽  
Author(s):  
Johannes Forkman
Keyword(s):  
Confidence Intervals ◽  
Random Effects ◽  
Variance Components ◽  
Mixed Effects ◽  
Mixed Effects Models ◽  
Linear Mixed Effects Models ◽  
Linear Mixed Effects ◽  
Coefficients Of Variation ◽  
Generalized Confidence Intervals ◽  
Generalized Pivotal Quantities

Abstract Linear mixed-effects models are linear models with several variance components. Models with a single random-effects factor have two variance components: the random-effects variance, i. e., the inter-subject variance, and the residual error variance, i. e., the intra-subject variance. In many applications, it is practice to report variance components as coefficients of variation. The intra- and inter-subject coefficients of variation are the square roots of the corresponding variances divided by the mean. This article proposes methods for computing confidence intervals for intra- and inter-subject coefficients of variation using generalized pivotal quantities. The methods are illustrated through two examples. In the first example, precision is assessed within and between runs in a bioanalytical method validation. In the second example, variation is estimated within and between main plots in an agricultural split-plot experiment. Coverage of generalized confidence intervals is investigated through simulation and shown to be close to the nominal value.

Subjective cognitive decline is longitudinally associated with lower health-related quality of life

2017 ◽  
Vol 29 (12) ◽  
pp. 1939-1950 ◽  
Author(s):  
Susanne Roehr ◽  
Tobias Luck ◽  
Alexander Pabst ◽  
Horst Bickel ◽  
Hans-Helmut König ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Mixed Effects ◽  
Mixed Effects Models ◽  
Subjective Cognitive Decline ◽  
Linear Mixed Effects Models ◽  
Linear Mixed Effects ◽  
Related Quality ◽  
Health Related ◽  
Eq Vas

ABSTRACTBackground:Subjective cognitive decline (SCD), the potentially earliest notable manifestation of preclinical Alzheimer's disease and other dementias, was consistently associated with lower quality of life in cross-sectional studies. The aim of this study was to investigate whether such an association persists longitudinally – particularly with health-related quality of life (HRQoL) in older individuals without cognitive impairment.Methods:Data were derived from follow-up 2–6 of the prospective Germany Study on Ageing, Cognition and Dementia in Primary Care (AgeCoDe) covering a total six-year observation period. We used linear mixed effects models to estimate the effect of SCD on HRQoL measured by the EQ-5D visual analogue scale (EQ VAS).Results:Of 1,387 cognitively unimpaired individuals aged 82.2 years (SD = 3.2) on average, 702 (50.6%) reported SCD and 230 (16.6%) with SCD-related concerns. Effect estimates of the linear mixed effects models revealed lower HRQoL in individuals with SCD (unadjusted: –3.7 points on the EQ VAS, 95%CI = –5.3 to –2.1; SE = 0.8; p < 0.001; adjusted: –2.9 points, 95%CI = –3.9 to –1.9; SE = 0.5; p < 0.001) than in individuals without SCD. The effect was most pronounced in SCD with related concerns (unadjusted: –5.4, 95%CI = –7.6 to –3.2; SE = 1.1; p < 0.001; adjusted: –4.3, 95%CI = –5.8 to –2.9, SE = 0.7; p < 0.001).Conclusion:SCD constitutes a serious issue to older cognitively unimpaired individuals that is depicted in persisting lower levels of HRQoL beyond depressive symptoms and functional impairment. Therefore, SCD should be taken seriously in clinical practice.

The Use of Theory of Linear Mixed-Effects Models to Detect Fraudulent Erasures at an Aggregate Level

2021 ◽  
pp. 001316442199489
Author(s):  
Luyao Peng ◽  
Sandip Sinharay
Keyword(s):  
Type I Error ◽  
Real Data ◽  
Mixed Effects ◽  
Error Rates ◽  
Mixed Effects Models ◽  
Type I ◽  
Aggregate Level ◽  
Linear Mixed Effects Models ◽  
Linear Mixed Effects ◽  
Best Linear Unbiased

Wollack et al. (2015) suggested the erasure detection index (EDI) for detecting fraudulent erasures for individual examinees. Wollack and Eckerly (2017) and Sinharay (2018) extended the index of Wollack et al. (2015) to suggest three EDIs for detecting fraudulent erasures at the aggregate or group level. This article follows up on the research of Wollack and Eckerly (2017) and Sinharay (2018) and suggests a new aggregate-level EDI by incorporating the empirical best linear unbiased predictor from the literature of linear mixed-effects models (e.g., McCulloch et al., 2008). A simulation study shows that the new EDI has larger power than the indices of Wollack and Eckerly (2017) and Sinharay (2018). In addition, the new index has satisfactory Type I error rates. A real data example is also included.

Sign in / Sign up

Export Citation Format

Share Document