scholarly journals On Testing Equal Conditional Predictive Ability Under Measurement Error*

Author(s):  
Yannick Hoga ◽  
Timo Dimitriadis
2008 ◽  
Vol 65 (12) ◽  
pp. 2644-2655 ◽  
Author(s):  
Amy M. Kamarainen ◽  
Freya E. Rowland ◽  
Reinette Biggs ◽  
Stephen R. Carpenter

Zooplankton grazing is important in resolving residual variation around the total phosphorus – chlorophyll a relationship. In empirical studies, zooplankton body size is often a better predictor of residual variation than zooplankton biomass. We investigate whether higher measurement error associated with zooplankton biomass may explain its lower predictive ability. We collected five replicate zooplankton biomass samples in 19 lakes, allowing us to quantify measurement error in volumetric zooplankton biomass with greater precision than in previous studies. A hierarchical Bayesian model was used to assess the predictive ability of volumetric zooplankton biomass and mean individual zooplankton length, corrected for measurement error. We found consistent effects of total zooplankton biomass, but not zooplankton length, on chlorophyll a. This finding does not appear to be related to the higher precision with which total zooplankton biomass was measured in our study, but rather to ecological factors. Interlake variation outweighed the effects of measurement error in estimating the strength of relationships between zooplankton variables and chlorophyll a. Our findings therefore suggest that studies to estimate zooplankton effects on phytoplankton should allocate resources to study a larger range of lakes over different time periods than to process replicate samples to reduce measurement error.


2021 ◽  
Author(s):  
Conor Goold ◽  
Ruth C. Newberry

Predicting the behaviour of shelter dogs after adoption is an important, but difficult, endeavour. Differences between shelter and post-adoption environments, between- and within-individual heterogeneity in behaviour, uncertainty in behavioural predictions and measurement error all hinder the accurate assessment of future behaviour. This study integrates 1) a longitudinal behavioural assessment with 2) a novel joint hierarchical Bayesian mixture model that accounts for individual variation, missing data and measurement error to predict behaviour post-adoption. We analysed shelter observations (> 28,000 records) and post-adoption reports (from telephone surveys) on the behaviour of 241 dogs across eight contexts. Dog behaviour at the shelter correlated positively with behaviour post-adoption within contexts (r = 0.38; 95% highest density interval: [0.20, 0.55]), and behavioural repeatability was approximately 20% higher post-adoption for behaviour within contexts. Although measurement error was higher post-adoption than at the shelter, we found few differences in individual-level, latent probabilities of different behaviours post-adoption versus at the shelter. This good predictive ability was aided by accurate representation of uncertainty in individual-level predictions. We conclude that longitudinal assessment paired with a sufficient inferential framework to model latent behavioural profiles with uncertainty enables reasonably accurate estimation of post-adoption behaviour.


1999 ◽  
Vol 15 (2) ◽  
pp. 91-98 ◽  
Author(s):  
Lutz F. Hornke

Summary: Item parameters for several hundreds of items were estimated based on empirical data from several thousands of subjects. The logistic one-parameter (1PL) and two-parameter (2PL) model estimates were evaluated. However, model fit showed that only a subset of items complied sufficiently, so that the remaining ones were assembled in well-fitting item banks. In several simulation studies 5000 simulated responses were generated in accordance with a computerized adaptive test procedure along with person parameters. A general reliability of .80 or a standard error of measurement of .44 was used as a stopping rule to end CAT testing. We also recorded how often each item was used by all simulees. Person-parameter estimates based on CAT correlated higher than .90 with true values simulated. For all 1PL fitting item banks most simulees used more than 20 items but less than 30 items to reach the pre-set level of measurement error. However, testing based on item banks that complied to the 2PL revealed that, on average, only 10 items were sufficient to end testing at the same measurement error level. Both clearly demonstrate the precision and economy of computerized adaptive testing. Empirical evaluations from everyday uses will show whether these trends will hold up in practice. If so, CAT will become possible and reasonable with some 150 well-calibrated 2PL items.


2019 ◽  
Vol 24 (1) ◽  
pp. 70-91 ◽  
Author(s):  
Noémi K. Schuurman ◽  
Ellen L. Hamaker

1990 ◽  
Vol 137 (6) ◽  
pp. 415 ◽  
Author(s):  
E. Bergeault ◽  
B. Huyart ◽  
G. Geneves ◽  
L. Jallet
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document