scholarly journals A generalized observation confirmation model to account for false positive error in species detection-nondetection data

2018 ◽  
Author(s):  
John D. J. Clare ◽  
Benjamin Zuckerberg ◽  
Philip A. Townsend

AbstractSpatially-indexed repeated detection-nondetection data is widely collected by ecologists interested in estimating parameters associated with species distribution, relative abundance, phenology, and more while accounting for imperfect detection. Recent model development has focused on accounting for false positive error as well, given growing recognition that misclassification is common across many sampling protocols. To date, however, the development of model-based solutions to false positive error has been largely restricted to occupancy models. We describe a general form of the observation confirmation protocol originally described for occupancy estimation that permits investigators to flexibly and intuitively extend several models for detection-nondetection data to account for false positive error. Simulation results demonstrate that estimators for relative abundance and arrival time exhibit relative bias greater than 20% under realistic levels of false positive prevalence (e.g., 5% of detections are false positive). Bias increases as true and false positives occur in more distinct places or times, but can also be sensitive to the values of the state variables of interest, sampling design, and sampling efficiency. Results from an empirical study focusing on patterns of gray fox relative abundance across Wisconsin, USA suggest that false positive error can also distort estimated spatial patterns often used to guide decision-making. The extended estimators described within typically improve performance at any level of confirmation, and when false positive error occurs at random and constitutes less than 10% of all detections, the estimators are essentially unbiased when more than 50 observations can be confirmed as true or false positives. The generalized form of the observation-confirmation protocol is a flexible model-based solution to false positive error useful for researchers collecting data with sampling devices like trail or smartphone cameras, acoustic recorders, or other techniques where classifications can be reviewed post-hoc.


Ecology ◽  
2020 ◽  
Author(s):  
John D.J. Clare ◽  
Philip A. Townsend ◽  
Benjamin Zuckerberg


2020 ◽  
Author(s):  
Kristy Martire ◽  
Agnes Bali ◽  
Kaye Ballantyne ◽  
Gary Edmond ◽  
Richard Kemp ◽  
...  

We do not know how often false positive reports are made in a range of forensic science disciplines. In the absence of this information it is important to understand the naive beliefs held by potential jurors about forensic science evidence reliability. It is these beliefs that will shape evaluations at trial. This descriptive study adds to our knowledge about naive beliefs by: 1) measuring jury-eligible (lay) perceptions of reliability for the largest range of forensic science disciplines to date, over three waves of data collection between 2011 and 2016 (n = 674); 2) calibrating reliability ratings with false positive report estimates; and 3) comparing lay reliability estimates with those of an opportunity sample of forensic practitioners (n = 53). Overall the data suggest that both jury-eligible participants and practitioners consider forensic evidence highly reliable. When compared to best or plausible estimates of reliability and error in the forensic sciences these views appear to overestimate reliability and underestimate the frequency of false positive errors. This result highlights the importance of collecting and disseminating empirically derived estimates of false positive error rates to ensure that practitioners and potential jurors have a realistic impression of the value of forensic science evidence.



1990 ◽  
Vol 15 (1) ◽  
pp. 39-52 ◽  
Author(s):  
Huynh Huynh

False positive and false negative error rates are studied for competency testing where examinees are permitted to retake the test if they fail to pass. Formulae are provided for the beta-binomial and Rasch models, and estimates based on these two models are compared for several typical situations. Although Rasch estimates are expected to be more accurate than beta-binomial estimates, differences among them are found not to be substantial in a number of practical situations. Under relatively general conditions and when test retaking is permitted, the probability of making a false negative error is zero. Under the same situation, and given that an examinee is a true nonmaster, the conditional probability of making a false positive error for this examinee is one.



2019 ◽  
Vol 302 ◽  
pp. 109877 ◽  
Author(s):  
Kristy A. Martire ◽  
Kaye N. Ballantyne ◽  
Agnes Bali ◽  
Gary Edmond ◽  
Richard I. Kemp ◽  
...  


2019 ◽  
Vol Volume 15 ◽  
pp. 3021-3032
Author(s):  
Ji-Yeon Chung ◽  
Hyung-Jun Yoon ◽  
Hu Won Kim ◽  
Kyu Yeong Choi ◽  
Jang Jae Lee ◽  
...  


Author(s):  
J. Rick Turner


Author(s):  
Helen F. Steenman ◽  
Bruce P. Hermann ◽  
Allen R. Wyler ◽  
E. T. Richey


Sign in / Sign up

Export Citation Format

Share Document