Forensic science evidence: Naive estimates of false positive error rates and reliability

2020 ◽  
Author(s):  
Kristy Martire ◽  
Agnes Bali ◽  
Kaye Ballantyne ◽  
Gary Edmond ◽  
Richard Kemp ◽  
...  

We do not know how often false positive reports are made in a range of forensic science disciplines. In the absence of this information it is important to understand the naive beliefs held by potential jurors about forensic science evidence reliability. It is these beliefs that will shape evaluations at trial. This descriptive study adds to our knowledge about naive beliefs by: 1) measuring jury-eligible (lay) perceptions of reliability for the largest range of forensic science disciplines to date, over three waves of data collection between 2011 and 2016 (n = 674); 2) calibrating reliability ratings with false positive report estimates; and 3) comparing lay reliability estimates with those of an opportunity sample of forensic practitioners (n = 53). Overall the data suggest that both jury-eligible participants and practitioners consider forensic evidence highly reliable. When compared to best or plausible estimates of reliability and error in the forensic sciences these views appear to overestimate reliability and underestimate the frequency of false positive errors. This result highlights the importance of collecting and disseminating empirically derived estimates of false positive error rates to ensure that practitioners and potential jurors have a realistic impression of the value of forensic science evidence.

2019 ◽  
Vol 302 ◽  
pp. 109877 ◽  
Author(s):  
Kristy A. Martire ◽  
Kaye N. Ballantyne ◽  
Agnes Bali ◽  
Gary Edmond ◽  
Richard I. Kemp ◽  
...  

1990 ◽  
Vol 15 (1) ◽  
pp. 39-52 ◽  
Author(s):  
Huynh Huynh

False positive and false negative error rates are studied for competency testing where examinees are permitted to retake the test if they fail to pass. Formulae are provided for the beta-binomial and Rasch models, and estimates based on these two models are compared for several typical situations. Although Rasch estimates are expected to be more accurate than beta-binomial estimates, differences among them are found not to be substantial in a number of practical situations. Under relatively general conditions and when test retaking is permitted, the probability of making a false negative error is zero. Under the same situation, and given that an examinee is a true nonmaster, the conditional probability of making a false positive error for this examinee is one.


2019 ◽  
Author(s):  
Scott D. Blain ◽  
Julia Longenecker ◽  
Rachael Grazioplene ◽  
Bonnie Klimes-Dougan ◽  
Colin G. DeYoung

Positive symptoms of schizophrenia and its extended phenotype—often termed psychoticism or positive schizotypy—are characterized by the inclusion of novel, erroneous mental contents. One promising framework for explaining positive symptoms involves “apophenia,” conceptualized here as a disposition toward false positive errors. Apophenia and positive symptoms have shown relations to Openness to Experience, and all of these constructs involve tendencies toward pattern seeking. Nonetheless, few studies have investigated the relations between psychoticism and non-self-report indicators of apophenia, let alone the role of normal personality variation. The current research used structural equation models to test associations between psychoticism, openness, intelligence, and non-self-report indicators of apophenia comprising false positive error rates on a variety of computerized tasks. In Sample 1, 1193 participants completed digit identification, theory of mind, and emotion recognition tasks. In Sample 2, 195 participants completed auditory signal detection and semantic word association tasks. Openness and psychoticism were positively correlated. Self-reported psychoticism, openness, and their shared variance were positively associated with apophenia, as indexed by false positive error rates, whether or not intelligence was controlled for. Apophenia was not associated with other personality traits, and openness and psychoticism were not associated with false negative errors. Standardized regression paths from openness-psychoticism to apophenia were in the range of .61 to .75. Findings provide insights into the measurement of apophenia and its relation to personality and psychopathology. Apophenia and pattern seeking may be promising constructs for unifying openness with the psychosis spectrum and for providing an explanation of positive symptoms. Results are discussed in the context of possible adaptive characteristics of apophenia, as well as potential risk factors for the development of psychotic disorders.


2020 ◽  
pp. jclinpath-2020-206726
Author(s):  
Cornelia Margaret Szecsei ◽  
Jon D Oxley

AimTo examine the effects of specialist reporting on error rates in prostate core biopsy diagnosis.MethodBiopsies were reported by eight specialist uropathologists over 3 years. New cancer diagnoses were double-reported and all biopsies were reviewed for the multidisciplinary team (MDT) meeting. Diagnostic alterations were recorded in supplementary reports and error rates were compared with a decade previously.Results2600 biopsies were reported. 64.1% contained adenocarcinoma, a 19.7% increase. The false-positive error rate had reduced from 0.4% to 0.06%. The false-negative error rate had increased from 1.5% to 1.8%, but represented fewer absolute errors due to increased cancer incidence.ConclusionsSpecialisation and double-reporting have reduced false-positive errors. MDT review of negative cores continues to identify a very low number of false-negative errors. Our data represents a ‘gold standard’ for prostate biopsy diagnostic error rates. Increased use of MRI-targeted biopsies may alter error rates and their future clinical significance.


Sign in / Sign up

Export Citation Format

Share Document