scholarly journals Modeling science trustworthiness under publish or perish pressure

2017 ◽  
Author(s):  
David Robert Grimes ◽  
Chris T. Bauch ◽  
John P.A. Ioannidis
Keyword(s):  
Intrinsic Value ◽  
False Positive Rate ◽  
Scientific Publication ◽  
Negative Consequences ◽  
Publish Or Perish ◽  
Negative Results ◽  
Positive Rate ◽  
Scientific Endeavor ◽  
Positive Results ◽  
Accurate Reporting

AbstractThe scientific endeavor pivots on the accurate reporting of experimental and theoretical findings, and consequently scientific publication is immensely important. As the number of active scientists continues to increase, there is concern that rewarding scientists chiefly on publication creates a perverse incentive where careless and fraudulent research can thrive. This is compounded by the predisposition of top-tier journals towards novel or positive findings rather than negative results or investigations that merely confirm a null hypothesis, despite their intrinsic value, potentially compounding a reproducibility crisis in several fields. This is a serious problem for both science and public trust in scientific findings. To date, there has been comparatively little mathematical modeling on the factors that influence science trustworthiness, despite the importance of quantifying the problem. In this work, we present a simple phenomenological model with cohorts of diligent, careless and unethical scientists with funding allocated based on published outputs. The results of this analysis suggest that trustworthiness of published science in a given field is strongly influenced by the false positive rate and the pressures from journals for positive results, and that decreasing available funding has negative consequences for the resulting trustworthiness. We also examine strategies to combat propagation of irreproducible science, including increasing fraud detection and awarding diligence, discussing the implications of these findings.

scholarly journals Modelling science trustworthiness under publish or perish pressure

2018 ◽  
Vol 5 (1) ◽  
pp. 171511 ◽  
Author(s):  
David Robert Grimes ◽  
Chris T. Bauch ◽  
John P. A. Ioannidis
Keyword(s):  
Phenomenological Model ◽  
False Positive ◽  
Null Hypothesis ◽  
False Positive Rate ◽  
Scientific Publication ◽  
Negative Consequences ◽  
Publish Or Perish ◽  
Positive Rate ◽  
Positive Results ◽  
Scientific Endeavour

Scientific publication is immensely important to the scientific endeavour. There is, however, concern that rewarding scientists chiefly on publication creates a perverse incentive, allowing careless and fraudulent conduct to thrive, compounded by the predisposition of top-tier journals towards novel, positive findings rather than investigations confirming null hypothesis. This potentially compounds a reproducibility crisis in several fields, and risks undermining science and public trust in scientific findings. To date, there has been comparatively little modelling on factors that influence science trustworthiness, despite the importance of quantifying the problem. We present a simple phenomenological model with cohorts of diligent, careless and unethical scientists, with funding allocated by published outputs. This analysis suggests that trustworthiness of published science in a given field is influenced by false positive rate, and pressures for positive results. We find decreasing available funding has negative consequences for resulting trustworthiness, and examine strategies to combat propagation of irreproducible science.

Properly collected plasma metanephrines excludes PPGL after false positive screening tests

2021 ◽  
Author(s):  
Gregory A Kline ◽  
Jessica Boyd ◽  
Brenda Polzin ◽  
Adrian Harvey ◽  
Janice L Pasieka ◽  
...  
Keyword(s):  
False Positive ◽  
Adrenal Mass ◽  
Chart Review ◽  
False Positive Rate ◽  
Total Positivity ◽  
Screening Tests ◽  
Positive Rate ◽  
Plasma Metanephrines ◽  
Positive Results ◽  
Urine Metanephrines

Abstract Context False positive results are common for pheochromocytoma/paraganglioma(PPGL) real-world screening. Objective Determine the correlation between screening urine and seated plasma metanephrines in outpatients where PPGL was absent, compared to meticulously prepared and supine-collected plasma metanephrines with age-adjusted references. Design Retrospective cohort study Setting Databases from a single-provider provincial laboratory(2012-2018), a validated PPGL registry and a manual chart review from a specialized endocrine testing unit. Patients PPGL registry data excluded known PPGL cases from the laboratory database. Outpatients having both urine and plasma metanephrines <90 days apart. Methods The correlation between urine and seated plasma measures along with the total positivity rate. All cases of plasma metanephrines drawn in the endocrine unit were reviewed for test indication and test positivity rate. Results There were 810 non-PPGL pairs of urine and plasma metanephrines in the laboratory database; 46.1% of urine metanephrines were reported high. Of seated outpatient plasma metanephrines drawn a median of 5.9 days later, 19.2% were also high (r=0.33 and 0.50 for normetanephrine and metanephrine, respectively). In contrast, the meticulously prepared and supine collected patients(n=139, 51% prior high urine metanephrines) had <3% rate of abnormal high results in patients without known PPGL/adrenal mass. Conclusions There was a poor-to-moderate correlation between urine and seated plasma metanephrines. Up to 20% of those with high urine measures also had high seated plasma metanephrines in the absence of PPGL. Properly prepared and collected supine plasma metanephrines had a false positive rate of <3% in the absence of known PPGL/adrenal mass.

Validation of Receptor-Binding Assays To Detect Antibiotics in Goat's Milk

2014 ◽  
Vol 77 (2) ◽  
pp. 308-313 ◽  
Author(s):  
M. C. BELTRÁN ◽  
M. BORRÀS ◽  
O. NAGEL ◽  
R. L. ALTHAUS ◽  
M. P. MOLINA
Keyword(s):  
Receptor Binding ◽  
False Positive ◽  
False Positive Rate ◽  
Quality Parameters ◽  
Lactation Period ◽  
Binding Assays ◽  
Goat’S Milk ◽  
Positive Rate ◽  
Goat's Milk ◽  
Positive Results

The suitability of different receptor-binding assays to detect antibiotics in raw goat's milk was investigated. Detection capability of most β-lactams and tetracyclines assessed applying the Betastar Combo, the SNAP Betalactam, the SNAP Tetracycline, and the Twinsensor tests was at or below maximum residue limits established by European legislation. Regarding test specificity, cross-reactions with antibiotics other than β-lactams and tetracyclines were not found, and no false-positive results were obtained for the Betastar Combo and the SNAP tests when bulk samples of goat's milk were analyzed. For the Twinsensor test, the false-positive rate was 1%. The performance of the Betastar Combo and the SNAP tests was practically unaffected by the milk quality parameters using individual samples of goat's milk collected at points throughout the entire lactation period (false-positive rate, ≤5%). However, a larger number of positive results were obtained by the Twinsensor test in this type of milk sample (>10%), especially in the last weeks of lactation. Interferences related to the use of the preservative azidiol were not observed in any case. Neither were any significant differences found in relation to the interpretation method (visual versus instrumental) applied. In general, the response of the Betastar Combo, SNAP, and Twinsensor tests was optimal for the analysis of bulk caprine milk; thus, they may be used to monitor milk for the presence of β-lactam and tetracycline residues in quality control programs.

scholarly journals Use of a Disposable Water Filter for Prevention of False-Positive Results due to Nontuberculosis Mycobacteria in a Clinical Laboratory Performing Routine Acid-Fast Staining for Tuberculosis

2007 ◽  
Vol 73 (19) ◽  
pp. 6296-6298 ◽  
Author(s):  
Hui-Zin Tu ◽  
Chiao-Shan Chen ◽  
Tsi-Shu Huang ◽  
Wen-Kuei Huang ◽  
Yao-shen Chen ◽  
...  
Keyword(s):  
False Positive ◽  
Clinical Laboratory ◽  
Tap Water ◽  
False Positive Rate ◽  
Acid Fast Bacillus ◽  
Water Filter ◽  
Point Of Use ◽  
Positive Rate ◽  
Positive Results ◽  
Laboratory Water

ABSTRACT A point-of-use 0.2-μm filter was evaluated for elimination of nontuberculosis mycobacteria in laboratory water to reduce false-positive acid-fast bacillus staining results. Use of the point-of-use filter can significantly reduce the false-positive rate to 1.2% compared to samples treated with tap water (10.7%) and deionized water (8.7%).

scholarly journals Use of Molecular Genetic Analyses in Danish Routine Newborn Screening

2021 ◽  
Vol 7 (3) ◽  
pp. 50
Author(s):  
Allan Meldgaard Lund ◽  
Flemming Wibrand ◽  
Kristin Skogstrand ◽  
Marie Bækvad-Hansen ◽  
Niels Gregersen ◽  
...  
Keyword(s):  
Newborn Screening ◽  
False Positive Rate ◽  
Genetic Diseases ◽  
Molecular Genetic ◽  
Negative Consequences ◽  
Genetic Analyses ◽  
Future Possibility ◽  
Targeted Ngs ◽  
Positive Rate ◽  
Second Tier

Historically, the analyses used for newborn screening (NBS) were biochemical, but increasingly, molecular genetic analyses are being introduced in the workflow. We describe the application of molecular genetic analyses in the Danish NBS programme and show that second-tier molecular genetic testing is useful to reduce the false positive rate while simultaneously providing information about the precise molecular genetic variant and thus informing therapeutic strategy and easing providing information to parents. When molecular genetic analyses are applied as second-tier testing, valuable functional data from biochemical methods are available and in our view, such targeted NGS technology should be implemented when possible in the NBS workflow. First-tier NGS technology may be a promising future possibility for disorders without a reliable biomarker and as a general approach to increase the adaptability of NBS for a broader range of genetic diseases, which is important in the current landscape of quickly evolving new therapeutic possibilities. However, studies on feasibility, sensitivity, and specificity are needed as well as more insight into what views the general population has towards using genetic analyses in NBS. This may be sensitive to some and could have potentially negative consequences for the NBS programme.

scholarly journals Analysis of SARS-CoV-2 PCR and Chest CT Findings at a Single Facility in Tokyo (Machida Municipal Hospital)

2021 ◽  
Vol 2021 ◽  
pp. 1-5
Author(s):  
Taisuke Kazuyori ◽  
Akihito Sato ◽  
Yasuhiro Morimoto ◽  
Kazuyoshi Kuwano
Keyword(s):  
Chest Ct ◽  
Background Characteristics ◽  
Rt Pcr ◽  
Important Indicator ◽  
Negative Results ◽  
Ct Findings ◽  
Positive Rate ◽  
Polymerase Chain ◽  
The City ◽  
Positive Results

Introduction. The SARS-CoV-2 reverse transcription polymerase chain reaction (RT-PCR) test is useful for diagnosing COVID-19, and the RT-PCR positive rate is an important indicator for estimating the incidence rate and number of infections. COVID-19 pneumonia is also associated with characteristic findings on chest CT, which can aid in diagnosis. Methods. We retrospectively evaluated patient background characteristics, the number of cases, the positivity rate, and chest CT findings for positive and negative cases in 672 patients who underwent RT-PCR for suspected COVID-19 at our hospital between April 3 and August 28, 2020. In addition, we compared trends in the positive rates at approximately weekly intervals with trends in the number of new infections in Machida City, Tokyo. Results. The study included 323 men and 349 women, with a median age of 46 years (range: 1 month–100 years). RT-PCR findings were positive in 37 cases, and the positive rate was 5.51%. Trends in the positive rate at our hospital and the number of new COVID-19 cases in the city were similar during the study period. Among patients with positive results, 15 (40.5%) had chest CT findings, and 14 had bilateral homogeneous GGOs. Among patients with negative results, 190 had chest CT findings at the time of examination, and 150 were diagnosed with bacterial pneumonia or bronchitis, with main findings consisting of consolidations and centrilobular opacities. Only 11 of these patients exhibited bilateral homogeneous GGOs. Conclusion. Bilateral homogeneous GGOs are characteristic of COVID-19 pneumonia and may aid in the diagnosis of COVID-19.

scholarly journals Commercial Laboratory IgM Testing forToxoplasma gondiiin Pregnancy: A 20-Year Experience

2005 ◽  
Vol 13 (3) ◽  
pp. 151-153 ◽  
Author(s):  
David J. Garry ◽  
Andrew Elimian ◽  
Vandy Wiencek ◽  
David A. Baker
Keyword(s):  
Predictive Value ◽  
False Positive ◽  
False Positive Rate ◽  
Reference Laboratory ◽  
Antibody Testing ◽  
Commercial Laboratory ◽  
Laboratory Results ◽  
Positive Rate ◽  
Acute Toxoplasmosis ◽  
Positive Results

Objective.This study was performed to review the clinical utility of commercial laboratoryToxoplasmosis-specific IgM testing during pregnancy and outcomes of the gestation at our institution.Methods.A retrospective review of all women referred for suspected acuteToxoplasma gondiiinfection during pregnancy from 1984 through 2004 was performed. Women were diagnosed with suspected acute toxoplasmosis based on commercial laboratory serologic antibody testing. All women had blood sent to a recognized reference laboratory for antibody testing within 2 weeks of the commercial laboratory results. The study protocol was approved by the Institutional Review Board. Chi-square analysis were used with a significance ofP< .05.Results.A total of 130 women were evaluated during the study period with 116 IgM positive results from the commercial laboratories. The commercial laboratory antibodies were as follows: IgM positive with IgG negative (n= 20), IgM positive with IgG positive (n= 96), and IgM negative with IgG positive (n= 14). There was a significant reduction in the IgM positive results when comparing commercial laboratory (n= 116) with the reference laboratory results (n= 28;p< .001). Acute toxoplasmosis infection was diagnosed in 7 (5%) of the women. All cases of acute toxoplasmosis infection had a positive commercial laboratory IgM result. The false positive rate for the commercial laboratory IgM was 88.6% and the diagnostic indices were sensitivity 100%, specificity 11.4%, positive predictive value 6% and negative predictive value 100%.Conclusion.Commercial laboratoryToxoplasmosis-specific IgM is associated with a high false positive rate. The commercial and reference laboratory IgM results identified all cases of acute toxoplasmosis infection. Commercial laboratories reflexively obtaining reference laboratory confirmation of positive results could reduce costs associated with testing, referrals, retesting, and invasive procedures.

False-positive and false-negative rates in meconium drug testing

1995 ◽  
Vol 41 (11) ◽  
pp. 1614-1616 ◽  
Author(s):  
C Moore ◽  
D Lewis ◽  
J Leikin
Keyword(s):  
Mass Spectrometry ◽  
False Positive ◽  
Drug Testing ◽  
False Positive Rate ◽  
False Negative ◽  
Gas Chromatography Mass Spectrometry ◽  
Negative Results ◽  
False Negative Results ◽  
The Matrix ◽  
Positive Rate

Abstract To determine the number of false-negative results produced by inefficient extraction of drugs from meconium, three published procedures were compared by using previously confirmed positive and negative meconium specimens. The methods were not equivalent in their ability to extract drugs from the matrix. To determine the number of false positives reported by the use of screen-only (unconfirmed) results, 535 screen-positive meconium specimens were subjects to confirmation by gas chromatography-mass spectrometry. Fifty-seven percent of the samples were confirmed positive for one or more of the drugs under investigation, showing that a false-positive rate as high as 43% may exist when unconfirmed screening results are used.

scholarly journals False Positive Cardiotoxicity Events in Cancer-Related Clinical Trials: Risks Related to Imperfect Noninvasive Parameters

Chemotherapy ◽  
2018 ◽  
Vol 63 (6) ◽  
pp. 324-329 ◽  
Author(s):  
Michael S. Ewer ◽  
Jay Herson
Keyword(s):  
False Positive ◽  
False Positive Rate ◽  
Left Ventricular ◽  
False Positives ◽  
Left Ventricular Ejection ◽  
True Positive ◽  
Ventricular Ejection Fraction ◽  
Positive Rate ◽  
Estimation Of Variance ◽  
Positive Results

Purpose: Cardiac ultrasound provides important structural and functional information that makes identification of cardiac abnormalities possible. Left ventricular ejection fraction (LVEF) provides the most commonly used parameter for recognition of treatment-related cardiac dysfunction. Random reading variance and physiologic factors influence LVEF and make the reported value imperfect. We attempt to quantitate the likelihood of false positive events by computer simulation. Methods: We simulated four visits on hypothetical trials. We assumed a baseline LVEF of 55% and normal distribution with regard to reading error and physiologic variation. 1,000 trials of sample size 1,500 were simulated. In a separate simulation, 1,000 patients entered with LVEFs of 45, 43, and 41% to estimate true positive incidence. Results: At each examination, less than 1.0% of false positives were noted. The cumulative false positive rate over four visits was 3.60%. True cardiotoxicity identification is satisfactory only when LVEF declines substantially. Conclusion: A 3.60% false positive rate in trials where the expected level of toxicity is low suggests that false positives are troubling and may exceed true positive results. Strategies to reduce the number of false positive results include making confirmatory studies mandatory. Evaluating increases along with decreases obtains some estimation of variance.

scholarly journals A method to alleviate false-positive results of the Elecsys HIV combi PT assay

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Xiaolan Lu ◽  
Minghong Zhang ◽  
Wen Liu ◽  
Nan Sheng ◽  
Qin Du ◽  
...  
Keyword(s):  
Hiv Infection ◽  
Retrospective Analysis ◽  
False Positive ◽  
False Positive Rate ◽  
Hiv Screening ◽  
Screening Assay ◽  
Positive Serum ◽  
Positive Rate ◽  
The Difference ◽  
Positive Results

AbstractTo explore the effects of urea dissociation on reducing false-positive results of  the Elecsys HIV combi PT assay. A retrospective analysis was used to evaluate the false-positive rate of the Elecsys HIV combi PT assay. Six false-positive sera, six positive sera and six sera from patients with early HIV infection were collected. Dissociation was performed using 1 mol/L, 2 mol/L, 4 mol/L, 6 mol/L, or 8 mol/L urea, and HIV screening assay were then detected to select the appropriate concentration of urea dissociation. Next, 55 false-positive sera and 15 sera from early HIV infection were used to verify the best concentration of urea to achieve dissociation. Retrospective analysis showed that the COI of the Elecsys HIV combi PT assay in false-positive sera ranged from 1.0 to 200.0, and approximately 97.01%(227/234) of false-positive sera were in the range of 1.0–15.0. The avidity index (AI) in positive and false-positive sera decreased as the urea dissociation concentration increased. When the dissociation concentration was 6 mol/L, the AI of false-positive serum was between 0.0234 and 0.2567, and the AI of early HIV infection sera was between 0.4325 and 0.5017. The difference in AI between false-positive and positive samples was significant. When negativity was defined as an AI of less than 0.3970, the sensitivity and specificity were 100.0% and 100.0%, respectively. Urea-mediated dissociation could significantly reduce the false-positive rate of the Elecsys HIV combi PT assay with a low COI. Our findings provided a reference for distinguishing positive and false-positive of the Elecsys HIV combi PT assay.

Sign in / Sign up

Export Citation Format

Share Document