Compressing Inverted Indexes with Recursive Graph Bisection: A Reproducibility Study

Author(s):  
Joel Mackenzie ◽  
Antonio Mallia ◽  
Matthias Petri ◽  
J. Shane Culpepper ◽  
Torsten Suel
2021 ◽  
Vol 9 (5) ◽  
pp. e001904
Author(s):  
Javier Ramos-Paradas ◽  
Susana Hernández-Prieto ◽  
David Lora ◽  
Elena Sanchez ◽  
Aranzazu Rosado ◽  
...  

BackgroundTumor mutational burden (TMB) is a recently proposed predictive biomarker for immunotherapy in solid tumors, including non-small cell lung cancer (NSCLC). Available assays for TMB determination differ in horizontal coverage, gene content and algorithms, leading to discrepancies in results, impacting patient selection. A harmonization study of TMB assessment with available assays in a cohort of patients with NSCLC is urgently needed.MethodsWe evaluated the TMB assessment obtained with two marketed next generation sequencing panels: TruSight Oncology 500 (TSO500) and Oncomine Tumor Mutation Load (OTML) versus a reference assay (Foundation One, FO) in 96 NSCLC samples. Additionally, we studied the level of agreement among the three methods with respect to PD-L1 expression in tumors, checked the level of different immune infiltrates versus TMB, and performed an inter-laboratory reproducibility study. Finally, adjusted cut-off values were determined.ResultsBoth panels showed strong agreement with FO, with concordance correlation coefficients (CCC) of 0.933 (95% CI 0.908 to 0.959) for TSO500 and 0.881 (95% CI 0.840 to 0.922) for OTML. The corresponding CCCs were 0.951 (TSO500-FO) and 0.919 (OTML-FO) in tumors with <1% of cells expressing PD-L1 (PD-L1<1%; N=55), and 0.861 (TSO500-FO) and 0.722 (OTML-FO) in tumors with PD-L1≥1% (N=41). Inter-laboratory reproducibility analyses showed higher reproducibility with TSO500. No significant differences were found in terms of immune infiltration versus TMB. Adjusted cut-off values corresponding to 10 muts/Mb with FO needed to be lowered to 7.847 muts/Mb (TSO500) and 8.380 muts/Mb (OTML) to ensure a sensitivity >88%. With these cut-offs, the positive predictive value was 78.57% (95% CI 67.82 to 89.32) and the negative predictive value was 87.50% (95% CI 77.25 to 97.75) for TSO500, while for OTML they were 73.33% (95% CI 62.14 to 84.52) and 86.11% (95% CI 74.81 to 97.41), respectively.ConclusionsBoth panels exhibited robust analytical performances for TMB assessment, with stronger concordances in patients with negative PD-L1 expression. TSO500 showed a higher inter-laboratory reproducibility. The cut-offs for each assay were lowered to optimal overlap with FO.


2016 ◽  
Vol 48 (6) ◽  
pp. 727-732 ◽  
Author(s):  
D. Paladini ◽  
R. Birnbaum ◽  
G. Donarini ◽  
I. Maffeo ◽  
E. Fulcheri

2013 ◽  
Vol 69 (4) ◽  
pp. spcone-spcone
Author(s):  
Angus Z. Lau ◽  
Albert P. Chen ◽  
Jennifer Barry ◽  
John J. Graham ◽  
William Dominguez-Viqueira ◽  
...  

2017 ◽  
Vol 2017 ◽  
pp. 1-15 ◽  
Author(s):  
Chunghun Ha ◽  
David S. Kim ◽  
SeJoon Park

ANOVA gauge repeatability and reproducibility study is the most popular tool for measurement system analysis. Two experimental designs can be applied depending on the durability of the objects. If repeated measurements are possible or sufficient homogeneous nonrepeatable samples are available, crossed design is appropriate; otherwise, nested design should be used. In this paper, we investigated the adequacy of ANOVA gauge repeatability and reproducibility study from the perspective of practitioners. We proposed a Monte Carlo simulation that is close to the realistic procedure to evaluate the adequacy of both structures. During the evaluation, we considered the average performance metrics, percentage of correct decision, histogram shape, and symmetric mean absolute percentage error for the four popular performance metrics, namely, % Study Variation, % Contribution, % Tolerance, and the number of distinct categories. The experimental results show that the nested design fails to judge the precision of the gauge while the crossed design succeeds.


Sign in / Sign up

Export Citation Format

Share Document