scholarly journals Proficiency Testing of Standardized Samples Shows Very High Interlaboratory Agreement for Clinical Next-Generation Sequencing–Based Oncology Assays

2018 ◽  
Vol 143 (4) ◽  
pp. 463-471 ◽  
Author(s):  
Jason D. Merker ◽  
Kelly Devereaux ◽  
A. John Iafrate ◽  
Suzanne Kamel-Reid ◽  
Annette S. Kim ◽  
...  

Context.— Next-generation sequencing–based assays are being increasingly used in the clinical setting for the detection of somatic variants in solid tumors, but limited data are available regarding the interlaboratory performance of these assays. Objective.— To examine proficiency testing data from the initial College of American Pathologists (CAP) Next-Generation Sequencing Solid Tumor survey to report on laboratory performance. Design.— CAP proficiency testing results from 111 laboratories were analyzed for accuracy and associated assay performance characteristics. Results.— The overall accuracy observed for all variants was 98.3%. Rare false-negative results could not be attributed to sequencing platform, selection method, or other assay characteristics. The median and average of the variant allele fractions reported by the laboratories were within 10% of those orthogonally determined by digital polymerase chain reaction for each variant. The median coverage reported at the variant sites ranged from 1922 to 3297. Conclusions.— Laboratories demonstrated an overall accuracy of greater than 98% with high specificity when examining 10 clinically relevant somatic single-nucleotide variants with a variant allele fraction of 15% or greater. These initial data suggest excellent performance, but further ongoing studies are needed to evaluate the performance of lower variant allele fractions and additional variant types.

2020 ◽  
Vol 144 (8) ◽  
pp. 959-966 ◽  
Author(s):  
Alissa Keegan ◽  
Julia A. Bridge ◽  
Neal I. Lindeman ◽  
Thomas A. Long ◽  
Jason D. Merker ◽  
...  

Context.— As laboratories increasingly turn from single-analyte testing in hematologic malignancies to next-generation sequencing–based panel testing, there is a corresponding need for proficiency testing to ensure adequate performance of these next-generation sequencing assays for optimal patient care. Objective.— To report the performance of laboratories on proficiency testing from the first 4 College of American Pathologists Next-Generation Sequencing Hematologic Malignancy surveys. Design.— College of American Pathologists proficiency testing results for 36 different engineered variants and/or allele fractions as well as a sample with no pathogenic variants were analyzed for accuracy and associated assay performance characteristics. Results.— The overall sensitivity observed for all variants was 93.5% (2190 of 2341) with 99.8% specificity (22 800 of 22 840). The false-negative rate was 6.5% (151 of 2341), and the largest single cause of these errors was difficulty in identifying variants in the sequence of CEBPA that is rich in cytosines and guanines. False-positive results (0.18%; 40 of 22 840) were most likely the result of preanalytic or postanalytic errors. Interestingly, the variant allele fractions were almost uniformly lower than the engineered fraction (as measured by digital polymerase chain reaction). Extensive troubleshooting identified a multifactorial cause for the low variant allele fractions, a result of an interaction between the linearized nature of the plasmid and the Illumina TruSeq chemistry. Conclusions.— Laboratories demonstrated an overall accuracy of 99.2% (24 990 of 25 181) with 99.8% specificity and 93.5% sensitivity when examining 36 clinically relevant somatic single-nucleotide variants with a variant allele fraction of 10% or greater. The data also highlight an issue with artificial linearized plasmids as survey material for next-generation sequencing.


2016 ◽  
Vol 140 (10) ◽  
pp. 1085-1091 ◽  
Author(s):  
Eric J. Duncavage ◽  
Haley J. Abel ◽  
Jason D. Merker ◽  
John B. Bodner ◽  
Qin Zhao ◽  
...  

Context.—Most current proficiency testing challenges for next-generation sequencing assays are methods-based proficiency testing surveys that use DNA from characterized reference samples to test both the wet-bench and bioinformatics/dry-bench aspects of the tests. Methods-based proficiency testing surveys are limited by the number and types of mutations that either are naturally present or can be introduced into a single DNA sample. Objective.—To address these limitations by exploring a model of in silico proficiency testing in which sequence data from a single well-characterized specimen are manipulated electronically. Design.—DNA from the College of American Pathologists reference genome was enriched using the Illumina TruSeq and Life Technologies AmpliSeq panels and sequenced on the MiSeq and Ion Torrent platforms, respectively. The resulting data were mutagenized in silico and 26 variants, including single-nucleotide variants, deletions, and dinucleotide substitutions, were added at variant allele fractions (VAFs) from 10% to 50%. Participating clinical laboratories downloaded these files and analyzed them using their clinical bioinformatics pipelines. Results.—Laboratories using the AmpliSeq/Ion Torrent and/or the TruSeq/MiSeq participated in the 2 surveys. On average, laboratories identified 24.6 of 26 variants (95%) overall and 21.4 of 22 variants (97%) with VAFs greater than 15%. No false-positive calls were reported. The most frequently missed variants were single-nucleotide variants with VAFs less than 15%. Across both challenges, reported VAF concordance was excellent, with less than 1% median absolute difference between the simulated VAF and mean reported VAF. Conclusions.—The results indicate that in silico proficiency testing is a feasible approach for methods-based proficiency testing, and demonstrate that the sensitivity and specificity of current next-generation sequencing bioinformatics across clinical laboratories are high.


2021 ◽  
Vol 8 (Supplement_1) ◽  
pp. S436-S436
Author(s):  
Rachel Downey Quick ◽  
Kelli A Martinez ◽  
Susan M Russo ◽  
Sarah E McGwier ◽  
Rachel A Quirt ◽  
...  

Abstract Background Pathogen testing using next-generation sequencing of microbial cell-free DNA (NGS cfDNA) is a promising diagnostic tool to identify pathogens that might not be detected using conventional lab evaluation. Considering the cost of this test, it is important to determine when it is most useful to the plan of care (POC). Figure 1. Unit of admission among cases Figure 2. Patient characteristics in cases determined to be valuable and not valuable to the plan of care (POC) Methods In this retrospective study, we collected data from the medical charts of 50 consecutive NGS cfDNA tests in a free-standing children’s hospital. We evaluated patients for demographics, underlying conditions, diagnosis at time of testing, conventional laboratory testing and timing, medical treatment, and NGS cfDNA test results for clinical relevance or false negative results compared to conventional testing. The primary goal was to identify patients for whom the NGS cfDNA testing affected the POC. Charts were reviewed, and determinations regarding whether the result influenced the POC were confirmed by a provider. Results We were unable to differentiate patients with clinically valuable NGS cfDNA results (Fig 1 & 2). Among those with NGS cfDNA results valuable to the POC (n=22), both negative and positive testing guided POC (13 valuable negative vs. 9 diagnostic cases). In the total sample, 5 cases (10%) had a clinically relevant pathogen identified through conventional testing, but not through NGS cfDNA and 2 cases had antimicrobial resistance on culture, which is not detected by NGS cfDNA. Conclusion While we did not find a specific clinical profile for NGS cfDNA use, positive results were essential to the diagnosis in 18% of cases with otherwise negative laboratory evaluation for the pathogen identified in NGS cfDNA. Negative tests affected the POC in 26% of cases by avoiding unnecessary antimicrobials in high risk immunocompromised patients and patients that presented with low-risk of infection, but unclear disease process. Caution must be exercised with reliance on this test with respect to antimicrobial resistance and risk of false negative results. Disclosures All Authors: No reported disclosures


Author(s):  
Valentina Nardi ◽  
Karen D. Tsuchiya ◽  
Annette S. Kim ◽  
Lora J. H. Bean ◽  
Jaimie G. Halley ◽  
...  

Context.— Next-generation sequencing–based assays are increasingly used in clinical molecular laboratories to detect somatic variants in solid tumors and hematologic malignancies and to detect constitutional variants. Proficiency testing data are potential sources of information about challenges in performing these assays. Objective.— To examine the most common sources of unacceptable results from the College of American Pathologists Next-Generation Sequencing Bioinformatics, Hematological Malignancies, Solid Tumor, and Germline surveys, and provide recommendations on how to avoid these pitfalls and improve performance. Design.— The College of American Pathologists next-generation sequencing somatic and germline proficiency testing survey results from 2016 to 2019 were analyzed to identify the most common causes of unacceptable results. Results.— On somatic and germline proficiency testing surveys, 95.9% (18 815/19 623) and 97.8% (33 890/34 641) of all variants were correctly identified, respectively. The most common causes of unacceptable results related to sequencing were false-negative errors in genomic regions that were difficult to sequence because of high GC content. False-positive errors occurred in the context of homopolymers and pseudogenes. Recurrent errors in variant annotation were seen for dinucleotide and duplication variants and included unacceptable transcript selection and outdated variant nomenclature. A small percentage of preanalytic or postanalytic errors were attributed to specimen swaps and transcription errors. Conclusions.— Laboratories demonstrate overall excellent performance for detecting variants in both somatic and germline proficiency testing surveys. Proficiency testing survey results highlight infrequent, but recurrent, analytic and nonanalytic challenges in performing next- generation sequencing–based assays and point to remedies to help laboratories improve performance.


2020 ◽  
Vol 144 (12) ◽  
pp. 1535-1546
Author(s):  
Kyung Park ◽  
Hung Tran ◽  
Kenneth W. Eng ◽  
Sinan Ramazanoglu ◽  
Rebecca M. Marrero Rolon ◽  
...  

Context.— An increasing number of molecular laboratories are implementing next-generation sequencing platforms to identify clinically actionable and relevant genomic alterations for precision oncology. Objective.— To describe the validation studies as per New York State–Department of Health (NYS-DOH) guidelines for the Oncomine Comprehensive Panel v2, which was originally tailored to the National Cancer Institute Molecular Analysis for Therapy Choice (NCI-MATCH) trial. Design.— Accuracy, precision, and reproducibility were investigated by using 130 DNA and 18 RNA samples from cytology cell blocks; formalin-fixed, paraffin-embedded tissues; and frozen samples. Analytic sensitivity and specificity were tested by using ATCC and HapMap cell lines. Results.— High accuracy and precision/reproducibility were observed for single nucleotide variants and insertion/deletions. We also share our experience in the detection of gene fusions and copy number alterations from an amplicon-based sequencing platform. After sequencing analysis, variant annotation and report generation were performed by using the institutional knowledgebase. Conclusions.— This study serves as an example for validating a comprehensive targeted next-generation sequencing assay with both DNASeq and RNASeq components for NYS-DOH.


Blood ◽  
2018 ◽  
Vol 132 (Supplement 1) ◽  
pp. 1566-1566 ◽  
Author(s):  
Amanda Kofides ◽  
Maria Demos ◽  
Nickolas Tsakmaklis ◽  
Lian Xu ◽  
Xia Liu ◽  
...  

Abstract Background Mutations in MYD88 are highly recurring in Waldenstrom's Macroglobulinemia (WM) patients and are important for establishing the diagnosis of WM. The most common mutation in MYD88 is c.978T>C resulting a proline substitution for leucine at amino acid position 265 (p.Leu265Pro). Both allele specific PCR (AS-PCR) and clinical diagnostic next generation sequencing (NGS) panels are used to detect mutated MYD88, though they differ in sensitivity and scope. In this study we screened 734 patients with WM by AS-PCR for MYD88 c.978T>C MYD88 followed by Sanger sequencing to clarify negative results for non-MYD88 p.Leu265Pro mutations and compared the findings to clinical NGS panel data from the same biopsy when available. We also investigated MYD88 isoform dysregulation and isoform specific effects of the observed mutations that may impact mutated MYD88 regulation which has not been previously studied in WM. Methods DNA from CD19-selected bone marrow mononuclear cells (BMMC) of 734 WM patients were used for the MYD88 c.978T>C AS-PCR assay previously described by us (Xu et al, Blood 2013). For patients wild-type for MYD88 c.978T>C by AS-PCR, Sanger sequencing of the open reading frame of MYD88 was performed for both DNA and RNA simultaneously isolated from CD19-selected BMMC. DNA was also used to validate the presence of c.978T>C by Sanger. Findings were compared to 222/734 (30.2%) patients who also underwent illumina miSeq based targeted next generation sequencing on a clinical diagnostic platform using unselected BMMC. NGS isoform specific expression estimates were calculated using Salmon for 77 WM patients and 34 healthy donors (Hunter et al, Blood 2016). Results 688/734 (93.7%) WM patients tested positive for the c.978T>C mutation. To confirm these results, Sanger sequencing at the DNA level covering the c.978T>C mutation was performed in 361/688 (52.5%) patients confirming the presence of the mutation in all cases. These Sanger studies revealed that one patient had two somatic mutations in addition to c.978T>C. Of the 46/734 (6.3%) that were wild-type by AS-PCR, 18 had cDNA available to screen for alternative MYD88 mutations. Of these, 13/18 (72.2%) were confirmed to be truly wild type for MYD88, and 5/18 (27.8%) harbored alternative MYD88 mutations making up 0.7% of the study population. Taken together 693/734 (94.4%) of patients were found to harbor somatic MYD88 mutations. Of the 222 patients form whom matching NGS panel data was available, the finding between the NGS and AS-PCR studies were largely concordant. The only discrepancies observed were 69 (31.1%) cases where targeted NGS gave false negative results for c.978T>C but was detected by AS-PCR. Of the four patients with alternative MYD88 mutations, one patient had a dinucleotide substitution that also resulted in p.Leu265Pro but tested as wild-type by AS-PCR, two patients each had one previously documented mutation (either pVal217Phe or p.Ser243Asn) and one patient had a mutation that was synonymous at the protein level (p.Phe277Phe). The patient with the two novel mutations in addition to c.978T>C had a mutation in the polypyrimidine track leading to the final exon and one resulting in p.Gly259Gly in the primary transcript but presents as a highly disruptive p.Val199Glu in the shorter regulatory isoforms. This is similar to c.978T>C which presents as p.L265P in the primary transcripts but acts as a stop loss in the shorter isoforms. We therefore looked for evidence of isoform level dysregulation in MYD88 using RNASeq and found highly significant and distinctive MYD88 isoform signatures for MYD88 mutant, MYD88 wild-type and healthy donor samples (Figure 1). Conclusions Using CD19-selected BMMC, MYD88 c.978T>C (p.Leu265Pro) was found in 93.7% of 734 patients, while non-c.978T>C mutations were present in <1% of WM population. Discordance with targeted NGS is common, with a false negative rate of 31%. Distinct isoform usage patterns and isoform specific mutational effects among MYD88 mutated patients was observed, highly suggestive of a functional role for MYD88 splicing in WM pathogenesis. Figure 1. Figure 1. Disclosures Castillo: Millennium: Research Funding; Janssen: Consultancy, Research Funding; Pharmacyclics: Consultancy, Research Funding; Abbvie: Consultancy, Research Funding; Genentech: Consultancy; Beigene: Consultancy, Research Funding. Treon:Johnson & Johnson: Consultancy; Janssen: Consultancy, Other: Travel, Accommodations, Expenses; BMS: Research Funding; Pharmacyclics: Consultancy, Other: Travel, Accommodations, Expenses, Research Funding. Hunter:Pharmacyclics: Consultancy.


2017 ◽  
Vol 141 (12) ◽  
pp. 1679-1685 ◽  
Author(s):  
Rakesh Nagarajan ◽  
Angela N. Bartley ◽  
Julia A. Bridge ◽  
Lawrence J. Jennings ◽  
Suzanne Kamel-Reid ◽  
...  

Context.— Detection of acquired variants in cancer is a paradigm of precision medicine, yet little has been reported about clinical laboratory practices across a broad range of laboratories. Objective.— To use College of American Pathologists proficiency testing survey results to report on the results from surveys on next-generation sequencing–based oncology testing practices. Design.— College of American Pathologists proficiency testing survey results from more than 250 laboratories currently performing molecular oncology testing were used to determine laboratory trends in next-generation sequencing–based oncology testing. Results.— These presented data provide key information about the number of laboratories that currently offer or are planning to offer next-generation sequencing–based oncology testing. Furthermore, we present data from 60 laboratories performing next-generation sequencing–based oncology testing regarding specimen requirements and assay characteristics. The findings indicate that most laboratories are performing tumor-only targeted sequencing to detect single-nucleotide variants and small insertions and deletions, using desktop sequencers and predesigned commercial kits. Despite these trends, a diversity of approaches to testing exists. Conclusions.— This information should be useful to further inform a variety of topics, including national discussions involving clinical laboratory quality systems, regulation and oversight of next-generation sequencing–based oncology testing, and precision oncology efforts in a data-driven manner.


Author(s):  
Maheen Nisar

Rapid progress is being made in the development of next-generation sequencing (NGS) technologies, allowing repeated findings of new genes and a more in-depth analysis of genetic polymorphisms behind the pathogenesis of a disease. In a field such as psychiatry, characteristic of vague and highly variable somatic manifestations, these technologies have brought great advances towards diagnosing various psychiatric and mental disorders, identifying high-risk individuals and towards more effective corresponding treatment. Psychiatry has the difficult task of diagnosing and treating mental disorders without being able to invariably and definitively establish the properties of its illness. This calls for diagnostic technologies that go beyond the traditional ways of gene manipulation to more advanced methods mainly focusing on new gene polymorphism discoveries, one of them being NGS. This enables the identification of hundreds of common and rare genetic variations contributing to behavioral and psychological conditions. Clinical NGS has been useful to detect copy number and single nucleotide variants and to identify structural rearrangements that have been challenging for standard bioinformatics algorithms. The main objective of this article is to review the recent applications of NGS in the diagnosis of major psychiatric disorders, and hence gauge the extent of its impact in the field. A comprehensive PubMed search was conducted and papers published from 2013-2018 were included, using the keywords, “schizophrenia” or “bipolar disorder” or “depressive disorder” or “attention deficit disorder” or “autism spectrum disorder” and “next-generation sequencing”


HLA ◽  
2021 ◽  
Author(s):  
Mei San Tang ◽  
Brian F. Duffy ◽  
Jo‐Ellen Jennemann ◽  
Bijal A. Parikh ◽  
Chang Liu

Sign in / Sign up

Export Citation Format

Share Document