scholarly journals ScaleQC: a scalable lossy to lossless solution for NGS data compression

2020 ◽  
Vol 36 (17) ◽  
pp. 4551-4559 ◽  
Author(s):  
Rongshan Yu ◽  
Wenxian Yang
Keyword(s):  
Lossless Compression ◽  
Supplementary Information ◽  
Next Generation Sequencing Data ◽  
Sequencing Data ◽  
Source Codes ◽  
Compression Performance ◽  
Data Rates ◽  
Quality Value ◽  
Ngs Data ◽  
Bit Stream

Abstract Motivation Per-base quality values in Next Generation Sequencing data take a significant portion of storage even after compression. Lossy compression technologies could further reduce the space used by quality values. However, in many applications, lossless compression is still desired. Hence, sequencing data in multiple file formats have to be prepared for different applications. Results We developed a scalable lossy to lossless compression solution for quality values named ScaleQC (Scalable Quality value Compression). ScaleQC is able to provide the so-called bit-stream level scalability that the losslessly compressed bit-stream by ScaleQC can be further truncated to lower data rates without incurring an expensive transcoding operation. Despite its scalability, ScaleQC still achieves comparable compression performance at both lossless and lossy data rates compared to the existing lossless or lossy compressors. Availability and implementation ScaleQC has been integrated with SAMtools as a special quality value encoding mode for CRAM. Its source codes can be obtained from our integrated SAMtools (https://github.com/xmuyulab/samtools) with dependency on integrated HTSlib (https://github.com/xmuyulab/htslib). Supplementary information Supplementary data are available at Bioinformatics online.

scholarly journals ScaleQC: A Scalable Lossy to Lossless Solution for NGS Sequencing Data Compression

2020 ◽  
Author(s):  
Rogshan Yu ◽  
Wenxian Yang
Keyword(s):  
State Of The Art ◽  
Lossless Compression ◽  
Sequencing Data ◽  
Source Codes ◽  
Compression Performance ◽  
Link Type ◽  
File Formats ◽  
Data Rates ◽  
Special Quality ◽  
Bit Stream

AbstractMotivationPer-base quality values in NGS sequencing data take a significant portion of storage even after compression. Lossy compression technologies could further reduce the space used by quality values. However, in many applications lossless compression is still desired. Hence, sequencing data in multiple file formats have to be prepared for different applications.ResultsWe developed a scalable lossy to lossless compression solution for quality values named ScaleQC. ScaleQC is able to provide bit-stream level scalability. More specifically, the losslessly compressed bit-stream by ScaleQC can be further truncated to lower data rates without re-encoding. Despite its scalability, ScaleQC still achieves same or better compression performance at both lossless and lossy data rates compared to the state-of-the-art lossless or lossy compressors.AvailabilityScaleQC has been integrated with SAMtools as a special quality value encoding mode for CRAM. Its source codes can be obtained from our integrated SAMtools (https://github.com/xmuyulab/samtools) with dependency on integrated HTSlib (https://github.com/xmuyulab/htslib).

scholarly journals Ktrim: an extra-fast and accurate adapter- and quality-trimmer for sequencing data

2020 ◽  
Vol 36 (11) ◽  
pp. 3561-3562 ◽  
Author(s):  
Kun Sun
Keyword(s):  
Data Preprocessing ◽  
Poor Quality ◽  
Read Length ◽  
Supplementary Information ◽  
Sequencing Data ◽  
Efficient Tool ◽  
Source Codes ◽  
Next Generation Sequencing Ngs ◽  
Ngs Data ◽  
Generation Sequencing

Abstract Motivation Next-generation sequencing (NGS) data frequently suffer from poor-quality cycles and adapter contaminations therefore need to be preprocessed before downstream analyses. With the ever-growing throughput and read length of modern sequencers, the preprocessing step turns to be a bottleneck in data analysis due to unmet performance of current tools. Extra-fast and accurate adapter- and quality-trimming tools for sequencing data preprocessing are therefore still of urgent demand. Results Ktrim was developed in this work. Key features of Ktrim include: built-in support to adapters of common library preparation kits; supports user-supplied, customized adapter sequences; supports both paired-end and single-end data; supports parallelization to accelerate the analysis. Ktrim was ∼2–18 times faster than current tools and also showed high accuracy when applied on the testing datasets. Ktrim could thus serve as a valuable and efficient tool for short-read NGS data preprocessing. Availability and implementation Source codes and scripts to reproduce the results descripted in this article are freely available at https://github.com/hellosunking/Ktrim/, distributed under the GPL v3 license. Contact [email protected] Supplementary information Supplementary data are available at Bioinformatics online.

scholarly journals NGSremix: A software tool for estimating pairwise relatedness between admixed individuals from next-generation sequencing data

2021 ◽  
Author(s):  
Anne Krogh Nøhr ◽  
Kristian Hanghøj ◽  
Genis Garcia Erill ◽  
Zilong Li ◽  
Ida Moltke ◽  
...  
Keyword(s):  
Next Generation Sequencing ◽  
Genetic Research ◽  
Likelihood Estimation ◽  
Software Tool ◽  
Estimation Methods ◽  
Next Generation Sequencing Data ◽  
Next Generation ◽  
Sequencing Data ◽  
Ngs Data ◽  
Generation Sequencing

Abstract Estimation of relatedness between pairs of individuals is important in many genetic research areas. When estimating relatedness, it is important to account for admixture if this is present. However, the methods that can account for admixture are all based on genotype data as input, which is a problem for low-depth next-generation sequencing (NGS) data from which genotypes are called with high uncertainty. Here we present a software tool, NGSremix, for maximum likelihood estimation of relatedness between pairs of admixed individuals from low-depth NGS data, which takes the uncertainty of the genotypes into account via genotype likelihoods. Using both simulated and real NGS data for admixed individuals with an average depth of 4x or below we show that our method works well and clearly outperforms all the commonly used state-of-the-art relatedness estimation methods PLINK, KING, relateAdmix, and ngsRelate that all perform quite poorly. Hence, NGSremix is a useful new tool for estimating relatedness in admixed populations from low-depth NGS data. NGSremix is implemented in C/C ++ in a multi-threaded software and is freely available on Github https://github.com/KHanghoj/NGSremix.

scholarly journals ALSgeneScanner: a pipeline for the analysis and interpretation of DNA NGS data of ALS patients

2018 ◽  
Author(s):  
Alfredo Iacoangeli ◽  
Ahmad Al Khleifat ◽  
William Sproviero ◽  
Aleksey Shatunov ◽  
Ashley R Jones ◽  
...  
Keyword(s):  
Motor Neurons ◽  
Health Care Professionals ◽  
Sequence Data ◽  
Whole Genome Sequence ◽  
Next Generation Sequencing Data ◽  
Sequencing Data ◽  
Whole Exome ◽  
Exome Sequence Data ◽  
Als Patients ◽  
Ngs Data

AbstractAmyotrophic lateral sclerosis (ALS, MND) is a neurodegenerative disease of upper and lower motor neurons resulting in death from neuromuscular respiratory failure, typically within two years of first symptoms. Genetic factors are an important cause of ALS, with variants in more than 25 genes having strong evidence, and weaker evidence available for variants in more than 120 genes. With the increasing availability of Next-Generation sequencing data, non-specialists, including health care professionals and patients, are obtaining their genomic information without a corresponding ability to analyse and interpret it. Furthermore, the relevance of novel or existing variants in ALS genes is not always apparent. Here we present ALSgeneScanner, a tool that is easy to install and use, able to provide an automatic, detailed, annotated report, on a list of ALS genes from whole genome sequence data in a few hours and whole exome sequence data in about one hour on a readily available mid-range computer. This will be of value to non-specialists and aid in the interpretation of the relevance of novel and existing variants identified in DNA sequencing data.

scholarly journals VikNGS: A C ++ Variant Integration Kit for Next Generation Sequencing Association Analysis

2019 ◽  
Author(s):  
Zeynep Baskurt ◽  
Scott Mastromatteo ◽  
Jiafen Gong ◽  
Richard F Wintle ◽  
Stephen W Scherer ◽  
...  
Keyword(s):  
Next Generation Sequencing ◽  
Genetic Association ◽  
Association Analysis ◽  
Supplementary Information ◽  
Next Generation Sequencing Data ◽  
Data Sets ◽  
Next Generation ◽  
Sequencing Data ◽  
Combining Data ◽  
Generation Sequencing

Abstract Integration of next generation sequencing data (NGS) across different research studies can improve the power of genetic association testing by increasing sample size and can obviate the need for sequencing controls. If differential genotype uncertainty across studies is not accounted for, combining data sets can produce spurious association results. We developed the Variant Integration Kit for NGS (VikNGS), a fast cross-platform software package, to enable aggregation of several data sets for rare and common variant genetic association analysis of quantitative and binary traits with covariate adjustment. VikNGS also includes a graphical user interface, power simulation functionality and data visualization tools. Availability The VikNGS package can be downloaded at http://www.tcag.ca/tools/index.html. Supplementary information Supplementary data are available at Bioinformatics online.

ADFinder: accurate detection of programmed DNA elimination using NGS high-throughput sequencing data

2020 ◽  
Vol 36 (12) ◽  
pp. 3632-3636 ◽  
Author(s):  
Weibo Zheng ◽  
Jing Chen ◽  
Thomas G Doak ◽  
Weibo Song ◽  
Ying Yan
Keyword(s):  
High Throughput ◽  
Large Scale ◽  
High Throughput Sequencing ◽  
Supplementary Information ◽  
Sequencing Data ◽  
Source Codes ◽  
High Throughput Sequencing Data ◽  
Dna Elimination ◽  
Multiple Alternative ◽  
Dna Splicing

Abstract Motivation Programmed DNA elimination (PDE) plays a crucial role in the transitions between germline and somatic genomes in diverse organisms ranging from unicellular ciliates to multicellular nematodes. However, software specific for the detection of DNA splicing events is scarce. In this paper, we describe Accurate Deletion Finder (ADFinder), an efficient detector of PDEs using high-throughput sequencing data. ADFinder can predict PDEs with relatively low sequencing coverage, detect multiple alternative splicing forms in the same genomic location and calculate the frequency for each splicing event. This software will facilitate research of PDEs and all down-stream analyses. Results By analyzing genome-wide DNA splicing events in two micronuclear genomes of Oxytricha trifallax and Tetrahymena thermophila, we prove that ADFinder is effective in predicting large scale PDEs. Availability and implementation The source codes and manual of ADFinder are available in our GitHub website: https://github.com/weibozheng/ADFinder. Supplementary information Supplementary data are available at Bioinformatics online.

scholarly journals A Novel Method to Detect Bias in Short Read NGS Data

2017 ◽  
Vol 14 (3) ◽  
Author(s):  
Jamie Alnasir ◽  
Hugh P. Shanahan
Keyword(s):  
Biological Significance ◽  
Gc Content ◽  
Next Generation Sequencing Data ◽  
Data Sets ◽  
Sequencing Data ◽  
Data Set ◽  
Short Read ◽  
Novel Method ◽  
Type Data ◽  
Ngs Data

AbstractDetecting sources of bias in transcriptomic data is essential to determine signals of Biological significance. We outline a novel method to detect sequence specific bias in short read Next Generation Sequencing data. This is based on determining intra-exon correlations between specific motifs. This requires a mild assumption that short reads sampled from specific regions from the same exon will be correlated with each other. This has been implemented on Apache Spark and used to analyse two D. melanogaster eye-antennal disc data sets generated at the same laboratory. The wild type data set in drosophila indicates a variation due to motif GC content that is more significant than that found due to exon GC content. The software is available online and could be applied for cross-experiment transcriptome data analysis in eukaryotes.

WBFQC: A new approach for compressing next-generation sequencing data splitting into homogeneous streams

2018 ◽  
Vol 16 (05) ◽  
pp. 1850018 ◽  
Author(s):  
Sanjeev Kumar ◽  
Suneeta Agarwal ◽  
Ranvijay
Keyword(s):  
Next Generation Sequencing ◽  
Genomic Data ◽  
Next Generation Sequencing Data ◽  
Next Generation ◽  
Sequencing Data ◽  
Compression Technique ◽  
Compression Algorithms ◽  
Ngs Data ◽  
And Storage ◽  
Generation Sequencing

Genomic data nowadays is playing a vital role in number of fields such as personalized medicine, forensic, drug discovery, sequence alignment and agriculture, etc. With the advancements and reduction in the cost of next-generation sequencing (NGS) technology, these data are growing exponentially. NGS data are being generated more rapidly than they could be significantly analyzed. Thus, there is much scope for developing novel data compression algorithms to facilitate data analysis along with data transfer and storage directly. An innovative compression technique is proposed here to address the problem of transmission and storage of large NGS data. This paper presents a lossless non-reference-based FastQ file compression approach, segregating the data into three different streams and then applying appropriate and efficient compression algorithms on each. Experiments show that the proposed approach (WBFQC) outperforms other state-of-the-art approaches for compressing NGS data in terms of compression ratio (CR), and compression and decompression time. It also has random access capability over compressed genomic data. An open source FastQ compression tool is also provided here ( http://www.algorithm-skg.com/wbfqc/home.html ).

scholarly journals Pisces: An Accurate and Versatile Variant Caller for Somatic and Germline Next-Generation Sequencing Data

2018 ◽  
Author(s):  
Tamsen Dunn ◽  
Gwenn Berry ◽  
Dorothea Emig-Agius ◽  
Yu Jiang ◽  
Serena Lei ◽  
...  
Keyword(s):  
Next Generation Sequencing ◽  
Gene Mutations ◽  
Variant Calling ◽  
Amplicon Sequencing ◽  
Supplementary Information ◽  
Next Generation Sequencing Data ◽  
Next Generation ◽  
Sequencing Data ◽  
Ras Gene ◽  
Generation Sequencing

AbstractMotivationNext-Generation Sequencing (NGS) technology is transitioning quickly from research labs to clinical settings. The diagnosis and treatment selection for many acquired and autosomal conditions necessitate a method for accurately detecting somatic and germline variants, suitable for the clinic.ResultsWe have developed Pisces, a rapid, versatile and accurate small variant calling suite designed for somatic and germline amplicon sequencing applications. Pisces accuracy is achieved by four distinct modules, the Pisces Read Stitcher, Pisces Variant Caller, the Pisces Variant Quality Recalibrator, and the Pisces Variant Phaser. Each module incorporates a number of novel algorithmic strategies aimed at reducing noise or increasing the likelihood of detecting a true variant.AvailabilityPisces is distributed under an open source license and can be downloaded from https://github.com/Illumina/Pisces. Pisces is available on the BaseSpace™ SequenceHub as part of the TruSeq Amplicon workflow and the Illumina Ampliseq Workflow. Pisces is distributed on Illumina sequencing platforms such as the MiSeq™, and is included in the Praxis™ Extended RAS Panel test which was recently approved by the FDA for the detection of multiple RAS gene [email protected] informationSupplementary data are available online.

scholarly journals An information-theoretic approach for measuring the distance of organ tissue samples using their transcriptomic signatures

2020 ◽  
Author(s):  
Dimitris V. Manatakis ◽  
Aaron VanDevender ◽  
Elias S. Manolakos
Keyword(s):  
Ex Vivo ◽  
Practical Importance ◽  
Supplementary Information ◽  
Next Generation Sequencing Data ◽  
Theoretic Approach ◽  
Sequencing Data ◽  
Tissue Samples ◽  
Human Organ ◽  
Information Theoretic ◽  
Organ Models

AbstractMotivationRecapitulating aspects of human organ functions using in-vitro (e.g., plates, transwells, etc.), in-vivo (e.g., mouse, rat, etc.), or ex-vivo (e.g., organ chips, 3D systems, etc.) organ models are of paramount importance for precision medicine and drug discovery. It will allow us to identify potential side effects and test the effectiveness of therapeutic approaches early in their design phase and will inform the development of accurate disease models. Developing mathematical methods to reliably compare the “distance/similarity” of organ models from/to the real human organ they represent is an understudied problem with important applications in biomedicine and tissue engineering.ResultsWe introduce the Transctiptomic Signature Distance, TSD, an information-theoretic distance for assessing the transcriptomic similarity of two tissue samples, or two groups of tissue samples. In developing TSD, we are leveraging next-generation sequencing data and information retrieved from well-curated databases providing signature gene sets characteristic for human organs. We present the justification and mathematical development of the new distance and demonstrate its effectiveness in different scenarios of practical importance using several publicly available RNA-seq [email protected] informationSupplementary data are available at bioRxiv.

Sign in / Sign up

Export Citation Format

Share Document