scholarly journals Runcer-Necromancer: a method to rescue data from an interrupted run on MGISEQ-2000

F1000Research ◽  
2021 ◽  
Vol 10 ◽  
pp. 22
Author(s):  
Anna Pavlova ◽  
Vera Belova ◽  
Robert Afasizhev ◽  
Irina Bulusheva ◽  
Denis Rebrikov ◽  
...  

During the sequencing process, problems can occur with any device, including the MGISEQ-2000 (DNBSEQ-G400) platform. We encountered a power outage that resulted in a temporary shutdown of a sequencer in the middle of the run. Since barcode reading in MGISEQ-2000 takes place at the end of the run, it was impossible to use non-demultiplexed raw data. We decided to completely use up the same cartridge with reagents and flow cell loaded with DNB and started a new run in a shortened custom mode. We figured out how the MGISEQ-2000 converts preliminary data in .cal format into .fastq files and wrote a script named “Runcer-Necromacer” for merging .fastq files based on the analysis of their headers (available online: https://github.com/genomecenter/runcer-necromancer). Read merging proved to be possible because the MGISEQ-2000 flow cell has a patterned structure and each DNB has invariable coordinates on it, regardless of its position on the flow cell stage. We demonstrated the correctness of data merging by comparing sample analysis results with previously obtained .fastq files for them. Thus, we confirmed that it is possible to restart the device and save both parts of the interrupted run.

2020 ◽  
Author(s):  
Anna Pavlova ◽  
Vera Belova ◽  
Robert Afasizhev ◽  
Irina Bulusheva ◽  
Denis Rebrikov ◽  
...  

AbstractDuring the sequencing process, problems can occur with any device including the MGISEQ-2000 (DNBSEQ-G400) platform. We encountered a power outage that resulted in a temporary shutdown of a sequencer in the middle of the run. Since barcode reading in MGISEQ-2000 takes place at the end of the run, it was impossible to use non-demultiplexed raw data. We decided to completely use up the same cartridge with reagents and flow cell loaded with DNB and started a new run in a shortened custom mode. We figured out how the MGISEQ-2000 converts preliminary data in .cal format into .fastq files and wrote a script named “Runcer-Necromacer” for merging .fastq files based on the analysis of their headers (available online: https://github.com/genomecenter/runcer-necromancer). Read merging proved to be possible because the MGISEQ-2000 flow cell has a patterned structure and each DNB has invariable coordinates on it, regardless of its position on the flow cell stage. We demonstrated the correctness of data merging by comparing sample analysis results with previously obtained .fastq files for them. Thus, we confirmed that it is possible to restart the device and save both parts of the interrupted run.


2019 ◽  
Vol 28 (1S) ◽  
pp. 321-329 ◽  
Author(s):  
Shauna Berube ◽  
Jodi Nonnemacher ◽  
Cornelia Demsky ◽  
Shenly Glenn ◽  
Sadhvi Saxena ◽  
...  

Purpose Our goal was to evaluate an updated version of the “Cookie Theft” picture by obtaining norms based on picture descriptions by healthy controls for total content units (CUs), syllables per CU, and the ratio of left–right CUs. In addition, we aimed to compare these measures from healthy controls to picture descriptions obtained from individuals with poststroke aphasia and primary progressive aphasia (PPA) to assess whether these measures can capture impairments in content and efficiency of communication. Method Using an updated version of this picture, we analyzed descriptions from 50 healthy controls to develop norms for numbers of syllables, total CUs, syllables per CU, and left–right CU. We provide preliminary data from 44 individuals with aphasia (19 with poststroke aphasia and 25 with PPA). Results A total of 96 CUs were established based on the written transcriptions of spoken picture descriptions of the 50 control participants. There was a significant effect of group on total CUs, syllables, syllables per CU, and left–right CUs. The poststroke participants produced significantly fewer total CU and syllables than those with PPA. Each aphasic group produced significantly fewer total CUs, fewer syllables, more syllables per CU, and lower left–right CUs (indicating a right-sided bias) compared to controls. Conclusions Results show that the measures of numbers of syllables, total CUs, syllables per CU, and left–right CUs can distinguish language output of individuals with aphasia from controls and capture impairments in content and efficiency of communication. A limitation of this study is that we evaluated only 44 individuals with aphasia. In the future, we will evaluate other measures, such as CUs per minute, lexical variability, grammaticality, and ratio of nouns to verbs. Supplemental Material https://doi.org/10.23641/asha.7015223


2018 ◽  
Author(s):  
Natalie Ring ◽  
Jonathan Abrahams ◽  
Miten Jain ◽  
Hugh Olsen ◽  
Andrew Preston ◽  
...  

ABSTRACTThe genome of Bordetella pertussis is complex, with high GC content and many repeats, each longer than 1,000 bp. Short-read DNA sequencing is unable to resolve the structure of the genome; however, long-read sequencing offers the opportunity to produce single-contig B. pertussis assemblies using sequencing reads which are longer than the repetitive sections. We used an R9.4 MinION flow cell and barcoding to sequence five B. pertussis strains in a single sequencing run. We then trialled combinations of the many nanopore-user-community-built long-read analysis tools to establish the current optimal assembly pipeline for B. pertussis genome sequences. Our best long-read-only assemblies were produced by Canu read correction followed by assembly with Flye and polishing with Nanopolish, whilst the best hybrids (using nanopore and Illumina reads together) were produced by Canu correction followed by Unicycler. This pipeline produced closed genome sequences for four strains, revealing inter-strain genomic rearrangement. However, read mapping to the Tohama I reference genome suggests that the remaining strain contains an ultra-long duplicated region (over 100 kbp), which was not resolved by our pipeline. We have therefore demonstrated the ability to resolve the structure of several B. pertussis strains per single barcoded nanopore flow cell, but the genomes with highest complexity (e.g. very large duplicated regions) remain only partially resolved using the standard library preparation and will require an alternative library preparation method. For full strain characterisation, we recommend hybrid assembly of long and short reads together; for comparison of genome arrangement, assembly using long reads alone is sufficient.DATA SUMMARYFinal sequence read files (fastq) for all 5 strains have been deposited in the SRA, BioProject PRJNA478201, accession numbers SAMN09500966, SAMN09500967, SAMN09500968, SAMN09500969, SAMN09500970A full list of accession numbers for Illumina sequence reads is available in Table S1Assembly tests, basecalled read sets and reference materials are available from figshare: https://figshare.com/projects/Resolving_the_complex_Bordetella_pertussis_genome_using_barcoded_nanopore_sequencing/31313Genome sequences for B. pertussis strains UK36, UK38, UK39, UK48 and UK76 have been deposited in GenBank; accession numbers: CP031289, CP031112, CP031113, QRAX00000000, CP031114Source code and full commands used are available from Github: https://github.com/nataliering/Resolving-the-complex-Bordetella-pertussis-genome-using-barcoded-nanopore-sequencingIMPACT STATEMENTOver the past two decades, whole genome sequencing has allowed us to understand microbial pathogenicity and evolution on an unprecedented level. However, repetitive regions, like those found throughout the B. pertussis genome, have confounded our ability to resolve complex genomes using short-read sequencing technologies alone. To produce closed B. pertussis genome sequences it is necessary to use a sequencing technology which can generate reads longer than these problematic genomic regions. Using barcoded nanopore sequencing, we show that multiple B. pertussis genomes can be resolved per flow cell. Use of our assembly pipeline to resolve further B. pertussis genomes will advance understanding of how genome-level differences affect the phenotypes of strains which appear monomorphic at nucleotide-level.This work expands the recently emergent theme that even the most complex genomes can be resolved with sufficiently long sequencing reads. Additionally, we utilise a more widely accessible alternative sequencing platform to the Pacific Biosciences platform already used by large research centres such as the CDC. Our optimisation process, moreover, shows that the analysis tools favoured by the sequencing community do not necessarily produce the most accurate assemblies for all organisms; pipeline optimisation may therefore be beneficial in studies of unusually complex genomes.


2019 ◽  
Author(s):  
Manuel Holtgrewe ◽  
Mikko Nieminen ◽  
Clemens Messerschmidt ◽  
Dieter Beule

Management raw sequencing data and its preprocessing (conversion into sequences and demultiplexing) remains a challenging topic for groups running sequencing devices. They face many challenges in such efforts and solutions ranging from manual management of spreadsheets to very complex and customized LIMS systems handling much more than just sequencing raw data. In this manuscript, we describe the software package DigestiFlow that focuses on the management of Illumina flow cell sample sheets and raw data. It allows for automated extraction of information from flow cell data and management of sample sheets. Furthermore, it allows for the automated and reproducible conversion of Illumina base calls to sequences and the demultiplexing thereof using bcl2fastq and Picard Tools, followed by quality control report generation.


2021 ◽  
Vol 6 (1) ◽  
pp. 8-13
Author(s):  
Surono Surono ◽  
Adhi Kusuma Negara ◽  
Endro Sigit Kurniawan

Purwarupa Differential Global Navigation Satellite System bertujuan untuk meningkatkan akurasi dari receiver GNSS, dengan menambahkan referensi stasiun lokal untuk menambah informasi yang diterima dari satelit. Differential Global Navigation Satellite System ini menggunakan metode real time kinematik yang berbasiskan pada carrier phase (besaran sudut) dalam penentuan posisi data secara relatif dengan tingkat ketelitian mencapai satuan milimeter. Sistem RTK menggunakan data pengamatan fase data atau koreksi fase dikirim secara seketika dari stasiun referensi ke receiver pengguna. Hasil dari purwarupa adalah resiver GNSS geodetik berbasis radio link yang bisa diprogram agar bisa menghasilkan raw data. Pemrograman menggunakan software RTKLIB seri b33 dengan aplikasi RTKnavi untuk logging data.


2019 ◽  
Author(s):  
Manuel Holtgrewe ◽  
Clemens Messerschmidt ◽  
Mikko Nieminen ◽  
Dieter Beule

Abstract Summary Management raw sequencing data and its preprocessing (conversion into sequences and demultiplexing) remains a challenging topic for groups running sequencing devices. They face many challenges in such efforts and solutions ranging from manual management of spreadsheets to very complex and customized LIMS systems handling much more than just sequencing raw data. In this manuscript, we describe the software package DigestiFlow that focuses on the management of Illumina flow cell sample sheets and raw data. It allows for automated extraction of information from flow cell data and management of sample sheets. Furthermore, it allows for the automated and reproducible conversion of Illumina base calls to sequences and the demultiplexing thereof using bcl2fastq and Picard Tools, followed by quality control report generation. Availability and Implementation The software is available under the MIT license at https://github.com/bihealth/digestiflow-server. The client software components are available via Bioconda. Supplementary information Supplementary data are available at Bioinformatics online.


Author(s):  
Shubham Chandak ◽  
Kedar Tatwawadi ◽  
Srivatsan Sridhar ◽  
Tsachy Weissman

Abstract Motivation Nanopore sequencing provides a real-time and portable solution to genomic sequencing, enabling better assembly, structural variant discovery and modified base detection than second generation technologies. The sequencing process generates a huge amount of data in the form of raw signal contained in fast5 files, which must be compressed to enable efficient storage and transfer. Since the raw data is inherently noisy, lossy compression has potential to significantly reduce space requirements without adversely impacting performance of downstream applications. Results We explore the use of lossy compression for nanopore raw data using two state-of-the-art lossy time-series compressors, and evaluate the tradeoff between compressed size and basecalling/consensus accuracy. We test several basecallers and consensus tools on a variety of datasets at varying depths of coverage, and conclude that lossy compression can provide 35–50% further reduction in compressed size of raw data over the state-of-the-art lossless compressor with negligible impact on basecalling accuracy (≲0.2% reduction) and consensus accuracy (≲0.002% reduction). In addition, we evaluate the impact of lossy compression on methylation calling accuracy and observe that this impact is minimal for similar reductions in compressed size, although further evaluation with improved benchmark datasets is required for reaching a definite conclusion. The results suggest the possibility of using lossy compression, potentially on the nanopore sequencing device itself, to achieve significant reductions in storage and transmission costs while preserving the accuracy of downstream applications. Availabilityand implementation The code is available at https://github.com/shubhamchandak94/lossy_compression_evaluation. Supplementary information Supplementary data are available at Bioinformatics online.


2017 ◽  
Author(s):  
Ryan R. Wick ◽  
Louise M. Judd ◽  
Claire L. Gorrie ◽  
Kathryn E. Holt

AbstractIllumina sequencing platforms have enabled widespread bacterial whole genome sequencing. While Illumina data is appropriate for many analyses, its short read length limits its ability to resolve genomic structure. This has major implications for tracking the spread of mobile genetic elements, including those which carry antimicrobial resistance determinants. Fully resolving a bacterial genome requires long-read sequencing such as those generated by Oxford Nanopore Technologies (ONT) platforms. Here we describe our use of the ONT MinION to sequence 12 isolates of Klebsiella pneumoniae on a single flow cell. We assembled each genome using a combination of ONT reads and previously available Illumina reads, and little to no manual intervention was needed to achieve fully resolved assemblies using the Unicycler hybrid assembler. Assembling only ONT reads with Canu was less effective, resulting in fewer resolved genomes and higher error rates even following error correction with Nanopolish. We demonstrate that multiplexed ONT sequencing is a valuable tool for high-throughput bacterial genome finishing. Specifically, we advocate the use of Illumina sequencing as a first analysis step, followed by ONT reads as needed to resolve genomic structure.Data summarySequence read files for all 12 isolates have been deposited in SRA, accessible through these NCBI BioSample accession numbers: SAMEA3357010, SAMEA3357043, SAMN07211279, SAMN07211280, SAMEA3357223, SAMEA3357193, SAMEA3357346, SAMEA3357374, SAMEA3357320, SAMN07211281, SAMN07211282, SAMEA3357405.A full list of SRA run accession numbers (both Illumina reads and ONT reads) for these samples are available in Table S1.Assemblies and sequencing reads corresponding to each stage of processing and analysis are provided in the following figshare project: https://figshare.com/projects/Completing_bacterial_genome_assemblies_with_multiplex_MinION_sequencing/23068Source code is provided in the following public GitHub repositories: https://github.com/rrwick/Bacterial-genome-assemblies-with-multiplex-MinION-sequencinghttps://github.com/rrwick/Porechophttps://github.com/rrwick/Fast5-to-FastqImpact StatementLike many research and public health laboratories, we frequently perform large-scale bacterial comparative genomics studies using Illumina sequencing, which assays gene content and provides the high-confidence variant calls needed for phylogenomics and transmission studies. However, problems often arise with resolving genome assemblies, particularly around regions that matter most to our research, such as mobile genetic elements encoding antibiotic resistance or virulence genes. These complexities can often be resolved by long sequence reads generated with PacBio or Oxford Nanopore Technologies (ONT) platforms. While effective, this has proven difficult to scale, due to the relatively high costs of generating long reads and the manual intervention required for assembly. Here we demonstrate the use of barcoded ONT libraries sequenced in multiplex on a single ONT MinION flow cell, coupled with hybrid assembly using Unicycler, to resolve 12 large bacterial genomes. Minor manual intervention was required to fully resolve small plasmids in five isolates, which we found to be underrepresented in ONT data. Cost per sample for the ONT sequencing was equivalent to Illumina sequencing, and there is potential for significant savings by multiplexing more samples on the ONT run. This approach paves the way for high-throughput and cost-effective generation of completely resolved bacterial genomes to become widely accessible.


2021 ◽  
Vol 17 (12) ◽  
pp. e1009630
Author(s):  
Jiajun Qiu ◽  
Xiao Ma ◽  
Fanyi Zeng ◽  
Jingbin Yan

RNA editing is a co- or post-transcriptional modification through which some cells can make discrete changes to specific nucleotide sequences within an RNA molecule after transcription. Previous studies found that RNA editing may be critically involved in cancer and aging. However, the function of RNA editing in human early embryo development is still unclear. In this study, through analyzing single cell RNA sequencing data, 36.7% RNA editing sites were found to have a have differential editing ratio among early embryo developmental stages, and there was a great reprogramming of RNA editing rates at the 8-cell stage, at which most of the differentially edited RNA editing sites (99.2%) had a decreased RNA editing rate. In addition, RNA editing was more likely to occur on RNA splicing sites during human early embryo development. Furthermore, long non-coding RNA (lncRNA) editing sites were found more likely to be on RNA splicing sites (odds ratio = 2.19, P = 1.37×10−8), while mRNA editing sites were less likely (odds ratio = 0.22, P = 8.38×10−46). Besides, we found that the RNA editing rate on lncRNA had a significantly higher correlation coefficient with the percentage spliced index (PSI) of lncRNA exons (R = 0.75, P = 4.90×10−16), which indicated that RNA editing may regulate lncRNA splicing during human early embryo development. Finally, functional analysis revealed that those RNA editing-regulated lncRNAs were enriched in signal transduction, the regulation of transcript expression, and the transmembrane transport of mitochondrial calcium ion. Overall, our study might provide a new insight into the mechanism of RNA editing on lncRNAs in human developmental biology and common birth defects.


2019 ◽  
Author(s):  
Manuel Holtgrewe ◽  
Mikko Nieminen ◽  
Clemens Messerschmidt ◽  
Dieter Beule

Management raw sequencing data and its preprocessing (conversion into sequences and demultiplexing) remains a challenging topic for groups running sequencing devices. They face many challenges in such efforts and solutions ranging from manual management of spreadsheets to very complex and customized LIMS systems handling much more than just sequencing raw data. In this manuscript, we describe the software package DigestiFlow that focuses on the management of Illumina flow cell sample sheets and raw data. It allows for automated extraction of information from flow cell data and management of sample sheets. Furthermore, it allows for the automated and reproducible conversion of Illumina base calls to sequences and the demultiplexing thereof using bcl2fastq and Picard Tools, followed by quality control report generation.


Sign in / Sign up

Export Citation Format

Share Document