Streaming fragment assignment for real-time analysis of sequencing experiments.
Ontology highlight
ABSTRACT:
SUBMITTER: Roberts A
PROVIDER: S-EPMC3880119 | biostudies-literature | 2013 Jan
REPOSITORIES: biostudies-literature
Publications
Streaming fragment assignment for real-time analysis of sequencing experiments.
Nature methods 20121118 1
We present eXpress, a software package for efficient probabilistic assignment of ambiguously mapping sequenced fragments. eXpress uses a streaming algorithm with linear run time and constant memory use. It can determine abundances of sequenced molecules in real time and can be applied to ChIP-seq, metagenomics and other large-scale sequencing data. We demonstrate its use on RNA-seq data and show that eXpress achieves greater efficiency than other quantification methods. ...[more]
Similar Datasets
Project description:The recently introduced Oxford Nanopore MinION platform generates DNA sequence data in real-time. This has great potential to shorten the sample-to-results time and is likely to have benefits such as rapid diagnosis of bacterial infection and identification of drug resistance. However, there are few tools available for streaming analysis of real-time sequencing data. Here, we present a framework for streaming analysis of MinION real-time sequence data, together with probabilistic streaming algorithms for species typing, strain typing and antibiotic resistance profile identification. Using four culture isolate samples, as well as a mixed-species sample, we demonstrate that bacterial species and strain information can be obtained within 30 min of sequencing and using about 500 reads, initial drug-resistance profiles within two hours, and complete resistance profiles within 10 h. While strain identification with multi-locus sequence typing required more than 15x coverage to generate confident assignments, our novel gene-presence typing could detect the presence of a known strain with 0.5x coverage. We also show that our pipeline can process over 100 times more data than the current throughput of the MinION on a desktop computer.
| S-EPMC4960868 | biostudies-literature
Project description:Combinatorial triple-selective labeling facilitates the NMR assignment process for proteins that are subject to signal overlap and insufficient signal-to-noise in standard triple-resonance experiments. Aiming at maximum amino-acid type and sequence-specific information, the method represents a trade-off between the number of selectively labeled samples that have to be prepared and the number of spectra to be recorded per sample. In order to address the demand of long measurement times, we here propose pulse sequences in which individual phase-shifted transients are stored separately and recombined later to produce several 2D HN(CX) type spectra that are usually acquired sequentially. Sign encoding by the phases of (13)C 90° pulses allows to either select or discriminate against (13)C' or (13)C(?) spins coupled to (15)N. As a result, (1)H-(15)N correlation maps of the various isotopomeric species present in triple-selectively labeled proteins are deconvoluted which in turn reduces problems due to spectral overlap. The new methods are demonstrated with four different membrane proteins with rotational correlation times ranging from 18 to 52 ns.
| S-EPMC4254601 | biostudies-literature
Project description:Pure shift NMR spectroscopy has become an efficient tool for improving resolution in proton NMR spectra by removing the effect of homonuclear couplings. The introduction of real-time acquisition methods has allowed the main drawback of pure shift NMR, the long experiment times needed, to be circumvented. Real-time methods use periodic application of J-refocusing pulse sequence elements, acquiring a single free induction decay, in contrast to previous methods that construct a pure shift interferogram by concatenating excerpts from multiple free induction decays. In the important heteronuclear single-quantum correlation experiment, implementing real-time pure shift data acquisition typically leads to the simultaneous improvement of both resolution and sensitivity. The current limitations of and problems with real-time pure shift acquisition methods are discussed here in the context of heteronuclear single-quantum correlation experiments. We aim to provide a detailed account of the technical challenges, together with a practical guide to exploiting the full potential of such methods.
| S-EPMC6175388 | biostudies-literature
Project description:The cloud-based media streaming service is a promising paradigm for multimedia applications. It is attractive to media streaming service providers, who wish to deploy their media server clusters in a media cloud at reduced cost. Since the real-time live streaming service is both a bandwidth-intensive and quality-sensitive application, how to optimize the internal bandwidth utilization of a data center network (DCN) as well as guarantee the external bandwidth of the real-time live streaming application, is a key issue of deploying virtual machine (VM)-hosted media server cluster in a media cloud. Therefore, in this study, we propose an external-bandwidth-guaranteed media server cluster deployment scheme in media cloud. The approach simultaneously considers the outside bandwidth requirement of a tree-based media server cluster for live streaming and the intra-bandwidth consumption of a DCN. The proposed scheme models the optimal problem as a new terminal-Steiner-tree-like problem and provides an approximate algorithm for placing the media servers. Our evaluation results show that the proposed scheme guarantees the external bandwidth requirement of a real-time live streaming application, at the same time, greatly reduces the intra-bandwidth utilization of a media cloud with different DCN structures.
| S-EPMC6447193 | biostudies-literature
Project description:Primer and probe sequence designs are among the most critical input factors in real-time polymerase chain reaction (PCR) assay optimization. In this study, we present the use of statistical design of experiments (DOE) approach as a general guideline for probe optimization and more specifically focus on design optimization of label-free hydrolysis probes that are designated as mediator probes (MPs), which are used in reverse transcription MP PCR (RT-MP PCR). The effect of three input factors on assay performance was investigated: distance between primer and mediator probe cleavage site; dimer stability of MP and target sequence (influenza B virus); and dimer stability of the mediator and universal reporter (UR). The results indicated that the latter dimer stability had the greatest influence on assay performance, with RT-MP PCR efficiency increased by up to 10% with changes to this input factor. With an optimal design configuration, a detection limit of 3-14 target copies/10 ?l reaction could be achieved. This improved detection limit was confirmed for another UR design and for a second target sequence, human metapneumovirus, with 7-11 copies/10 ?l reaction detected in an optimum case. The DOE approach for improving oligonucleotide designs for real-time PCR not only produces excellent results but may also reduce the number of experiments that need to be performed, thus reducing costs and experimental times.
| S-EPMC4827641 | biostudies-literature
Project description:BACKGROUND:Prosthetic joint infections are clinically difficult to diagnose and treat. Previously, we demonstrated metagenomic sequencing on an Illumina MiSeq replicates the findings of current gold standard microbiological diagnostic techniques. Nanopore sequencing offers advantages in speed of detection over MiSeq. Here, we report a real-time analytical pathway for Nanopore sequence data, designed for detecting bacterial composition of prosthetic joint infections but potentially useful for any microbial sequencing, and compare detection by direct-from-clinical-sample metagenomic nanopore sequencing with Illumina sequencing and standard microbiological diagnostic techniques. RESULTS:DNA was extracted from the sonication fluids of seven explanted orthopaedic devices, and additionally from two culture negative controls, and was sequenced on the Oxford Nanopore Technologies MinION platform. A specific analysis pipeline was assembled to overcome the challenges of identifying the true infecting pathogen, given high levels of host contamination and unavoidable background lab and kit contamination. The majority of DNA classified (>?90%) was host contamination and discarded. Using negative control filtering thresholds, the species identified corresponded with both routine microbiological diagnosis and MiSeq results. By analysing sequences in real time, causes of infection were robustly detected within minutes from initiation of sequencing. CONCLUSIONS:We demonstrate a novel, scalable pipeline for real-time analysis of MinION sequence data and use of this pipeline to show initial proof of concept that metagenomic MinION sequencing can provide rapid, accurate diagnosis for prosthetic joint infections. The high proportion of human DNA in prosthetic joint infection extracts prevents full genome analysis from complete coverage, and methods to reduce this could increase genome depth and allow antimicrobial resistance profiling. The nine samples sequenced in this pilot study have shown a proof of concept for sequencing and analysis that will enable us to investigate further sequencing to improve specificity and sensitivity.
| S-EPMC6161345 | biostudies-literature
Project description:Single-molecule real-time (SMRT) sequencing allows identification of methylated DNA bases and methylation patterns/motifs at the genome level. Using SMRT sequencing, diverse bacterial methylomes including those of Helicobacter pylori, Lactobacillus spp., and Escherichia coli have been determined, and previously unreported DNA methylation motifs have been identified. However, the methylomes of Xanthomonas species, which belong to the most important plant pathogenic bacterial genus, have not been documented. Here, we report the methylomes of Xanthomonas axonopodis pv. glycines (Xag) strain 8ra and X. campestris pv. vesicatoria (Xcv) strain 85-10. We identified N6-methyladenine (6mA) and N4-methylcytosine (4mC) modification in both genomes. In addition, we assigned putative DNA methylation motifs including previously unreported methylation motifs via REBASE and MotifMaker, and compared methylation patterns in both species. Although Xag and Xcv belong to the same genus, their methylation patterns were dramatically different. The number of 4mC DNA bases in Xag (66,682) was significantly higher (29 fold) than in Xcv (2,321). In contrast, the number of 6mA DNA bases (4,147) in Xag was comparable to the number in Xcv (5,491). Strikingly, there were no common or shared motifs in the 10 most frequently methylated motifs of both strains, indicating they possess unique species- or strain-specific methylation motifs. Among the 20 most frequent motifs from both strains, for 9 motifs at least 1% of the methylated bases were located in putative promoter regions. Methylome analysis by SMRT sequencing technology is the first step toward understanding the biology and functions of DNA methylation in this genus.
| S-EPMC5117858 | biostudies-literature
Project description:The Oxford Nanopore Technologies MinION sequencer enables the selection of specific DNA molecules for sequencing by reversing the driving voltage across individual nanopores. To directly select molecules for sequencing, we used dynamic time warping to match reads to reference sequences. We demonstrate our open-source Read Until software in real-time selective sequencing of regions within small genomes, individual amplicon enrichment and normalization of an amplicon set.
| S-EPMC5008457 | biostudies-literature
Project description:We present a quantification method for affinity-based DNA microarrays which is based on the real-time measurements of hybridization kinetics. This method, i.e. real-time DNA microarrays, enhances the detection dynamic range of conventional systems by being impervious to probe saturation in the capturing spots, washing artifacts, microarray spot-to-spot variations, and other signal amplitude-affecting non-idealities. We demonstrate in both theory and practice that the time-constant of target capturing in microarrays, similar to all affinity-based biosensors, is inversely proportional to the concentration of the target analyte, which we subsequently use as the fundamental parameter to estimate the concentration of the analytes. Furthermore, to empirically validate the capabilities of this method in practical applications, we present a FRET-based assay which enables the real-time detection in gene expression DNA microarrays.
| S-EPMC2802827 | biostudies-other
Project description:BackgroundProbabilistic assignment of ambiguously mapped fragments produced by high-throughput sequencing experiments has been demonstrated to greatly improve accuracy in the analysis of RNA-Seq and ChIP-Seq, and is an essential step in many other sequence census experiments. A maximum likelihood method using the expectation-maximization (EM) algorithm for optimization is commonly used to solve this problem. However, batch EM-based approaches do not scale well with the size of sequencing datasets, which have been increasing dramatically over the past few years. Thus, current approaches to fragment assignment rely on heuristics or approximations for tractability.ResultsWe present an implementation of a distributed EM solution to the fragment assignment problem using Spark, a data analytics framework that can scale by leveraging compute clusters within datacenters-"the cloud". We demonstrate that our implementation easily scales to billions of sequenced fragments, while providing the exact maximum likelihood assignment of ambiguous fragments. The accuracy of the method is shown to be an improvement over the most widely used tools available and can be run in a constant amount of time when cluster resources are scaled linearly with the amount of input data.ConclusionsThe cloud offers one solution for the difficulties faced in the analysis of massive high-thoughput sequencing data, which continue to grow rapidly. Researchers in bioinformatics must follow developments in distributed systems-such as new frameworks like Spark-for ways to port existing methods to the cloud and help them scale to the datasets of the future. Our software, eXpress-D, is freely available at: http://github.com/adarob/express-d.
| S-EPMC3881492 | biostudies-literature