Browse
Submit Data
Databases
API
Help

Dataset Information

33 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

COSMOS: Python library for massively parallel workflows.

ABSTRACT: Efficient workflows to shepherd clinically generated genomic data through the multiple stages of a next-generation sequencing pipeline are of critical importance in translational biomedical science. Here we present COSMOS, a Python library for workflow management that allows formal description of pipelines and partitioning of jobs. In addition, it includes a user interface for tracking the progress of jobs, abstraction of the queuing system and fine-grained control over the workflow. Workflows can be created on traditional computing clusters as well as cloud-based services.Source code is available for academic non-commercial research purposes. Links to code and documentation are provided at http://lpm.hms.harvard.edu and http://wall-lab.stanford.edu.dpwall@stanford.edu or peter_tonellato@hms.harvard.edu.Supplementary data are available at Bioinformatics online.

SUBMITTER: Gafni E

PROVIDER: S-EPMC4184253 | biostudies-literature | 2014 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

COSMOS: Python library for massively parallel workflows.

Gafni Erik E Luquette Lovelace J LJ Lancaster Alex K AK Hawkins Jared B JB Jung Jae-Yoon JY Souilmi Yassine Y Wall Dennis P DP Tonellato Peter J PJ

Bioinformatics (Oxford, England) 20140630 20

<h4>Summary</h4>Efficient workflows to shepherd clinically generated genomic data through the multiple stages of a next-generation sequencing pipeline are of critical importance in translational biomedical science. Here we present COSMOS, a Python library for workflow management that allows formal description of pipelines and partitioning of jobs. In addition, it includes a user interface for tracking the progress of jobs, abstraction of the queuing system and fine-grained control over the workf ...[more]

PMID: 24982428

Similar Datasets

TEMPy2: a Python library with improved 3D electron microscopy density-fitting and validation workflows.

Project description:Structural determination of molecular complexes by cryo-EM requires large, often complex processing of the image data that are initially obtained. Here, TEMPy2, an update of the TEMPy package to process, optimize and assess cryo-EM maps and the structures fitted to them, is described. New optimization routines, comprehensive automated checks and workflows to perform these tasks are described.

| S-EPMC7787107 | biostudies-literature

Evaluation of Library Preparation Workflows and Applications to Different Sample Types Using the PowerSeq<sup>®</sup> 46GY System with Massively Parallel Sequencing.

Project description:This project evaluated the prototype PowerSeq® 46GY System using donor DNA and casework-type samples. The goal of this study was to determine whether modifications to the manufacturer's protocol could increase read coverage and improve sample results. Buccal and casework-type libraries were prepared using the TruSeq® DNA PCR-Free HT kit or the KAPA HyperPrep kit. Both kits were evaluated unmodified, and by substituting AMPure® XP beads for the beads of the most optimal kit. Two qPCR kits, the PowerSeq® Quant MS System and KAPA Library Quantification Kit, were also evaluated along with a KAPA size-adjustment workbook, which was compared as a third quantification method. Libraries were sequenced using the MiSeq® FGx and data were analyzed with STRait Razor. Results suggested that all three quantification methods overestimated library concentration, but the PowerSeq kit was most accurate. Samples prepared with the TruSeq library kit provided the highest coverage and the fewest instances of dropout and below-threshold alleles compared with the KAPA kit. Additionally, all bone and hair samples demonstrated full profile completeness, with bone samples yielding a higher average coverage than hair samples. Overall, our study demonstrated that the 46GY manufacturer's protocol produced the best quality results compared to alternative library preparation options.

| S-EPMC10218485 | biostudies-literature

Massively parallel gene expression variation measurement of a synonymous codon library.

Project description:BackgroundCell-to-cell variation in gene expression strongly affects population behavior and is key to multiple biological processes. While codon usage is known to affect ensemble gene expression, how codon usage influences variation in gene expression between single cells is not well understood.ResultsHere, we used a Sort-seq based massively parallel strategy to quantify gene expression variation from a green fluorescent protein (GFP) library containing synonymous codons in Escherichia coli. We found that sequences containing codons with higher tRNA Adaptation Index (TAI) scores, and higher codon adaptation index (CAI) scores, have higher GFP variance. This trend is not observed for codons with high Normalized Translation Efficiency Index (nTE) scores nor from the free energy of folding of the mRNA secondary structure. GFP noise, or squared coefficient of variance (CV2), scales with mean protein abundance for low-abundant proteins but does not change at high mean protein abundance.ConclusionsOur results suggest that the main source of noise for high-abundance proteins is likely not originating at translation elongation. Additionally, the drastic change in mean protein abundance with small changes in protein noise seen from our library implies that codon optimization can be performed without concerning gene expression noise for biotechnology applications.

| S-EPMC7927243 | biostudies-literature

pyrpipe: a Python package for RNA-Seq workflows.

Project description:The availability of terabytes of RNA-Seq data and continuous emergence of new analysis tools, enable unprecedented biological insight. There is a pressing requirement for a framework that allows for fast, efficient, manageable, and reproducible RNA-Seq analysis. We have developed a Python package, (pyrpipe), that enables straightforward development of flexible, reproducible and easy-to-debug computational pipelines purely in Python, in an object-oriented manner. pyrpipe provides access to popular RNA-Seq tools, within Python, via high-level APIs. Pipelines can be customized by integrating new Python code, third-party programs, or Python libraries. Users can create checkpoints in the pipeline or integrate pyrpipe into a workflow management system, thus allowing execution on multiple computing environments, and enabling efficient resource management. pyrpipe produces detailed analysis, and benchmark reports which can be shared or included in publications. pyrpipe is implemented in Python and is compatible with Python versions 3.6 and higher. To illustrate the rich functionality of pyrpipe, we provide case studies using RNA-Seq data from GTEx, SARS-CoV-2-infected human cells, and Zea mays. All source code is freely available at https://github.com/urmi-21/pyrpipe; the package can be installed from the source, from PyPI (https://pypi.org/project/pyrpipe), or from bioconda (https://anaconda.org/bioconda/pyrpipe). Documentation is available at (http://pyrpipe.rtfd.io).

| S-EPMC8168212 | biostudies-literature

Enabling multiplexed CRISPR/Cas9 screening via massively parallel in-library ligation

Project description:Here we developed a massively parallel in-library ligation methodology to simultaneously perturb four pre-designed targets in CRISPR/Cas9 screening. Thousands of pairs of sequences precisely ligated with their counterparts in library, which enabled simultaneous expression of four gRNAs from each single vector. We demonstrated this novel method with 6,236 4-gene combinations targeting 1,599 immune response related genes, and generated a plasmid library with 1,400x coverage. The library performance was evaluated in a canonical T cell activation experiment, and combinations involved in TCR signaling pathway or TCR complex were successfully identified as positive regulators. Novel combination that is reflecting a potential pathway crosstalk was also verified. This new methodology expands the capacity of the perturbation in CRISPR screening and provided a powerful tool for researches in broad fields to study the combinatorial outcomes from coordinated gene behaviors.

2022-06-15 | GSE149945 | GEO

Matriarch: A Python Library for Materials Architecture.

Project description:Biological materials, such as proteins, often have a hierarchical structure ranging from basic building blocks at the nanoscale (e.g., amino acids) to assembled structures at the macroscale (e.g., fibers). Current software for materials engineering allows the user to specify polypeptide chains and simple secondary structures prior to molecular dynamics simulation, but is not flexible in terms of the geometric arrangement of unequilibrated structures. Given some knowledge of a larger-scale structure, instructing the software to create it can be very difficult and time-intensive. To this end, the present paper reports a mathematical language, using category theory, to describe the architecture of a material, i.e., its set of building blocks and instructions for combining them. While this framework applies to any hierarchical material, here we concentrate on proteins. We implement this mathematical language as an open-source Python library called Matriarch. It is a domain-specific language that gives the user the ability to create almost arbitrary structures with arbitrary amino acid sequences and, from them, generate Protein Data Bank (PDB) files. In this way, Matriarch is more powerful than commercial software now available. Matriarch can be used in tandem with molecular dynamics simulations and helps engineers design and modify biologically inspired materials based on their desired functionality. As a case study, we use our software to alter both building blocks and building instructions for tropocollagen, and determine their effect on its structure and mechanical properties.

| S-EPMC4996638 | biostudies-literature

MCDataset: a public reference dataset of Monte Carlo simulated quantities for multilayered and voxelated tissues computed by massively parallel PyXOpto Python package.

Project description:SignificanceCurrent open-source Monte Carlo (MC) method implementations for light propagation modeling are many times tedious to build and require third-party licensed software that can often discourage prospective researchers in the biomedical optics community from fully utilizing the light propagation tools. Furthermore, the same drawback also limits rigorous cross-validation of physical quantities estimated by various MC codes.AimProposal of an open-source tool for light propagation modeling and an easily accessible dataset to encourage fruitful communications amongst researchers and pave the way to a more consistent comparison between the available implementations of the MC method.ApproachThe PyXOpto implementation of the MC method for multilayered and voxelated tissues based on the Python programming language and PyOpenCL extension enables massively parallel computation on numerous OpenCL-enabled devices. The proposed implementation is used to compute a large dataset of reflectance, transmittance, energy deposition, and sampling volume for various source, detector, and tissue configurations.ResultsThe proposed PyXOpto agrees well with the original MC implementation. However, further validation reveals a noticeable bias introduced by the random number generator used in the original MC implementation.ConclusionsEstablishing a common dataset is highly important for the validation of existing and development of MC codes for light propagation in turbid media.

| S-EPMC9016074 | biostudies-literature

Gene expression profiling by massively parallel sequencing.

Project description:Massively parallel sequencing holds great promise for expression profiling, as it combines the high throughput of SAGE with the accuracy of EST sequencing. Nevertheless, until now only very limited information had been available on the suitability of the current technology to meet the requirements. Here, we evaluate the potential of 454 sequencing technology for expression profiling using Drosophila melanogaster. We show that short (< approximately 80 bp) and long (> approximately 300-400 bp) cDNA fragments are under-represented in 454 sequence reads. Nevertheless, sequencing of 3' cDNA fragments generated by nebulization could be used to overcome the length bias of the 454 sequencing technology. Gene expression measurements generated by restriction analysis and nebulization for fragments within the 80- to 300-bp range showed correlations similar to those reported for replicated microarray experiments (0.83-0.91); 97% of the cDNA fragments could be unambiguously mapped to the genomic DNA, demonstrating the advantage of longer sequence reads. Our analyses suggest that the 454 technology has a large potential for expression profiling, and the high mapping accuracy indicates that it should be possible to compare expression profiles across species.

| S-EPMC2134766 | biostudies-other

Massively parallel single-amino-acid mutagenesis.

Project description:Random mutagenesis methods only partially cover the mutational space and are constrained by DNA synthesis length limitations. Here we demonstrate programmed allelic series (PALS), a single-volume, site-directed mutagenesis approach using microarray-programmed oligonucleotides. We created libraries including nearly every missense mutation as singleton events for the yeast transcription factor Gal4 (99.9% coverage) and human tumor suppressor p53 (93.5%). PALS-based comprehensive missense mutational scans may aid structure-function studies, protein engineering, and the interpretation of variants identified by clinical sequencing.

| S-EPMC4344410 | biostudies-literature

Robustness of Massively Parallel Sequencing Platforms.

Project description:The improvements in high throughput sequencing technologies (HTS) made clinical sequencing projects such as ClinSeq and Genomics England feasible. Although there are significant improvements in accuracy and reproducibility of HTS based analyses, the usability of these types of data for diagnostic and prognostic applications necessitates a near perfect data generation. To assess the usability of a widely used HTS platform for accurate and reproducible clinical applications in terms of robustness, we generated whole genome shotgun (WGS) sequence data from the genomes of two human individuals in two different genome sequencing centers. After analyzing the data to characterize SNPs and indels using the same tools (BWA, SAMtools, and GATK), we observed significant number of discrepancies in the call sets. As expected, the most of the disagreements between the call sets were found within genomic regions containing common repeats and segmental duplications, albeit only a small fraction of the discordant variants were within the exons and other functionally relevant regions such as promoters. We conclude that although HTS platforms are sufficiently powerful for providing data for first-pass clinical tests, the variant predictions still need to be confirmed using orthogonal methods before using in clinical applications.

| S-EPMC4575192 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data