Dataset Information

BOD: a customizable bioinformatics on demand system accommodating multiple steps and parallel tasks.

ABSTRACT: The integration of bioinformatics resources worldwide is one of the major concerns of the biological community. We herein established the BOD (Bioinformatics on demand) system to use Grid computing technology to set up a virtual workbench via a web-based platform, to assist researchers performing customized comprehensive bioinformatics work. Users will be able to submit entire search queries and computation requests, e.g. from DNA assembly to gene prediction and finally protein folding, from their own office using the BOD end-user web interface. The BOD web portal parses the user's job requests into steps, each of which may contain multiple tasks in parallel. The BOD task scheduler takes an entire task, or splits it into multiple subtasks, and dispatches the task or subtasks proportionally to computation node(s) associated with the BOD portal server. A node may further split and distribute an assigned task to its sub-nodes using a similar strategy. In the end, the BOD portal server receives and collates all results and returns them to the user. BOD uses a pipeline model to describe the user's submitted data and stores the job requests/status/results in a relational database. In addition, an XML criterion is established to capture task computation program details.

SUBMITTER: Qiao LA

PROVIDER: S-EPMC514377 | biostudies-literature | 2004

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

BOD: a customizable bioinformatics on demand system accommodating multiple steps and parallel tasks.

Qiao Li-An LA Zhu Jing J Liu Qingyan Q Zhu Tao T Song Chi C Lin Wei W Wei Guozhu G Mu Lisen L Tao Jiang J Zhao Nanming N Yang Guangwen G Liu Xiangjun X

Nucleic acids research 20040809 14

The integration of bioinformatics resources worldwide is one of the major concerns of the biological community. We herein established the BOD (Bioinformatics on demand) system to use Grid computing technology to set up a virtual workbench via a web-based platform, to assist researchers performing customized comprehensive bioinformatics work. Users will be able to submit entire search queries and computation requests, e.g. from DNA assembly to gene prediction and finally protein folding, from the ...[more]

PMID: 15302917

Similar Datasets

Project description:BACKGROUND: In bioinformatics projects, scientific workflow systems are widely used to manage computational procedures. Full-featured workflow systems have been proposed to fulfil the demand for workflow management. However, such systems tend to be over-weighted for actual bioinformatics practices. We realize that quick deployment of cutting-edge software implementing advanced algorithms and data formats, and continuous adaptation to changes in computational resources and the environment are often prioritized in scientific workflow management. These features have a greater affinity with the agile software development method through iterative development phases after trial and error.Here, we show the application of a scientific workflow system Pwrake to bioinformatics workflows. Pwrake is a parallel workflow extension of Ruby's standard build tool Rake, the flexibility of which has been demonstrated in the astronomy domain. Therefore, we hypothesize that Pwrake also has advantages in actual bioinformatics workflows. FINDINGS: We implemented the Pwrake workflows to process next generation sequencing data using the Genomic Analysis Toolkit (GATK) and Dindel. GATK and Dindel workflows are typical examples of sequential and parallel workflows, respectively. We found that in practice, actual scientific workflow development iterates over two phases, the workflow definition phase and the parameter adjustment phase. We introduced separate workflow definitions to help focus on each of the two developmental phases, as well as helper methods to simplify the descriptions. This approach increased iterative development efficiency. Moreover, we implemented combined workflows to demonstrate modularity of the GATK and Dindel workflows. CONCLUSIONS: Pwrake enables agile management of scientific workflows in the bioinformatics domain. The internal domain specific language design built on Ruby gives the flexibility of rakefiles for writing scientific workflows. Furthermore, readability and maintainability of rakefiles may facilitate sharing workflows among the scientific community. Workflows for GATK and Dindel are available at http://github.com/misshie/Workflows.

Project description:BACKGROUND: Bioinformatic analyses typically proceed as chains of data-processing tasks. A pipeline, or 'workflow', is a well-defined protocol, with a specific structure defined by the topology of data-flow interdependencies, and a particular functionality arising from the data transformations applied at each step. In computer science, the dataflow programming (DFP) paradigm defines software systems constructed in this manner, as networks of message-passing components. Thus, bioinformatic workflows can be naturally mapped onto DFP concepts. RESULTS: To enable the flexible creation and execution of bioinformatics dataflows, we have written a modular framework for parallel pipelines in Python ('PaPy'). A PaPy workflow is created from re-usable components connected by data-pipes into a directed acyclic graph, which together define nested higher-order map functions. The successive functional transformations of input data are evaluated on flexibly pooled compute resources, either local or remote. Input items are processed in batches of adjustable size, all flowing one to tune the trade-off between parallelism and lazy-evaluation (memory consumption). An add-on module ('NuBio') facilitates the creation of bioinformatics workflows by providing domain specific data-containers (e.g., for biomolecular sequences, alignments, structures) and functionality (e.g., to parse/write standard file formats). CONCLUSIONS: PaPy offers a modular framework for the creation and deployment of parallel and distributed data-processing workflows. Pipelines derive their functionality from user-written, data-coupled components, so PaPy also can be viewed as a lightweight toolkit for extensible, flow-based bioinformatics data-processing. The simplicity and flexibility of distributed PaPy pipelines may help users bridge the gap between traditional desktop/workstation and grid computing. PaPy is freely distributed as open-source Python code at http://muralab.org/PaPy, and includes extensive documentation and annotated usage examples.

Project description:It is well established that networks within multiple-demand cortex (MDC) become active when diverse skills and behaviors are being learnt. However, their causal role in learning remains to be established. In the present study, we first performed functional magnetic resonance imaging on healthy female and male human participants to confirm that MDC was most active in the initial stages of learning a novel vocabulary, consisting of pronounceable nonwords (pseudowords), each associated with a picture of a real object. We then examined, in healthy female and male human participants, whether repetitive transcranial magnetic stimulation of a frontal midline node of the cingulo-opercular MDC affected learning rates specifically during the initial stages of learning. We report that stimulation of this node, but not a control brain region, substantially improved both accuracy and response times during the earliest stage of learning pseudoword-object associations. This stimulation had no effect on the processing of established vocabulary, tested by the accuracy and response times when participants decided whether a real word was accurately paired with a picture of an object. These results provide evidence that noninvasive stimulation to MDC nodes can enhance learning rates, thereby demonstrating their causal role in the learning process. We propose that this causal role makes MDC candidate target for experimental therapeutics; for example, in stroke patients with aphasia attempting to reacquire a vocabulary.SIGNIFICANCE STATEMENT Learning a task involves the brain system within which that specific task becomes established. Therefore, successfully learning a new vocabulary establishes the novel words in the language system. However, there is evidence that in the early stages of learning, networks within multiple-demand cortex (MDC), which control higher cognitive functions, such as working memory, attention, and monitoring of performance, become active. This activity declines once the task is learnt. The present study demonstrated that a node within MDC, located in midline frontal cortex, becomes active during the early stage of learning a novel vocabulary. Importantly, noninvasive brain stimulation of this node improved performance during this stage of learning. This observation demonstrated that MDC activity is important for learning.

Dataset Information

BOD: a customizable bioinformatics on demand system accommodating multiple steps and parallel tasks.

Publications

BOD: a customizable bioinformatics on demand system accommodating multiple steps and parallel tasks.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets