Browse
Submit Data
Databases
API
Help

Dataset Information

23 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Information Integration from Semantically Heterogeneous Biological Data Sources.

ABSTRACT: We present the first prototype of INDUS (Intelligent Data Understanding System), a federated, query-centric system for information integration and knowledge acquisition from distributed, semantically heterogeneous data sources that can be viewed (conceptually) as tables. INDUS employs ontologies and inter-ontology mappings, to enable a user to view a collection of such data sources (regardless of location, internal structure and query interfaces) as though they were a collection of tables structured according to an ontology supplied by the user. This allows INDUS to answer user queries against distributed, semantically heterogeneous data sources without the need for a centralized data warehouse or a common global ontology.

SUBMITTER: Caragea D

PROVIDER: S-EPMC2929138 | biostudies-literature | 2005 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Information Integration from Semantically Heterogeneous Biological Data Sources.

Caragea Doina D Bao Jie J Pathak Jyotishman J Silvescu Adrian A Andorf Carson C Dobbs Drena D Honavar Vasant V

International Workshop on Databases and Expert Systems Applications : proceedings 20050801

We present the first prototype of INDUS (Intelligent Data Understanding System), a federated, query-centric system for information integration and knowledge acquisition from distributed, semantically heterogeneous data sources that can be viewed (conceptually) as tables. INDUS employs ontologies and inter-ontology mappings, to enable a user to view a collection of such data sources (regardless of location, internal structure and query interfaces) as though they were a collection of tables struct ...[more]

PMID: 20802821

Similar Datasets

Dynamic integration of biological data sources using the data concierge.

Project description:BACKGROUND:The ever-changing landscape of large-scale network environments and innovative biology technologies require dynamic mechanisms to rapidly integrate previously unknown bioinformatics sources at runtime. However, existing integration technologies lack sufficient flexibility to adapt to these changes, because the techniques used for integration are static, and sensitive to new or changing bioinformatics source implementations and evolutionary biologist requirements. METHODS:To address this challenge, in this paper we propose a new semantics-based adaptive middleware, the Data Concierge, which is able to dynamically integrate heterogeneous biological data sources without the need for wrappers. Along with the architecture necessary to facilitate dynamic integration, API description mechanism is proposed to dynamically classify, recognize, locate, and invoke newly added biological data source functionalities. Based on the unified semantic metadata, XML-based state machines are able to provide flexible configurations to execute biologist's abstract and complex operations. RESULTS AND DISCUSSION:Experimental results demonstrate that for obtaining dynamic features, the Data Concierge sacrifices reasonable performance on reasoning knowledge models and dynamically doing data source API invocations. The overall costs to integrate new biological data sources are significantly lower when using the Data Concierge. CONCLUSIONS:The Data Concierge facilitates the rapid integration of new biological data sources in existing applications with no repetitive software development required, and hence, this mechanism would provide a cost-effective solution to the labor-intensive software engineering tasks.

| S-EPMC4340781 | biostudies-literature

Use of Graph Database for the Integration of Heterogeneous Biological Data.

Project description:Understanding complex relationships among heterogeneous biological data is one of the fundamental goals in biology. In most cases, diverse biological data are stored in relational databases, such as MySQL and Oracle, which store data in multiple tables and then infer relationships by multiple-join statements. Recently, a new type of database, called the graph-based database, was developed to natively represent various kinds of complex relationships, and it is widely used among computer science communities and IT industries. Here, we demonstrate the feasibility of using a graph-based database for complex biological relationships by comparing the performance between MySQL and Neo4j, one of the most widely used graph databases. We collected various biological data (protein-protein interaction, drug-target, gene-disease, etc.) from several existing sources, removed duplicate and redundant data, and finally constructed a graph database containing 114,550 nodes and 82,674,321 relationships. When we tested the query execution performance of MySQL versus Neo4j, we found that Neo4j outperformed MySQL in all cases. While Neo4j exhibited a very fast response for various queries, MySQL exhibited latent or unfinished responses for complex queries with multiple-join statements. These results show that using graph-based databases, such as Neo4j, is an efficient way to store complex biological relationships. Moreover, querying a graph database in diverse ways has the potential to reveal novel relationships among heterogeneous biological data.

| S-EPMC5389944 | biostudies-literature

Fast integration of heterogeneous data sources for predicting gene function with limited annotation.

Project description:MOTIVATION: Many algorithms that integrate multiple functional association networks for predicting gene function construct a composite network as a weighted sum of the individual networks and then use the composite network to predict gene function. The weight assigned to an individual network represents the usefulness of that network in predicting a given gene function. However, because many categories of gene function have a small number of annotations, the process of assigning these network weights is prone to overfitting. RESULTS: Here, we address this problem by proposing a novel approach to combining multiple functional association networks. In particular, we present a method where network weights are simultaneously optimized on sets of related function categories. The method is simpler and faster than existing approaches. Further, we show that it produces composite networks with improved function prediction accuracy using five example species (yeast, mouse, fly, Esherichia coli and human). AVAILABILITY: Networks and code are available from: http://morrislab.med.utoronto.ca/sara/SW

| S-EPMC2894508 | biostudies-other

InterMine: a flexible data warehouse system for the integration and analysis of heterogeneous biological data.

Project description:SummaryInterMine is an open-source data warehouse system that facilitates the building of databases with complex data integration requirements and a need for a fast customizable query facility. Using InterMine, large biological databases can be created from a range of heterogeneous data sources, and the extensible data model allows for easy integration of new data types. The analysis tools include a flexible query builder, genomic region search and a library of 'widgets' performing various statistical analyses. The results can be exported in many commonly used formats. InterMine is a fully extensible framework where developers can add new tools and functionality. Additionally, there is a comprehensive set of web services, for which client libraries are provided in five commonly used programming languages.AvailabilityFreely available from http://www.intermine.org under the LGPL license.Contactg.micklem@gen.cam.ac.ukSupplementary informationSupplementary data are available at Bioinformatics online.

| S-EPMC3516146 | biostudies-literature

PyCellBase, an efficient python package for easy retrieval of biological data from heterogeneous sources.

Project description:BackgroundBiological databases and repositories are incrementing in diversity and complexity over the years. This rapid expansion of current and new sources of biological knowledge raises serious problems of data accessibility and integration. To handle the growing necessity of unification, CellBase was created as an integrative solution. CellBase provides a centralized NoSQL database containing biological information from different and heterogeneous sources. Access to this information is done through a RESTful web service API, which provides an efficient interface to the data.ResultsIn this work we present PyCellBase, a Python package that provides programmatic access to the rich RESTful web service API offered by CellBase. This package offers a fast and user-friendly access to biological information without the need of installing any local database. In addition, a series of command-line tools are provided to perform common bioinformatic tasks, such as variant annotation. CellBase data is always available by a high-availability cluster and queries have been tuned to ensure a real-time performance.ConclusionPyCellBase is an open-source Python package that provides an efficient access to heterogeneous biological information. It allows to perform tasks that require a comprehensive set of knowledge resources, as for example variant annotation. Queries can be easily fine-tuned to retrieve the desired information of particular biological features. PyCellBase offers the convenience of an object-oriented scripting language and provides the ability to integrate the obtained results into other Python applications and pipelines.

| S-EPMC6438028 | biostudies-literature

Recovery of biological information under heterogeneous experimental conditions using subgroup standardization.

Project description:Recovery of biological information (i.e. Breast tumor versus non-tumor part of breast) from microarray data under heterogeneous experimental conditions (Buffer1 versus Buffer2) using subgroup standardization. Microarray is a useful tool for gene expression analysis and prediction. For a given disease, a microarray database may come from various sources with different experimental setups, collected over time. This heterogeneity provides unnecessary complication in data analysis and, even worse, given false classification in clustering. Therefore, it is practically important to provide a standard data treatment for microarray data from heterogeneous experimental conditions. In this work, “subgroup standardization” is proposed to compensate technical heterogeneities (e.g., buffers, time, machines etc.) in microarray experimental conditions. Provided with repetitive microarray experiments, over time and buffers, the results indicate that the proposed approach can extract correct biological information in the presence of technical irregularities. Hierarchical clustering is used to validate the effectiveness of the proposed approach. Keywords: disease state study

2007-10-20 | GSE9309 | GEO

Integration of Heterogeneous Biological Data in Multiscale Mechanistic Model Calibration: Application to Lung Adenocarcinoma.

Project description:Mechanistic models are built using knowledge as the primary information source, with well-established biological and physical laws determining the causal relationships within the model. Once the causal structure of the model is determined, parameters must be defined in order to accurately reproduce relevant data. Determining parameters and their values is particularly challenging in the case of models of pathophysiology, for which data for calibration is sparse. Multiple data sources might be required, and data may not be in a uniform or desirable format. We describe a calibration strategy to address the challenges of scarcity and heterogeneity of calibration data. Our strategy focuses on parameters whose initial values cannot be easily derived from the literature, and our goal is to determine the values of these parameters via calibration with constraints set by relevant data. When combined with a covariance matrix adaptation evolution strategy (CMA-ES), this step-by-step approach can be applied to a wide range of biological models. We describe a stepwise, integrative and iterative approach to multiscale mechanistic model calibration, and provide an example of calibrating a pathophysiological lung adenocarcinoma model. Using the approach described here we illustrate the successful calibration of a complex knowledge-based mechanistic model using only the limited heterogeneous datasets publicly available in the literature.

| S-EPMC9261258 | biostudies-literature

Identifying Human SIRT1 Substrates by Integrating Heterogeneous Information from Various Sources.

Project description:Most proteins undergo different kinds of modification after translation. Protein acetylation is one of the most crucial post-translational modifications, which causes direct or indirect impact on various biological activities in vivo. As a member of Class III HDACs, SIRT1 was the closest one to the yeast sir2 and drew most attention, while a small number of known SIRT1 substrates caused difficulties to clarify its function. In this work, we designed a novel computational method to screen SIRT1 substrates based on manually collected data and Support Vector Machines (SVMs). Unlike other approaches, we took both primary sequence and protein functional features into consideration. Through integrating functional features, the Matthews correlation coefficient (MCC) for the prediction increased from 0.10 to 0.65. The prediction results were verified by independent dataset and biological experiments. The validation results demostrated that our classifier could effectively identify SIRT1 substrates and filter appropriate candidates for further research. Furthermore, we provide online tool to support SIRT1 substrates prediction, which is freely available at http://bioinfo.bjmu.edu.cn/huac/ .

| S-EPMC5496887 | biostudies-other

CMGSDB: integrating heterogeneous Caenorhabditis elegans data sources using compositional data mining.

Project description:CMGSDB (Database for Computational Modeling of Gene Silencing) is an integration of heterogeneous data sources about Caenorhabditis elegans with capabilities for compositional data mining (CDM) across diverse domains. Besides gene, protein and functional annotations, CMGSDB currently unifies information about 531 RNAi phenotypes obtained from heterogeneous databases using a hierarchical scheme. A phenotype browser at the CMGSDB website serves this hierarchy and relates phenotypes to other biological entities. The application of CDM to CMGSDB produces 'chains' of relationships in the data by finding two-way connections between sets of biological entities. Chains can, for example, relate the knock down of a set of genes during an RNAi experiment to the disruption of a pathway or specific gene expression through another set of genes not directly related to the former set. The web interface for CMGSDB is available at https://bioinformatics.cs.vt.edu/cmgs/CMGSDB/, and serves individual biological entity information as well as details of all chains computed by CDM.

| S-EPMC2238953 | biostudies-literature

BIOZON: a hub of heterogeneous biological data.

Project description:Biological entities are strongly related and mutually dependent on each other. Therefore, there is a growing need to corroborate and integrate data from different resources and aspects of biological systems in order to analyze them effectively. Biozon is a unified biological database that integrates heterogeneous data types such as proteins, structures, domain families, protein-protein interactions and cellular pathways, and establishes the relationships between them. All data are integrated on to a single graph schema centered around the non-redundant set of biological objects that are shared by each source. This integration results in a highly connected graph structure that provides a more complete picture of the known context of a given object that cannot be determined from any one source. Currently, Biozon integrates roughly 2 million protein sequences, 42 million DNA or RNA sequences, 32,000 protein structures, 150,000 interactions and more from sources such as GenBank, UniProt, Protein Data Bank (PDB) and BIND. Biozon augments source data with locally derived data such as 5 billion pairwise protein alignments and 8 million structural alignments. The user may form complex cross-type queries on the graph structure, add similarity relations to form fuzzy queries and rank the results based on analysis of the edge structure similar to Google PageRank, online at Biozon.org.

| S-EPMC1347515 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data