Browse
Submit Data
Databases
API
Help

Dataset Information

30 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Information Integration from Semantically Heterogeneous Biological Data Sources.

ABSTRACT: We present the first prototype of INDUS (Intelligent Data Understanding System), a federated, query-centric system for information integration and knowledge acquisition from distributed, semantically heterogeneous data sources that can be viewed (conceptually) as tables. INDUS employs ontologies and inter-ontology mappings, to enable a user to view a collection of such data sources (regardless of location, internal structure and query interfaces) as though they were a collection of tables structured according to an ontology supplied by the user. This allows INDUS to answer user queries against distributed, semantically heterogeneous data sources without the need for a centralized data warehouse or a common global ontology.

SUBMITTER: Caragea D

PROVIDER: S-EPMC2929138 | biostudies-literature | 2005 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Information Integration from Semantically Heterogeneous Biological Data Sources.

Caragea Doina D Bao Jie J Pathak Jyotishman J Silvescu Adrian A Andorf Carson C Dobbs Drena D Honavar Vasant V

International Workshop on Databases and Expert Systems Applications : proceedings 20050801

We present the first prototype of INDUS (Intelligent Data Understanding System), a federated, query-centric system for information integration and knowledge acquisition from distributed, semantically heterogeneous data sources that can be viewed (conceptually) as tables. INDUS employs ontologies and inter-ontology mappings, to enable a user to view a collection of such data sources (regardless of location, internal structure and query interfaces) as though they were a collection of tables struct ...[more]

PMID: 20802821

Similar Datasets

Dynamic integration of biological data sources using the data concierge.

Project description:BackgroundThe ever-changing landscape of large-scale network environments and innovative biology technologies require dynamic mechanisms to rapidly integrate previously unknown bioinformatics sources at runtime. However, existing integration technologies lack sufficient flexibility to adapt to these changes, because the techniques used for integration are static, and sensitive to new or changing bioinformatics source implementations and evolutionary biologist requirements.MethodsTo address this challenge, in this paper we propose a new semantics-based adaptive middleware, the Data Concierge, which is able to dynamically integrate heterogeneous biological data sources without the need for wrappers. Along with the architecture necessary to facilitate dynamic integration, API description mechanism is proposed to dynamically classify, recognize, locate, and invoke newly added biological data source functionalities. Based on the unified semantic metadata, XML-based state machines are able to provide flexible configurations to execute biologist's abstract and complex operations.Results and discussionExperimental results demonstrate that for obtaining dynamic features, the Data Concierge sacrifices reasonable performance on reasoning knowledge models and dynamically doing data source API invocations. The overall costs to integrate new biological data sources are significantly lower when using the Data Concierge.ConclusionsThe Data Concierge facilitates the rapid integration of new biological data sources in existing applications with no repetitive software development required, and hence, this mechanism would provide a cost-effective solution to the labor-intensive software engineering tasks.

| S-EPMC4340781 | biostudies-literature

Fast integration of heterogeneous data sources for predicting gene function with limited annotation.

Project description:MotivationMany algorithms that integrate multiple functional association networks for predicting gene function construct a composite network as a weighted sum of the individual networks and then use the composite network to predict gene function. The weight assigned to an individual network represents the usefulness of that network in predicting a given gene function. However, because many categories of gene function have a small number of annotations, the process of assigning these network weights is prone to overfitting.ResultsHere, we address this problem by proposing a novel approach to combining multiple functional association networks. In particular, we present a method where network weights are simultaneously optimized on sets of related function categories. The method is simpler and faster than existing approaches. Further, we show that it produces composite networks with improved function prediction accuracy using five example species (yeast, mouse, fly, Esherichia coli and human).AvailabilityNetworks and code are available from: http://morrislab.med.utoronto.ca/sara/SW

| S-EPMC2894508 | biostudies-literature

Use of Graph Database for the Integration of Heterogeneous Biological Data.

Project description:Understanding complex relationships among heterogeneous biological data is one of the fundamental goals in biology. In most cases, diverse biological data are stored in relational databases, such as MySQL and Oracle, which store data in multiple tables and then infer relationships by multiple-join statements. Recently, a new type of database, called the graph-based database, was developed to natively represent various kinds of complex relationships, and it is widely used among computer science communities and IT industries. Here, we demonstrate the feasibility of using a graph-based database for complex biological relationships by comparing the performance between MySQL and Neo4j, one of the most widely used graph databases. We collected various biological data (protein-protein interaction, drug-target, gene-disease, etc.) from several existing sources, removed duplicate and redundant data, and finally constructed a graph database containing 114,550 nodes and 82,674,321 relationships. When we tested the query execution performance of MySQL versus Neo4j, we found that Neo4j outperformed MySQL in all cases. While Neo4j exhibited a very fast response for various queries, MySQL exhibited latent or unfinished responses for complex queries with multiple-join statements. These results show that using graph-based databases, such as Neo4j, is an efficient way to store complex biological relationships. Moreover, querying a graph database in diverse ways has the potential to reveal novel relationships among heterogeneous biological data.

| S-EPMC5389944 | biostudies-literature

InterMine: a flexible data warehouse system for the integration and analysis of heterogeneous biological data.

Project description:SummaryInterMine is an open-source data warehouse system that facilitates the building of databases with complex data integration requirements and a need for a fast customizable query facility. Using InterMine, large biological databases can be created from a range of heterogeneous data sources, and the extensible data model allows for easy integration of new data types. The analysis tools include a flexible query builder, genomic region search and a library of 'widgets' performing various statistical analyses. The results can be exported in many commonly used formats. InterMine is a fully extensible framework where developers can add new tools and functionality. Additionally, there is a comprehensive set of web services, for which client libraries are provided in five commonly used programming languages.AvailabilityFreely available from http://www.intermine.org under the LGPL license.Contactg.micklem@gen.cam.ac.ukSupplementary informationSupplementary data are available at Bioinformatics online.

| S-EPMC3516146 | biostudies-literature

PyCellBase, an efficient python package for easy retrieval of biological data from heterogeneous sources.

Project description:BackgroundBiological databases and repositories are incrementing in diversity and complexity over the years. This rapid expansion of current and new sources of biological knowledge raises serious problems of data accessibility and integration. To handle the growing necessity of unification, CellBase was created as an integrative solution. CellBase provides a centralized NoSQL database containing biological information from different and heterogeneous sources. Access to this information is done through a RESTful web service API, which provides an efficient interface to the data.ResultsIn this work we present PyCellBase, a Python package that provides programmatic access to the rich RESTful web service API offered by CellBase. This package offers a fast and user-friendly access to biological information without the need of installing any local database. In addition, a series of command-line tools are provided to perform common bioinformatic tasks, such as variant annotation. CellBase data is always available by a high-availability cluster and queries have been tuned to ensure a real-time performance.ConclusionPyCellBase is an open-source Python package that provides an efficient access to heterogeneous biological information. It allows to perform tasks that require a comprehensive set of knowledge resources, as for example variant annotation. Queries can be easily fine-tuned to retrieve the desired information of particular biological features. PyCellBase offers the convenience of an object-oriented scripting language and provides the ability to integrate the obtained results into other Python applications and pipelines.

| S-EPMC6438028 | biostudies-literature

Recovery of biological information under heterogeneous experimental conditions using subgroup standardization.

Project description:Recovery of biological information (i.e. Breast tumor versus non-tumor part of breast) from microarray data under heterogeneous experimental conditions (Buffer1 versus Buffer2) using subgroup standardization. Microarray is a useful tool for gene expression analysis and prediction. For a given disease, a microarray database may come from various sources with different experimental setups, collected over time. This heterogeneity provides unnecessary complication in data analysis and, even worse, given false classification in clustering. Therefore, it is practically important to provide a standard data treatment for microarray data from heterogeneous experimental conditions. In this work, “subgroup standardization” is proposed to compensate technical heterogeneities (e.g., buffers, time, machines etc.) in microarray experimental conditions. Provided with repetitive microarray experiments, over time and buffers, the results indicate that the proposed approach can extract correct biological information in the presence of technical irregularities. Hierarchical clustering is used to validate the effectiveness of the proposed approach. Keywords: disease state study

2007-10-20 | GSE9309 | GEO

Integration of Heterogeneous Biological Data in Multiscale Mechanistic Model Calibration: Application to Lung Adenocarcinoma.

Project description:Mechanistic models are built using knowledge as the primary information source, with well-established biological and physical laws determining the causal relationships within the model. Once the causal structure of the model is determined, parameters must be defined in order to accurately reproduce relevant data. Determining parameters and their values is particularly challenging in the case of models of pathophysiology, for which data for calibration is sparse. Multiple data sources might be required, and data may not be in a uniform or desirable format. We describe a calibration strategy to address the challenges of scarcity and heterogeneity of calibration data. Our strategy focuses on parameters whose initial values cannot be easily derived from the literature, and our goal is to determine the values of these parameters via calibration with constraints set by relevant data. When combined with a covariance matrix adaptation evolution strategy (CMA-ES), this step-by-step approach can be applied to a wide range of biological models. We describe a stepwise, integrative and iterative approach to multiscale mechanistic model calibration, and provide an example of calibrating a pathophysiological lung adenocarcinoma model. Using the approach described here we illustrate the successful calibration of a complex knowledge-based mechanistic model using only the limited heterogeneous datasets publicly available in the literature.

| S-EPMC9261258 | biostudies-literature

Accurate integration of multiple heterogeneous single-cell RNA-seq data sets by learning contrastive biological variation.

Project description:For most biological and medical applications of single-cell transcriptomics, an integrative study of multiple heterogeneous single-cell RNA sequencing (scRNA-seq) data sets is crucial. However, present approaches are unable to integrate diverse data sets from various biological conditions effectively because of the confounding effects of biological and technical differences. We introduce single-cell integration (scInt), an integration method based on accurate, robust cell-cell similarity construction and unified contrastive biological variation learning from multiple scRNA-seq data sets. scInt provides a flexible and effective approach to transfer knowledge from the already integrated reference to the query. We show that scInt outperforms 10 other cutting-edge approaches using both simulated and real data sets, particularly in the case of complex experimental designs. Application of scInt to mouse developing tracheal epithelial data shows its ability to integrate development trajectories from different developmental stages. Furthermore, scInt successfully identifies functionally distinct condition-specific cell subpopulations in single-cell heterogeneous samples from a variety of biological conditions.

| S-EPMC10317120 | biostudies-literature

Identifying Human SIRT1 Substrates by Integrating Heterogeneous Information from Various Sources.

Project description:Most proteins undergo different kinds of modification after translation. Protein acetylation is one of the most crucial post-translational modifications, which causes direct or indirect impact on various biological activities in vivo. As a member of Class III HDACs, SIRT1 was the closest one to the yeast sir2 and drew most attention, while a small number of known SIRT1 substrates caused difficulties to clarify its function. In this work, we designed a novel computational method to screen SIRT1 substrates based on manually collected data and Support Vector Machines (SVMs). Unlike other approaches, we took both primary sequence and protein functional features into consideration. Through integrating functional features, the Matthews correlation coefficient (MCC) for the prediction increased from 0.10 to 0.65. The prediction results were verified by independent dataset and biological experiments. The validation results demostrated that our classifier could effectively identify SIRT1 substrates and filter appropriate candidates for further research. Furthermore, we provide online tool to support SIRT1 substrates prediction, which is freely available at http://bioinfo.bjmu.edu.cn/huac/ .

| S-EPMC5496887 | biostudies-other

HIDTI: integration of heterogeneous information to predict drug-target interactions.

Project description:Identification of drug-target interactions (DTIs) plays a crucial role in drug development. Traditional laboratory-based DTI discovery is generally costly and time-consuming. Therefore, computational approaches have been developed to predict interactions between drug candidates and disease-causing proteins. We designed a novel method, termed heterogeneous information integration for DTI prediction (HIDTI), based on the concept of predicting vectors for all of unknown/unavailable heterogeneous drug- and protein-related information. We applied a residual network in HIDTI to extract features of such heterogeneous information for predicting DTIs, and tested the model using drug-based ten-fold cross-validation to examine the prediction performance for unseen drugs. As a result, HIDTI outperformed existing models using heterogeneous information, and was demonstrating that our method predicted heterogeneous information on unseen data better than other models. In conclusion, our study suggests that HIDTI has the potential to advance the field of drug development by accurately predicting the targets of new drugs.

| S-EPMC8904809 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data