The variable quality of metadata about biological samples used in biomedical experiments.
Ontology highlight
ABSTRACT:
SUBMITTER: Goncalves RS
PROVIDER: S-EPMC6380228 | biostudies-literature | 2019 Feb
REPOSITORIES: biostudies-literature
Publications
The variable quality of metadata about biological samples used in biomedical experiments.
Gonçalves Rafael S RS Musen Mark A MA
Scientific data 20190219
We present an analytical study of the quality of metadata about samples used in biomedical experiments. The metadata under analysis are stored in two well-known databases: BioSample-a repository managed by the National Center for Biotechnology Information (NCBI), and BioSamples-a repository managed by the European Bioinformatics Institute (EBI). We tested whether 11.4 M sample metadata records in the two repositories are populated with values that fulfill the stated requirements for such values. ...[more]
Similar Datasets
Project description:Unsupervised learning techniques, such as clustering and embedding, have been increasingly popular to cluster biomedical samples from high-dimensional biomedical data. Extracting clinical data or sample meta-data shared in common among biomedical samples of a given biological condition remains a major challenge. Here, we describe a powerful analytical method called Statistical Enrichment Analysis of Samples (SEAS) for interpreting clustered or embedded sample data from omics studies. The method derives its power by focusing on sample sets, i.e., groups of biological samples that were constructed for various purposes, e.g., manual curation of samples sharing specific characteristics or automated clusters generated by embedding sample omic profiles from multi-dimensional omics space. The samples in the sample set share common clinical measurements, which we refer to as "clinotypes," such as age group, gender, treatment status, or survival days. We demonstrate how SEAS yields insights into biological data sets using glioblastoma (GBM) samples. Notably, when analyzing the combined The Cancer Genome Atlas (TCGA)-patient-derived xenograft (PDX) data, SEAS allows approximating the different clinical outcomes of radiotherapy-treated PDX samples, which has not been solved by other tools. The result shows that SEAS may support the clinical decision. The SEAS tool is publicly available as a freely available software package at https://aimed-lab.shinyapps.io/SEAS/.
| S-EPMC8481385 | biostudies-literature
Project description:Over 15% of the data sets catalogued in the Gene Expression Omnibus Database involve RNA samples that have been pooled before hybridization. Pooling affects data quality and inference, but the exact effects are not yet known because pooling has not been systematically studied in the context of microarray experiments. Here we report on the results of an experiment designed to evaluate the utility of pooling and the impact on identifying differentially expressed genes. We find that inference for most genes is not adversely affected by pooling, and we recommend that pooling be done when fewer than three arrays are used in each condition. For larger designs, pooling does not significantly improve inferences if few subjects are pooled. The realized benefits in this case do not outweigh the price paid for loss of individual specific information. Pooling is beneficial when many subjects are pooled, provided that independent samples contribute to multiple pools.
| S-EPMC552978 | biostudies-literature
Project description:IntroductionComputable biomedical knowledge artifacts (CBKs) are digital objects conveying biomedical knowledge in machine-interpretable structures. As more CBKs are produced and their complexity increases, the value obtained from sharing CBKs grows. Mobilizing CBKs and sharing them widely can only be achieved if the CBKs are findable, accessible, interoperable, reusable, and trustable (FAIR+T). To help mobilize CBKs, we describe our efforts to outline metadata categories to make CBKs FAIR+T.MethodsWe examined the literature regarding metadata with the potential to make digital artifacts FAIR+T. We also examined metadata available online today for actual CBKs of 12 different types. With iterative refinement, we came to a consensus on key categories of metadata that, when taken together, can make CBKs FAIR+T. We use subject-predicate-object triples to more clearly differentiate metadata categories.ResultsWe defined 13 categories of CBK metadata most relevant to making CBKs FAIR+T. Eleven of these categories (type, domain, purpose, identification, location, CBK-to-CBK relationships, technical, authorization and rights management, provenance, evidential basis, and evidence from use metadata) are evident today where CBKs are stored online. Two additional categories (preservation and integrity metadata) were not evident in our examples. We provide a research agenda to guide further study and development of these and other metadata categories.ConclusionA wide variety of metadata elements in various categories is needed to make CBKs FAIR+T. More work is needed to develop a common framework for CBK metadata that can make CBKs FAIR+T for all stakeholders.
| S-EPMC8753304 | biostudies-literature
Project description:Genome-scale "-omics" measurements are challenging to benchmark due to the enormous variety of unique biological molecules involved. Mixtures of previously-characterized samples can be used to benchmark repeatability and reproducibility using component proportions as truth for the measurement. We describe and evaluate experiments characterizing the performance of RNA-sequencing (RNA-Seq) measurements, and discuss cases where mixtures can serve as effective process controls.We apply a linear model to total RNA mixture samples in RNA-seq experiments. This model provides a context for performance benchmarking. The parameters of the model fit to experimental results can be evaluated to assess bias and variability of the measurement of a mixture. A linear model describes the behavior of mixture expression measures and provides a context for performance benchmarking. Residuals from fitting the model to experimental data can be used as a metric for evaluating the effect that an individual step in an experimental process has on the linear response function and precision of the underlying measurement while identifying signals affected by interference from other sources. Effective benchmarking requires well-defined mixtures, which for RNA-Seq requires knowledge of the post-enrichment 'target RNA' content of the individual total RNA components. We demonstrate and evaluate an experimental method suitable for use in genome-scale process control and lay out a method utilizing spike-in controls to determine enriched RNA content of total RNA in samples.Genome-scale process controls can be derived from mixtures. These controls relate prior knowledge of individual components to a complex mixture, allowing assessment of measurement performance. The target RNA fraction accounts for differential selection of RNA out of variable total RNA samples. Spike-in controls can be utilized to measure this relationship between target RNA content and input total RNA. Our mixture analysis method also enables estimation of the proportions of an unknown mixture, even when component-specific markers are not previously known, whenever pure components are measured alongside the mixture.
| S-EPMC4574543 | biostudies-literature
Project description:BACKGROUND: Ontology term labels can be ambiguous and have multiple senses. While this is no problem for human annotators, it is a challenge to automated methods, which identify ontology terms in text. Classical approaches to word sense disambiguation use co-occurring words or terms. However, most treat ontologies as simple terminologies, without making use of the ontology structure or the semantic similarity between terms. Another useful source of information for disambiguation are metadata. Here, we systematically compare three approaches to word sense disambiguation, which use ontologies and metadata, respectively. RESULTS: The 'Closest Sense' method assumes that the ontology defines multiple senses of the term. It computes the shortest path of co-occurring terms in the document to one of these senses. The 'Term Cooc' method defines a log-odds ratio for co-occurring terms including co-occurrences inferred from the ontology structure. The 'MetaData' approach trains a classifier on metadata. It does not require any ontology, but requires training data, which the other methods do not. To evaluate these approaches we defined a manually curated training corpus of 2600 documents for seven ambiguous terms from the Gene Ontology and MeSH. All approaches over all conditions achieve 80% success rate on average. The 'MetaData' approach performed best with 96%, when trained on high-quality data. Its performance deteriorates as quality of the training data decreases. The 'Term Cooc' approach performs better on Gene Ontology (92% success) than on MeSH (73% success) as MeSH is not a strict is-a/part-of, but rather a loose is-related-to hierarchy. The 'Closest Sense' approach achieves on average 80% success rate. CONCLUSION: Metadata is valuable for disambiguation, but requires high quality training data. Closest Sense requires no training, but a large, consistently modelled ontology, which are two opposing conditions. Term Cooc achieves greater 90% success given a consistently modelled ontology. Overall, the results show that well structured ontologies can play a very important role to improve disambiguation. AVAILABILITY: The three benchmark datasets created for the purpose of disambiguation are available in Additional file 1.
| S-EPMC2663782 | biostudies-literature
Project description:A crucial and limiting factor in data reuse is the lack of accurate, structured, and complete descriptions of data, known as metadata. Towards improving the quantity and quality of metadata, we propose a novel metadata prediction framework to learn associations from existing metadata that can be used to predict metadata values. We evaluate our framework in the context of experimental metadata from the Gene Expression Omnibus (GEO). We applied four rule mining algorithms to the most common structured metadata elements (sample type, molecular type, platform, label type and organism) from over 1.3million GEO records. We examined the quality of well supported rules from each algorithm and visualized the dependencies among metadata elements. Finally, we evaluated the performance of the algorithms in terms of accuracy, precision, recall, and F-measure. We found that PART is the best algorithm outperforming Apriori, Predictive Apriori, and Decision Table. All algorithms perform significantly better in predicting class values than the majority vote classifier. We found that the performance of the algorithms is related to the dimensionality of the GEO elements. The average performance of all algorithm increases due of the decreasing of dimensionality of the unique values of these elements (2697 platforms, 537 organisms, 454 labels, 9 molecules, and 5 types). Our work suggests that experimental metadata such as present in GEO can be accurately predicted using rule mining algorithms. Our work has implications for both prospective and retrospective augmentation of metadata quality, which are geared towards making data easier to find and reuse.
| S-EPMC5643580 | biostudies-literature
Project description:An essential aspect of scientific reproducibility is a coherent and complete acquisition of metadata along with the actual data of an experiment. The high degree of complexity and heterogeneity of neuroscience experiments requires a rigorous management of the associated metadata. The odML framework represents a solution to organize and store complex metadata digitally in a hierarchical format that is both human and machine readable. However, this hierarchical representation of metadata is difficult to handle when metadata entries need to be collected and edited manually during the daily routines of a laboratory. With odMLtables, we present an open-source software solution that enables users to collect, manipulate, visualize, and store metadata in tabular representations (in xls or csv format) by providing functionality to convert these tabular collections to the hierarchically structured metadata format odML, and to either extract or merge subsets of a complex metadata collection. With this, odMLtables bridges the gap between handling metadata in an intuitive way that integrates well with daily lab routines and commonly used software products on the one hand, and the implementation of a complete, well-defined metadata collection for the experiment in a standardized format on the other hand. We demonstrate usage scenarios of the odMLtables tools in common lab routines in the context of metadata acquisition and management, and show how the tool can assist in exploring published datasets that provide metadata in the odML format.
| S-EPMC6776611 | biostudies-literature
Project description:Agricultural long-term experiments (LTEs) are an important research infrastructure for agriculture, plant and soil sciences. The aim of this metadata compilation is to make LTEs easier to find and to facilitate networking. LTEs are here defined as agricultural experiments with a minimum duration of 20 years and research in the context of soil and yield. An extensive literature review was conducted to identify LTEs in Europe exclusive of Germany, because Germany's LTEs were published before. Sources were scientific papers as well as other articles, books, trial guides and websites. The following information was searched for and compiled in this dataset, if available: site and name of the LTE, start and end (if appropriate), holding institution, type of land use (e.g. field crops or grassland), research theme, website (if available), participation in networks, measured parameters, farming category (i.e. conventional or organic), size of the LTE area, longitude and latitude of the LTE, experimental setup including factors, treatments, randomization and replication, number of plots, size of the plots, crop rotation, soil type, substrate, texture, literature which was written in the context of the LTE data, and AGROVOC keywords. LTE from the following countries are included: Austria, Belarus, Belgium, Bulgaria, Czech Republic, Denmark, Estonia, Finland, France, Great Britain, Hungary, Italy, Moldova, Norway, Poland, Romania, Serbia, Slovenia, Spain, Sweden, Switzerland, Ukraine. In total, 186 LTEs could be identified. The LTEs were classified according to the following research themes: fertilization, tillage, crop rotation, other. The majority of LTEs have the research theme "fertilization" (n = 125). Thirty LTEs have the research theme "crop rotation", 26 LTEs have the research theme "tillage", and 26 LTEs have "other" research themes. The following networks could be identified: GLTEN (Global long-term experiment network), ILTER (International long-term ecological research), IOSDV (International Organic Nitrogen Fertilization Experiment), NLFT (National Long-term Fertilization Trials, Hungary), RetiBio 2 (Italy). The oldest LTE was set up 1843, but the largest number of LTEs was established in the second half of the 20th century. Most of the LTEs are held by a scientific institution, i.e. 88 LTEs are held by a non-university scientific institution and 81 LTEs are held by a university or university of applied sciences. The link to the holding institution is provided whenever possible to facilitate contacting.
| S-EPMC8408514 | biostudies-literature
Project description:Public resources need to be appropriately annotated with metadata in order to make them discoverable, reproducible and traceable, further enabling them to be interoperable or integrated with other datasets. While data-sharing policies exist to promote the annotation process by data owners, these guidelines are still largely ignored. In this manuscript, we analyse automatic measures of metadata quality, and suggest their application as a mean to encourage data owners to increase the metadata quality of their resources and submissions, thereby contributing to higher quality data, improved data sharing, and the overall accountability of scientific publications. We analyse these metadata quality measures in the context of a real-world repository of metabolomics data (i.e. MetaboLights), including a manual validation of the measures, and an analysis of their evolution over time. Our findings suggest that the proposed measures can be used to mimic a manual assessment of metadata quality.
| S-EPMC6042808 | biostudies-literature
Project description:The availability of bioresources is a precondition for life science research, medical applications, and diagnostics, but requires a dedicated quality management to guarantee reliable and safe storage. Anecdotal reports of bacterial isolates and sample contamination indicate that organisms may persist in liquid nitrogen (LN) storage tanks. To evaluate the safety status of cryocollections, we systematically screened organisms in the LN phase and in ice layers covering inner surfaces of storage tanks maintained in different biobanking facilities. We applied a culture-independent approach combining cell detection by epifluorescence microscopy with the amplification of group-specific marker genes and high-throughput sequencing of bacterial ribosomal genes. In the LN phase, neither cells nor bacterial 16S rRNA gene copy numbers were detectable (detection limit, 102 cells per ml, 103 gene copies per ml). In several cases, small numbers of bacteria of up to 104 cells per ml and up to 106 gene copies per ml, as well as Mycoplasma, or fungi were detected in the ice phase formed underneath the lids or accumulated at the bottom. The bacteria most likely originated from the stored materials themselves (Elizabethingia, Janthibacterium), the technical environment (Pseudomonas, Acinetobacter, Methylobacterium), or the human microbiome (Bacteroides, Streptococcus, Staphylococcus). In single cases, bacteria, Mycoplasma, fungi, and human cells were detected in the debris at the bottom of the storage tanks. In conclusion, the limited microbial load of the ice phase and in the debris of storage tanks can be effectively avoided by minimizing ice formation and by employing hermetically sealed sample containers.
| S-EPMC6942587 | biostudies-literature