Global Property Prediction: A Benchmark Study on Open-Source, Perovskite-like Datasets.
Ontology highlight
ABSTRACT:
SUBMITTER: Mayr F
PROVIDER: S-EPMC8154242 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The ability to predict antibody binding sites (aka antigenic determinants or B-cell epitopes) for a given protein is a precursor to new vaccine design and diagnostics. Among the various methods of B-cell epitope identification X-ray crystallography is one of the most reliable methods. Using these experimental data computational methods exist for B-cell epitope prediction. As the number of structures of antibody-protein complexes grows, further interest in prediction methods using 3D structure is anticipated. This work aims to establish a benchmark for 3D structure-based epitope prediction methods.Two B-cell epitope benchmark datasets inferred from the 3D structures of antibody-protein complexes were defined. The first is a dataset of 62 representative 3D structures of protein antigens with inferred structural epitopes. The second is a dataset of 82 structures of antibody-protein complexes containing different structural epitopes. Using these datasets, eight web-servers developed for antibody and protein binding sites prediction have been evaluated. In no method did performance exceed a 40% precision and 46% recall. The values of the area under the receiver operating characteristic curve for the evaluated methods were about 0.6 for ConSurf, DiscoTope, and PPI-PRED methods and above 0.65 but not exceeding 0.70 for protein-protein docking methods when the best of the top ten models for the bound docking were considered; the remaining methods performed close to random. The benchmark datasets are included as a supplement to this paper.It may be possible to improve epitope prediction methods through training on datasets which include only immune epitopes and through utilizing more features characterizing epitopes, for example, the evolutionary conservation score. Notwithstanding, overall poor performance may reflect the generality of antigenicity and hence the inability to decipher B-cell epitopes as an intrinsic feature of the protein. It is an open question as to whether ultimately discriminatory features can be found.
| S-EPMC2174481 | biostudies-literature
Project description:: Similarity-search methods using molecular fingerprints are an important tool for ligand-based virtual screening. A huge variety of fingerprints exist and their performance, usually assessed in retrospective benchmarking studies using data sets with known actives and known or assumed inactives, depends largely on the validation data sets used and the similarity measure used. Comparing new methods to existing ones in any systematic way is rather difficult due to the lack of standard data sets and evaluation procedures. Here, we present a standard platform for the benchmarking of 2D fingerprints. The open-source platform contains all source code, structural data for the actives and inactives used (drawn from three publicly available collections of data sets), and lists of randomly selected query molecules to be used for statistically valid comparisons of methods. This allows the exact reproduction and comparison of results for future studies. The results for 12 standard fingerprints together with two simple baseline fingerprints assessed by seven evaluation methods are shown together with the correlations between methods. High correlations were found between the 12 fingerprints and a careful statistical analysis showed that only the two baseline fingerprints were different from the others in a statistically significant way. High correlations were also found between six of the seven evaluation methods, indicating that despite their seeming differences, many of these methods are similar to each other.
| S-EPMC3686626 | biostudies-literature
Project description:This paper describes OSeMOSYS Global, an open-source, open-data model generator for creating global electricity system models for an active global modelling community. This version of the model generator is freely available and can be used to create interconnected electricity system models for both the entire globe and for any geographically diverse subset of the globe. Compared to other existing global models, OSeMOSYS Global allows for full user flexibility in determining the time slice structure and geographic scope of the model and datasets, and is built using the widely used fully open-source OSeMOSYS energy system model. This paper describes the data sources, structure and use of OSeMOSYS Global, and provides illustrative workflow results.
| S-EPMC9568605 | biostudies-literature
Project description:OBJECTIVE:Finding relevant datasets is important for promoting data reuse in the biomedical domain, but it is challenging given the volume and complexity of biomedical data. Here we describe the development of an open source biomedical data discovery system called DataMed, with the goal of promoting the building of additional data indexes in the biomedical domain. MATERIALS AND METHODS:DataMed, which can efficiently index and search diverse types of biomedical datasets across repositories, is developed through the National Institutes of Health-funded biomedical and healthCAre Data Discovery Index Ecosystem (bioCADDIE) consortium. It consists of 2 main components: (1) a data ingestion pipeline that collects and transforms original metadata information to a unified metadata model, called DatA Tag Suite (DATS), and (2) a search engine that finds relevant datasets based on user-entered queries. In addition to describing its architecture and techniques, we evaluated individual components within DataMed, including the accuracy of the ingestion pipeline, the prevalence of the DATS model across repositories, and the overall performance of the dataset retrieval engine. RESULTS AND CONCLUSION:Our manual review shows that the ingestion pipeline could achieve an accuracy of 90% and core elements of DATS had varied frequency across repositories. On a manually curated benchmark dataset, the DataMed search engine achieved an inferred average precision of 0.2033 and a precision at 10 (P@10, the number of relevant results in the top 10 search results) of 0.6022, by implementing advanced natural language processing and terminology services. Currently, we have made the DataMed system publically available as an open source package for the biomedical community.
| S-EPMC7378878 | biostudies-literature
Project description:Over the last few decades, researchers have developed a number of empirical and theoretical models for the correlation and prediction of the thermophysical properties of pure fluids and mixtures treated as pseudo-pure fluids. In this paper, a survey of all the state-of-the-art formulations of thermophysical properties is presented. The most-accurate thermodynamic properties are obtained from multiparameter Helmholtz-energy-explicit-type formulations. For the transport properties, a wider range of methods has been employed, including the extended corresponding states method. All of the thermophysical property correlations described here have been implemented into CoolProp, an open-source thermophysical property library. This library is written in C++, with wrappers available for the majority of programming languages and platforms of technical interest. As of publication, 110 pure and pseudo-pure fluids are included in the library, as well as properties of 40 incompressible fluids and humid air. The source code for the CoolProp library is included as an electronic annex.
| S-EPMC3944605 | biostudies-literature
Project description:BackgroundBenchmark datasets are essential for both method development and performance assessment. These datasets have numerous requirements, representativeness being one. In the case of variant tolerance/pathogenicity prediction, representativeness means that the dataset covers the space of variations and their effects.ResultsWe performed the first analysis of the representativeness of variation benchmark datasets. We used statistical approaches to investigate how proteins in the benchmark datasets were representative for the entire human protein universe. We investigated the distributions of variants in chromosomes, protein structures, CATH domains and classes, Pfam protein families, Enzyme Commission (EC) classifications and Gene Ontology annotations in 24 datasets that have been used for training and testing variant tolerance prediction methods. All the datasets were available in VariBench or VariSNP databases. We tested also whether the pathogenic variant datasets contained neutral variants defined as those that have high minor allele frequency in the ExAC database. The distributions of variants over the chromosomes and proteins varied greatly between the datasets.ConclusionsNone of the datasets was found to be well representative. Many of the tested datasets had quite good coverage of the different protein characteristics. Dataset size correlates to representativeness but only weakly to the performance of methods trained on them. The results imply that dataset representativeness is an important factor and should be taken into account in predictor development and testing.
| S-EPMC6267811 | biostudies-literature
Project description:Large datasets that enable researchers to perform investigations with unprecedented rigor are growing increasingly common in neuroimaging. Due to the simultaneous increasing popularity of open science, these state-of-the-art datasets are more accessible than ever to researchers around the world. While analysis of these samples has pushed the field forward, they pose a new set of challenges that might cause difficulties for novice users. Here we offer practical tips for working with large datasets from the end-user's perspective. We cover all aspects of the data lifecycle: from what to consider when downloading and storing the data to tips on how to become acquainted with a dataset one did not collect and what to share when communicating results. This manuscript serves as a practical guide one can use when working with large neuroimaging datasets, thus dissolving barriers to scientific discovery.
| S-EPMC7992920 | biostudies-literature
Project description:Vascular networks are fundamental components of biological systems. Quantitative analysis and observation of the features of these networks can improve our understanding of their roles in health and disease. Recent advancements in imaging technologies have enabled the generation of large-scale vasculature datasets, but barriers to analyzing these datasets remain. Modern analysis options are mainly limited to paid applications or open-source terminal-based software that requires programming knowledge with high learning curves. Here, we describe VesselVio, an open-source application developed to analyze and visualize pre-binarized vasculature datasets and pre-constructed vascular graphs. Vasculature datasets and graphs can be loaded with annotations and processed with custom parameters. Here, the program is tested on ground-truth datasets and is compared with current pipelines. The utility of VesselVio is demonstrated by the analysis of multiple formats of 2D and 3D datasets acquired with several imaging modalities, including annotated mouse whole-brain vasculature volumes.
| S-EPMC9046271 | biostudies-literature
Project description:Lead-halide perovskite nanocrystals are an attractive class of materials since they can be easily fabricated, their optical properties can be tuned all over the visible spectral range, and they possess high emission quantum yields and narrow photoluminescence linewidths. Doping perovskites with lanthanides is one of the ways to widen the spectral range of their emission, making them attractive for further applications. Herein, we summarize the recent progress in the synthesis of ytterbium-doped perovskite nanocrystals in terms of the varying synthesis parameters such as temperature, ligand molar ratio, ytterbium precursor type, and dopant content. We further consider the dependence of morphology (size and ytterbium content) and optical parameters (photoluminescence quantum yield in visible and near-infrared spectral ranges) on the synthesis parameters. The developed open-source code approximates those dependencies as multiple-parameter linear regression and allows us to estimate the value of the photoluminescence quantum yield from the parameters of the perovskite synthesis. Further use and promotion of an open-source database will expand the possibilities of the developed code to predict the synthesis protocols for doped perovskite nanocrystals.
| S-EPMC9958719 | biostudies-literature
Project description:Powered lower-limb assistive devices, such as prostheses and exoskeletons, are a promising option for helping mobility-impaired individuals regain functional gait. Gait phase prediction plays an important role in controlling these devices and evaluating whether the device generates a gait similar to that of individuals with intact limbs. This study proposes a gait phase prediction method based on a deep neural network (DNN). The long short-term memory (LSTM)-based model predicts a continuous gait phase from the 250 ms history of the vertical load, thigh angle, knee angle, and ankle angle, commonly available on powered lower-limb assistive devices. One unified model was trained using publicly available benchmark datasets containing intact limb gaits for level-ground walking (LGW) and ascending stairs (SA). A phase prediction error of 1.28% for all benchmark datasets was obtained. The model was subsequently applied to a state machine-controlled powered prosthetic leg dataset collected from four individuals with unilateral transfemoral amputation. The gait phase prediction results (a phase prediction error of 5.70%) indicate that the model trained on benchmark data can be used for a system not included in the training dataset with no post-processing, such as model adaptation. Furthermore, it provided information regarding evaluation of the controller: whether the prosthetic leg generated normal gait. In conclusion, the proposed gait phase prediction model will facilitate efficient gait prediction and evaluation of controllers for powered lower-limb assistive devices.
| S-EPMC9849563 | biostudies-literature