Benchmark data for identifying multi-functional types of membrane proteins.
Ontology highlight
ABSTRACT:
SUBMITTER: Wan S
PROVIDER: S-EPMC4889873 | biostudies-other | 2016 Sep
REPOSITORIES: biostudies-other
Publications
Benchmark data for identifying multi-functional types of membrane proteins.
Wan Shibiao S Mak Man-Wai MW Kung Sun-Yuan SY
Data in brief 20160521
Identifying membrane proteins and their multi-functional types is an indispensable yet challenging topic in proteomics and bioinformatics. In this article, we provide data that are used for training and testing Mem-ADSVM (Wan et al., 2016. "Mem-ADSVM: a two-layer multi-label predictor for identifying multi-functional types of membrane proteins" [1]), a two-layer multi-label predictor for predicting multi-functional types of membrane proteins. ...[more]
Similar Datasets
Project description:BackgroundPredictive modeling based on multi-omics data, which incorporates several types of omics data for the same patients, has shown potential to outperform single-omics predictive modeling. Most research in this domain focuses on incorporating numerous data types, despite the complexity and cost of acquiring them. The prevailing assumption is that increasing the number of data types necessarily improves predictive performance. However, the integration of less informative or redundant data types could potentially hinder this performance. Therefore, identifying the most effective combinations of omics data types that enhance predictive performance is critical for cost-effective and accurate predictions.MethodsIn this study, we systematically evaluated the predictive performance of all 31 possible combinations including at least one of five genomic data types (mRNA, miRNA, methylation, DNAseq, and copy number variation) using 14 cancer datasets with right-censored survival outcomes, publicly available from the TCGA database. We employed various prediction methods and up-weighted clinical data in every model to leverage their predictive importance. Harrell's C-index and the integrated Brier Score were used as performance measures. To assess the robustness of our findings, we performed a bootstrap analysis at the level of the included datasets. Statistical testing was conducted for key results, limiting the number of tests to ensure a low risk of false positives.ResultsContrary to expectations, we found that using only mRNA data or a combination of mRNA and miRNA data was sufficient for most cancer types. For some cancer types, the additional inclusion of methylation data led to improved prediction results. Far from enhancing performance, the introduction of more data types most often resulted in a decline in performance, which varied between the two performance measures.ConclusionsOur findings challenge the prevailing notion that combining multiple omics data types in multi-omics survival prediction improves predictive performance. Thus, the widespread approach in multi-omics prediction of incorporating as many data types as possible should be reconsidered to avoid suboptimal prediction results and unnecessary expenditure.
| S-EPMC11370316 | biostudies-literature
Project description:This data article contains three benchmark datasets for training and testing iDNA-Methyl, a web-server predictor for identifying DNA methylation sites [Liu et al. Anal. Biochem. 474 (2015) 69-79].
| S-EPMC4510404 | biostudies-literature
Project description:BackgroundHelical membrane proteins are vital for the interaction of cells with their environment. Predicting the location of membrane helices in protein amino acid sequences provides substantial understanding of their structure and function and identifies membrane proteins in sequenced genomes. Currently there is no comprehensive benchmark tool for evaluating prediction methods, and there is no publication comparing all available prediction tools. Current benchmark literature is outdated, as recently determined membrane protein structures are not included. Current literature is also limited to global assessments, as specialised benchmarks for predicting specific classes of membrane proteins were not previously carried out.DescriptionWe present a benchmark server at http://sydney.edu.au/pharmacy/sbio/software/TMH_benchmark.shtml that uses recent high resolution protein structural data to provide a comprehensive assessment of the accuracy of existing membrane helix prediction methods. The server further allows a user to compare uploaded predictions generated by novel methods, permitting the comparison of these novel methods against all existing methods compared by the server. Benchmark metrics include sensitivity and specificity of predictions for membrane helix location and orientation, and many others. The server allows for customised evaluations such as assessing prediction method performances for specific helical membrane protein subtypes.We report results for custom benchmarks which illustrate how the server may be used for specialised benchmarks. Which prediction method is the best performing method depends on which measure is being benchmarked. The OCTOPUS membrane helix prediction method is consistently one of the highest performing methods across all measures in the benchmarks that we performed.ConclusionsThe benchmark server allows general and specialised assessment of existing and novel membrane helix prediction methods. Users can employ this benchmark server to determine the most suitable method for the type of prediction the user needs to perform, be it general whole-genome annotation or the prediction of specific types of helical membrane protein. Creators of novel prediction methods can use this benchmark server to evaluate the performance of their new methods. The benchmark server will be a valuable tool for researchers seeking to extract more sophisticated information from the large and growing protein sequence databases.
| S-EPMC3620685 | biostudies-literature
Project description:Background In the last few years, multi-omics data, that is, datasets containing different types of high-dimensional molecular variables for the same samples, have become increasingly available. To date, several comparison studies focused on feature selection methods for omics data, but to our knowledge, none compared these methods for the special case of multi-omics data. Given that these data have specific structures that differentiate them from single-omics data, it is unclear whether different feature selection strategies may be optimal for such data. In this paper, using 15 cancer multi-omics datasets we compared four filter methods, two embedded methods, and two wrapper methods with respect to their performance in the prediction of a binary outcome in several situations that may affect the prediction results. As classifiers, we used support vector machines and random forests. The methods were compared using repeated fivefold cross-validation. The accuracy, the AUC, and the Brier score served as performance metrics. Results The results suggested that, first, the chosen number of selected features affects the predictive performance for many feature selection methods but not all. Second, whether the features were selected by data type or from all data types concurrently did not considerably affect the predictive performance, but for some methods, concurrent selection took more time. Third, regardless of which performance measure was considered, the feature selection methods mRMR, the permutation importance of random forests, and the Lasso tended to outperform the other considered methods. Here, mRMR and the permutation importance of random forests already delivered strong predictive performance when considering only a few selected features. Finally, the wrapper methods were computationally much more expensive than the filter and embedded methods. Conclusions We recommend the permutation importance of random forests and the filter method mRMR for feature selection using multi-omics data, where, however, mRMR is considerably more computationally costly. Supplementary Information The online version contains supplementary material available at 10.1186/s12859-022-04962-x.
| S-EPMC9533501 | biostudies-literature
Project description:This data article contains the benchmark dataset for training and testing iRNA-Methyl, a web-server predictor for identifying N(6)-methyladenosine sites in RNA (Chen et al., 2015 [15]). It can also be used to develop other predictors for identifying N(6)-methyladenosine sites in the Saccharomyces cerevisiae genome.
| S-EPMC4773366 | biostudies-literature
Project description:Multi-omics data, that is, datasets containing different types of high-dimensional molecular variables, are increasingly often generated for the investigation of various diseases. Nevertheless, questions remain regarding the usefulness of multi-omics data for the prediction of disease outcomes such as survival time. It is also unclear which methods are most appropriate to derive such prediction models. We aim to give some answers to these questions through a large-scale benchmark study using real data. Different prediction methods from machine learning and statistics were applied on 18 multi-omics cancer datasets (35 to 1000 observations, up to 100 000 variables) from the database 'The Cancer Genome Atlas' (TCGA). The considered outcome was the (censored) survival time. Eleven methods based on boosting, penalized regression and random forest were compared, comprising both methods that do and that do not take the group structure of the omics variables into account. The Kaplan-Meier estimate and a Cox model using only clinical variables were used as reference methods. The methods were compared using several repetitions of 5-fold cross-validation. Uno's C-index and the integrated Brier score served as performance metrics. The results indicate that methods taking into account the multi-omics structure have a slightly better prediction performance. Taking this structure into account can protect the predictive information in low-dimensional groups-especially clinical variables-from not being exploited during prediction. Moreover, only the block forest method outperformed the Cox model on average, and only slightly. This indicates, as a by-product of our study, that in the considered TCGA studies the utility of multi-omics data for prediction purposes was limited. Contact:moritz.herrmann@stat.uni-muenchen.de, +49 89 2180 3198 Supplementary information: Supplementary data are available at Briefings in Bioinformatics online. All analyses are reproducible using R code freely available on Github.
| S-EPMC8138887 | biostudies-literature
Project description:Cellular senescence plays critical roles in aging, regeneration, and disease, yet the ability to discern its contributions across various cell types to pathophysiological processes in vivo remains limited. In this study, we generated an in vivotoolbox, consisting of three p16INK4a-related intersectional genetic systems, enabling pulse- chase tracing (Sn-pTracer), Cre-based tracing and ablation (Sn-cTracer), and gene manipulation combined with tracing (Sn-gTracer) of defined senescent cell types. Using liver injury and repair as an example, we found that macrophages and endothelial cells (ECs) represent distinct senescent cell populations with different fates and functions during liver fibrosis and repair.Targeted reprogramming of p16INK4a+ ECs through Kdr overexpression markedly reduces liver fibrosis. This study illuminates the pathophysiological diversity of senescent cells and offers valuable insights for the development of future cell type-specific senolytic therapies. Furthermore, our model provides a versatile platform for investigating cellular senescence in any desired cell type.
2024-07-12 | GSE271670 | GEO
Project description:The accumulation of somatic driver mutations in the human genome enables cells to gradually acquire a growth advantage and contributes to tumor development. Great efforts on protein-coding cancer drivers have yielded fruitful discoveries and clinical applications. However, investigations on cancer drivers in non-coding regions, especially long non-coding RNAs (lncRNAs), are extremely scarce due to the limitation of functional understanding. Thus, to identify driver lncRNAs integrating multi-omics data in human cancers, we proposed a computational framework, DriverLncNet, which dissected the functional impact of somatic copy number alteration (CNA) of lncRNAs on regulatory networks and captured key functional effectors in dys-regulatory networks. Applying it to 5 cancer types from The Cancer Genome Atlas (TCGA), we portrayed the landscape of 117 driver lncRNAs and revealed their associated cancer hallmarks through their functional effectors. Moreover, lncRNA RP11-571M6.8 was detected to be highly associated with immunotherapeutic targets (PD-1, PD-L1, and CTLA-4) and regulatory T cell infiltration level and their markers (IL2RA and FCGR2B) in glioblastoma multiforme, highlighting its immunosuppressive function. Meanwhile, a high expression of RP11-1020A11.1 in bladder carcinoma was predictive of poor survival independent of clinical characteristics, and CTD-2256P15.2 in lung adenocarcinoma responded to the sensitivity of methyl ethyl ketone (MEK) inhibitors. In summary, this study provided a framework to decipher the mechanisms of tumorigenesis from driver lncRNA level, established a new landscape of driver lncRNAs in human cancers, and offered potential clinical implications for precision oncology.
| S-EPMC6626872 | biostudies-literature
Project description:A major goal of computational neuroscience is to build accurate models of the activity of neurons that can be used to interpret their function in circuits. Here, we explore using functional cell types to refine single-cell models by grouping them into functionally relevant classes. Formally, we define a hierarchical generative model for cell types, single-cell parameters, and neural responses, and then derive an expectation-maximization algorithm with variational inference that maximizes the likelihood of the neural recordings. We apply this "simultaneous" method to estimate cell types and fit single-cell models from simulated data, and find that it accurately recovers the ground truth parameters. We then apply our approach to in vitro neural recordings from neurons in mouse primary visual cortex, and find that it yields improved prediction of single-cell activity. We demonstrate that the discovered cell-type clusters are well separated and generalizable, and thus amenable to interpretation. We then compare discovered cluster memberships with locational, morphological, and transcriptomic data. Our findings reveal the potential to improve models of neural responses by explicitly allowing for shared functional properties across neurons.
| S-EPMC10569560 | biostudies-literature
Project description: Not available
| EMPIAR-10491 | biostudies-other