Quantitative reproducibility analysis for identifying reproducible targets from high-throughput experiments.
Ontology highlight
ABSTRACT:
SUBMITTER: Zhang W
PROVIDER: S-EPMC5553769 | biostudies-other | 2017 Aug
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Ensuring reproducibility of results in high-throughput experiments is crucial for biomedical research. Here, we propose a set of computational methods, INTRIGUE, to evaluate and control reproducibility in high-throughput settings. Our approaches are built on a new definition of reproducibility that emphasizes directional consistency when experimental units are assessed with signed effect size estimates. The proposed methods are designed to (1) assess the overall reproducible quality of multiple studies and (2) evaluate reproducibility at the individual experimental unit levels. We demonstrate the proposed methods in detecting unobserved batch effects via simulations. We further illustrate the versatility of the proposed methods in transcriptome-wide association studies: in addition to reproducible quality control, they are also suited to investigating genuine biological heterogeneity. Finally, we discuss the potential extensions of the proposed methods in other vital areas of reproducible research (for example, publication bias and conceptual replications).
| S-EPMC8240032 | biostudies-literature
Project description:High-throughput experiments are an essential part of modern biological and biomedical research. The outcomes of high-throughput biological experiments often have a lot of missing observations due to signals below detection levels. For example, most single-cell RNA-seq (scRNA-seq) protocols experience high levels of dropout due to the small amount of starting material, leading to a majority of reported expression levels being zero. Though missing data contain information about reproducibility, they are often excluded in the reproducibility assessment, potentially generating misleading assessments. In this article, we develop a regression model to assess how the reproducibility of high-throughput experiments is affected by the choices of operational factors (eg, platform or sequencing depth) when a large number of measurements are missing. Using a latent variable approach, we extend correspondence curve regression, a recently proposed method for assessing the effects of operational factors to reproducibility, to incorporate missing values. Using simulations, we show that our method is more accurate in detecting differences in reproducibility than existing measures of reproducibility. We illustrate the usefulness of our method using a single-cell RNA-seq dataset collected on HCT116 cells. We compare the reproducibility of different library preparation platforms and study the effect of sequencing depth on reproducibility, thereby determining the cost-effective sequencing depth that is required to achieve sufficient reproducibility.
| S-EPMC9039958 | biostudies-literature
Project description:The outcome of high-throughput biological experiments is affected by many operational factors in the experimental and data-analytical procedures. Understanding how these factors affect the reproducibility of the outcome is critical for establishing workflows that produce replicable discoveries. In this article, we propose a regression framework, based on a novel cumulative link model, to assess the covariate effects of operational factors on the reproducibility of findings from high-throughput experiments. In contrast to existing graphical approaches, our method allows one to succinctly characterize the simultaneous and independent effects of covariates on reproducibility and to compare reproducibility while controlling for potential confounding variables. We also establish a connection between our model and certain Archimedean copula models. This connection not only offers our regression framework an interpretation in copula models, but also provides guidance on choosing the functional forms of the regression. Furthermore, it also opens a new way to interpret and utilize these copulas in the context of reproducibility. Using simulations, we show that our method produces calibrated type I error and is more powerful in detecting difference in reproducibility than existing measures of agreement. We illustrate the usefulness of our method using a ChIP-seq study and a microarray study.
| S-EPMC5975112 | biostudies-literature
Project description:Western blotting experiments were initially performed to detect a target protein in a complex biological sample and more recently, to measure relative protein abundance. Chemiluminescence coupled with film-based detection was traditionally the gold standard for western blotting but accurate and reproducible quantification has been a major challenge from this methodology. The development of sensitive, camera-based detection technologies coupled with an updated technical approach permits the production of reproducible, quantitative data. Fluorescence reagent and detection solutions are the latest innovation in western blotting but there remains questions and debate concerning their relative sensitivity and dynamic range versus chemiluminescence. A methodology to optimize and produce excellent, quantitative western blot results with rigorous data analysis from membranes probed with both fluorescent and chemiluminescent antibodies is described. The data reveal when and how to apply these detection methods to achieve reproducible data with a stepwise approach to data processing for quantitative analysis.
| S-EPMC9585080 | biostudies-literature
Project description:A common goal of microarray and related high-throughput genomic experiments is to identify genes that vary across biological condition. Most often this is accomplished by identifying genes with changes in mean expression level, so called differentially expressed (DE) genes, and a number of effective methods for identifying DE genes have been developed. Although useful, these approaches do not accommodate other types of differential regulation. An important example concerns differential coexpression (DC). Investigations of this class of genes are hampered by the large cardinality of the space to be interrogated as well as by influential outliers. As a result, existing DC approaches are often underpowered, exceedingly prone to false discoveries, and/or computationally intractable for even a moderately large number of pairs. To address this, an empirical Bayesian approach for identifying DC gene pairs is developed. The approach provides a false discovery rate controlled list of significant DC gene pairs without sacrificing power. It is applicable within a single study as well as across multiple studies. Computations are greatly facilitated by a modification to the expectation-maximization algorithm and a procedural heuristic. Simulations suggest that the proposed approach outperforms existing methods in far less computational time; and case study results suggest that the approach will likely prove to be a useful complement to current DE methods in high-throughput genomic studies.
| S-EPMC3482945 | biostudies-literature
Project description:SummaryMass spectrometry-based proteomics has had a formidable development in recent years, increasing the amount of data handled and the complexity of the statistical resources needed. Here we present SanXoT, an open-source, standalone software package for the statistical analysis of high-throughput, quantitative proteomics experiments. SanXoT is based on our previously developed weighted spectrum, peptide and protein statistical model and has been specifically designed to be modular, scalable and user-configurable. SanXoT allows limitless workflows that adapt to most experimental setups, including quantitative protein analysis in multiple experiments, systems biology, quantification of post-translational modifications and comparison and merging of experimental data from technical or biological replicates.Availability and implementationDownload links for the SanXoT Software Package, source code and documentation are available at https://wikis.cnic.es/proteomica/index.php/SSP.Contactjvazquez@cnic.es or ebonzon@cnic.es.Supplementary informationSupplementary information is available at Bioinformatics online.
| S-EPMC6499250 | biostudies-literature
Project description:Quantitative high-throughput screening (qHTS) experiments can simultaneously produce concentration-response profiles for thousands of chemicals. In a typical qHTS study, a large chemical library is subjected to a primary screen to identify candidate hits for secondary screening, validation studies, or prediction modeling. Different algorithms, usually based on the Hill equation logistic model, have been used to classify compounds as active or inactive (or inconclusive). However, observed concentration-response activity relationships may not adequately fit a sigmoidal curve. Furthermore, it is unclear how to prioritize chemicals for follow-up studies given the large uncertainties that often accompany parameter estimates from nonlinear models. Weighted Shannon entropy can address these concerns by ranking compounds according to profile-specific statistics derived from estimates of the probability mass distribution of response at the tested concentration levels. This strategy can be used to rank all tested chemicals in the absence of a prespecified model structure, or the approach can complement existing activity call algorithms by ranking the returned candidate hits. The weighted entropy approach was evaluated here using data simulated from the Hill equation model. The procedure was then applied to a chemical genomics profiling data set interrogating compounds for androgen receptor agonist activity.
| S-EPMC4029130 | biostudies-literature
Project description:BackgroundOwing to increased spending on pharmaceuticals since 2010, discussions about rising costs for the development of new medical technologies have been focused on the pharmaceutical industry. Computational techniques have been developed to reduce costs associated with new drug development. Among these techniques, virtual high-throughput screening (vHTS) can contribute to the drug discovery process by providing tools to search for new drugs with the ability to bind a specific molecular target.ObjectivesIn this context, Brazilian malaria molecular targets (BraMMT) was generated to execute vHTS experiments on selected molecular targets of Plasmodium falciparum.MethodsIn this study, 35 molecular targets of P. falciparum were built and evaluated against known antimalarial compounds.FindingsAs a result, it could predict the correct molecular target of market drugs, such as artemisinin. In addition, our findings suggested a new pharmacological mechanism for quinine, which includes inhibition of falcipain-II and a potential new antimalarial candidate, clioquinol.Main conclusionsThe BraMMT is available to perform vHTS experiments using OCTOPUS or Raccoon software to improve the search for new antimalarial compounds. It can be retrieved from www.drugdiscovery.com.br or download of Supplementary data.
| S-EPMC6388387 | biostudies-literature
Project description:RationaleThe implementation of mass spectrometry (MS)-based metabolomics is advancing many areas of biomedical research. The time associated with traditional chromatographic methods for resolving metabolites prior to mass analysis has limited the potential to perform large-scale, highly powered metabolomics studies and clinical applications.MethodsHere we describe a three-minute method for the rapid profiling of central metabolic pathways through UHPLC/MS, tracing experiments in vitro and in vivo, and targeted quantification of compounds of interest using spiked in heavy labeled standards.ResultsThis method has shown to be linear, reproducible, selective, sensitive, and robust for the semi-targeted analysis of central carbon and nitrogen metabolism. Isotopically labeled internal standards are used for absolute quantitation of steady-state metabolite levels and de novo synthesized metabolites in tracing studies. We further propose exploratory applications to biofluids, cell and tissue extracts derived from relevant biomedical/clinical samples.ConclusionsWhile limited to the analysis of central carbon and nitrogen metabolism, this method enables the analysis of hundreds of samples per day derived from diverse biological matrices. This approach makes it possible to analyze samples from large patient populations for translational research, personalized medicine, and clinical metabolomics applications. Copyright © 2017 John Wiley & Sons, Ltd.
| S-EPMC5364945 | biostudies-literature
Project description:Filter aided sample preparation (FASP) is becoming a central method for proteomic sample cleanup and peptide generation prior to LC-MS analysis. We previously adapted this method to a 96-well filter plate, and applied to prepare protein digests from cell lysate and body fluid samples in a high throughput quantitative manner. While the 96FASP approach is scalable and can handle multiple samples simultaneously, two key advantages compared to single FASP, it is also time-consuming. The centrifugation-based liquid transfer on the filter plate takes 3-5 times longer than single filter. To address this limitation, we now present a quick 96FASP (named q96FASP) approach that, relying on the use of filter membranes with a large MWCO size (~30kDa), significantly reduces centrifugal times. We show that q96FASP allows the generation of protein digests derived from whole cell lysates and body fluids in a quality similar to that of the single FASP method. Processing a sample in multiple wells in parallel, we observed excellent experimental repeatability by label-free quantitation approach. We conclude that the q96FASP approach promises to be a promising cost- and time-effective method for shotgun proteomics and will be particularly useful in large scale biomarker discovery studies.SignificanceHigh throughput sample processing is of particular interests for quantitative proteomics. The previously developed 96FASP is high throughput and appealing, however it is time-consuming in the context of centrifugation-based liquid transfer (~1.5h per spin). This study presents a truly high throughput sample preparation method based on large cut-off 96-well filter plate, which shortens the spin time to ~20min. To our knowledge, this is the first multi-well method that is entirely comparable with conventional FASP. This study thoroughly examined two types of filter plates and performed side-by-side comparisons with single FASP. Two types of samples, whole cell lysate of a UTI (urinary tract infection)-associated Klebsiella pneumoniae cell and human urine, were tested which demonstrated its capability for quantitative proteomics. The q96FSAP approach makes the filter plate-based approach more appealing for protein biomarker discovery projects, and could be broadly applied to large scale proteomics analysis.
| S-EPMC6029622 | biostudies-literature