RSim: A reference-based normalization method via rank similarity.
Ontology highlight
ABSTRACT:
SUBMITTER: Yuan B
PROVIDER: S-EPMC10501661 | biostudies-literature | 2023 Sep
REPOSITORIES: biostudies-literature
Publications
RSim: A reference-based normalization method via rank similarity.
PLoS computational biology 20230901 9
Microbiome sequencing data normalization is crucial for eliminating technical bias and ensuring accurate downstream analysis. However, this process can be challenging due to the high frequency of zero counts in microbiome data. We propose a novel reference-based normalization method called normalization via rank similarity (RSim) that corrects sample-specific biases, even in the presence of many zero counts. Unlike other normalization methods, RSim does not require additional assumptions or trea ...[more]
Similar Datasets
Project description:In the area of genetic epidemiology, studies of the genotype-phenotype associations have made significant contributions to human complicated trait genetics. These studies depend on specialized statistical methods for uncover the association between traits and genetic variants, both common and rare variants. Often, in analyzing such studies, potentially confounding factors, such as social and environmental conditions, are required to be involved. Multiple linear regression is the most widely used type of regression analysis when the outcome of interest is quantitative traits. Many statistical tests for identifying genotype-phenotype associations using linear regression rely on the assumption that the traits (or the residuals) of the regression follow a normal distribution. In genomic research, the rank-based inverse normal transformation (INT) is one of the most popular approaches to reach normally distributed traits (or normally distributed residuals). Many researchers believe that applying the INT to the non-normality of the traits (or the non-normality of the residuals) is required for valid inference, because the phenotypic (or residual) outliers and non-normality have the significant influence on both the type I error rate control and statistical power, especially under the situation in rare-variant association testing procedures. Here we propose a test for exploring the association of the rare variant with the quantitative trait by using a fully adjusted full-stage INT. Using simulations we show that the fully adjusted full-stage INT is more appropriate than the existing INT methods, such as the fully adjusted two-stage INT and the INT-based omnibus test, in testing genotype-phenotype associations with rare variants, especially when genotypes are uncorrelated with covariates. The fully adjusted full-stage INT retains the advantages of the fully adjusted two-stage INT and ameliorates the problems of the fully adjusted two-stage INT for analysis of rare variants under non-normality of the trait. We also present theoretical results on these desirable properties. In addition, the two available methods with non-normal traits, the quantile/median regression method and the Yeo-Johnson power transformation, are also included in simulations for comparison with these desirable properties.
| S-EPMC7304615 | biostudies-literature
Project description:Purpose: Description of a spike-adjusting-method (SAM) to normalize ChIP-seq data . Methods: We performed ChIP-seq of POLR3D and POLR2B with mouse liver supplemented with 2.5% of human DNA. Human DNA will be used as an internal control for ChIP-seq quantification. Results: We show that using the SAM for ChIP-seq quantification improve similarity of POLR3D and POLR2B ChIP-seq replicates samples and improve difference between samples originate from different conditions. Conclusions: The SAM improves comparison of ChIP-seq samples, either by increasing similarity between replicates or by emphasise differences between conditions.
2014-04-02 | GSE52049 | GEO
Project description:BackgroundMany gene expression normalization algorithms exist for Affymetrix GeneChip microarrays. The most popular of these is RMA, primarily due to the precision and low noise produced during the process. A significant strength of this and similar approaches is the use of the entire set of arrays during both normalization and model-based estimation of signal. However, this leads to differing estimates of expression based on the starting set of arrays, and estimates can change when a single, additional chip is added to the set. Additionally, outlier chips can impact the signals of other arrays, and can themselves be skewed by the majority of the population.ResultsWe developed an approach, termed IRON, which uses the best-performing techniques from each of several popular processing methods while retaining the ability to incrementally renormalize data without altering previously normalized expression. This combination of approaches results in a method that performs comparably to existing approaches on artificial benchmark datasets (i.e. spike-in) and demonstrates promising improvements in segregating true signals within biologically complex experiments.ConclusionsBy combining approaches from existing normalization techniques, the IRON method offers several advantages. First, IRON normalization occurs pair-wise, thereby avoiding the need for all chips to be normalized together, which can be important for large data analyses. Secondly, the technique does not require similarity in signal distribution across chips for normalization, which can be important for maintaining biologically relevant differences in a heterogeneous background. Lastly, IRON introduces fewer post-processing artifacts, particularly in data whose behavior violates common assumptions. Thus, the IRON method provides a practical solution to common needs of expression analysis. A software implementation of IRON is available at [http://gene.moffitt.org/libaffy/].
| S-EPMC3651355 | biostudies-literature
Project description:MotivationDespite the central role of diseases in biomedical research, there have been much fewer attempts to automatically determine which diseases are mentioned in a text-the task of disease name normalization (DNorm)-compared with other normalization tasks in biomedical text mining research.MethodsIn this article we introduce the first machine learning approach for DNorm, using the NCBI disease corpus and the MEDIC vocabulary, which combines MeSH® and OMIM. Our method is a high-performing and mathematically principled framework for learning similarities between mentions and concept names directly from training data. The technique is based on pairwise learning to rank, which has not previously been applied to the normalization task but has proven successful in large optimization problems for information retrieval.ResultsWe compare our method with several techniques based on lexical normalization and matching, MetaMap and Lucene. Our algorithm achieves 0.782 micro-averaged F-measure and 0.809 macro-averaged F-measure, an increase over the highest performing baseline method of 0.121 and 0.098, respectively.AvailabilityThe source code for DNorm is available at http://www.ncbi.nlm.nih.gov/CBBresearch/Lu/Demo/DNorm, along with a web-based demonstration and links to the NCBI disease corpus. Results on PubMed abstracts are available in PubTator: http://www.ncbi.nlm.nih.gov/CBBresearch/Lu/Demo/PubTator .
| S-EPMC3810844 | biostudies-literature
Project description:Purpose: Description of a spike-adjusting-method (SAM) to normalize ChIP-seq data . Methods: We performed ChIP-seq of POLR3D and POLR2B with mouse liver supplemented with 2.5% of human DNA. Human DNA will be used as an internal control for ChIP-seq quantification. Results: We show that using the SAM for ChIP-seq quantification improve similarity of POLR3D and POLR2B ChIP-seq replicates samples and improve difference between samples originate from different conditions. Conclusions: The SAM improves comparison of ChIP-seq samples, either by increasing similarity between replicates or by emphasise differences between conditions. Chromatin Immuno-precipitations were performed with antibodies directed against POLR3D (Pol III) and POLR2B (Pol II) using mouse liver material supplemented with human DNA. Immuno-precipitated DNA was next sequenced using Illumina HiSeq. Three different concentrations of human spiked DNA were tested for the Pol III ChIP (2.5%, 5% and 10%). We also sequenced the corresponding inputs (crosslinked DNA from mouse liver). Two concentrations of human spiked DNA (5% and 10%) were tested for the Pol 2 ChIP. We also sequenced the corresponding inputs (crosslinked DNA from mouse liver).
2014-04-02 | E-GEOD-52049 | biostudies-arrayexpress
Project description:BackgroundComparative DNA microarray analyses typically yield very large gene expression data sets that reflect complex patterns of change. Despite the wealth of information that is obtained, the identification of stable reference genes is required for normalization of disease- or drug-induced changes across tested groups. This is a prerequisite in quantitative real-time reverse transcription-PCR (qRT-PCR) and relative RT-PCR but rare in gene microarray analysis. The goal of the present study was to outline a simple method for identification of reliable reference genes derived from DNA microarray data sets by comparative statistical analysis of software-generated and manually calculated candidate genes.Material and methodsDNA microarray data sets derived from whole-blood samples obtained from 14 Zucker diabetic fatty (ZDF) rats (7 lean and 7 diabetic obese) were used for the method development. This involved the use of software-generated filtering parameters to accomplish the desired signal-to-noise ratios, 75th percentile signal manual normalizations, and the selection of reference genes as endogenous controls for target gene expression normalization.ResultsThe combination of software-generated and manual normalization methods yielded a group of 5 stably expressed, suitable endogenous control genes which can be used in further target gene expression determinations in whole blood of ZDF rats.ConclusionsThis method can be used to correct for potentially false results and aid in the selection of suitable endogenous control genes. It is especially useful when aimed to aid the software in cases of borderline results, where the expression and/or the fold change values are just beyond the pre-established set of acceptable parameters.
| S-EPMC4868104 | biostudies-literature
Project description:Chromatin immunoprecipitation followed by deep sequencing (ChIP-seq) experiments are widely used to determine, within entire genomes, the occupancy sites of any protein of interest, including, for example, transcription factors, RNA polymerases, or histones with or without various modifications. In addition to allowing the determination of occupancy sites within one cell type and under one condition, this method allows, in principle, the establishment and comparison of occupancy maps in various cell types, tissues, and conditions. Such comparisons require, however, that samples be normalized. Widely used normalization methods that include a quantile normalization step perform well when factor occupancy varies at a subset of sites, but may miss uniform genome-wide increases or decreases in site occupancy. We describe a spike adjustment procedure (SAP) that, unlike commonly used normalization methods intervening at the analysis stage, entails an experimental step prior to immunoprecipitation. A constant, low amount from a single batch of chromatin of a foreign genome is added to the experimental chromatin. This "spike" chromatin then serves as an internal control to which the experimental signals can be adjusted. We show that the method improves similarity between replicates and reveals biological differences including global and largely uniform changes.
| S-EPMC4079971 | biostudies-literature
Project description:RACE (Rapid Amplification of cDNA Ends) is a widely used approach for transcript identification. However, the dynamic range in the population of RACE transcript isoforms may be very large, and random clone selection -the typical approach- may be ineffective in sampling the different transcript species present in the population. Here, we describe an effective RACE sampling strategy. The products of the RACE reaction are hybridized onto high-density tiling arrays, and the exons detected are then used to delineate a series of RT-PCR reactions, through which the original RACE mixture is segregated into a number of simpler RT-PCR reactions. These are independently cloned, and randomly selected clones are sequenced. This approach is superior to the direct cloning and sequencing of the RACE products: it specifically targets novel transcripts, and often leads to the overall normalization of their abundances. We indeed show theoretically that this strategy leads to a very efficient sampling of the novel transcript species associated to annotated loci. In a pilot experiment, we used this approach to discover many novel transcripts for a few otherwise well-characterized protein coding genes. Finally we investigate how this strategy can be multiplexed for large-scale transcript discovery by high-density pooling of RACE reactions prior to hybridization. Our results indicate that through the interrogation of a limited number of exons per gene on a limited number of cell types, it is possible to recover a large fraction of the transcript diversity associated to protein coding loci. These loci, however, could be occupying a much larger genomic space than previously expected, implying that efficient multiplexing requires non-trivial pooling optimization.
2008-05-25 | GSE11433 | GEO
Project description:BackgroundHigh throughput microfluidic protocols in single cell RNA sequencing (scRNA-seq) collect mRNA counts from up to one million individual cells in a single experiment; this enables high resolution studies of rare cell types and cell development pathways. Determining small sets of genetic markers that can identify specific cell populations is thus one of the major objectives of computational analysis of mRNA counts data. Many tools have been developed for marker selection on single cell data; most of them, however, are based on complex statistical models and handle the multi-class case in an ad-hoc manner.ResultsWe introduce RANKCORR, a fast method with strong mathematical underpinnings that performs multi-class marker selection in an informed manner. RANKCORR proceeds by ranking the mRNA counts data before linearly separating the ranked data using a small number of genes. The step of ranking is intuitively natural for scRNA-seq data and provides a non-parametric method for analyzing count data. In addition, we present several performance measures for evaluating the quality of a set of markers when there is no known ground truth. Using these metrics, we compare the performance of RANKCORR to a variety of other marker selection methods on an assortment of experimental and synthetic data sets that range in size from several thousand to one million cells.ConclusionsAccording to the metrics introduced in this work, RANKCORR is consistently one of most optimal marker selection methods on scRNA-seq data. Most methods show similar overall performance, however; thus, the speed of the algorithm is the most important consideration for large data sets (and comparing the markers selected by several methods can be fruitful). RANKCORR is fast enough to easily handle the largest data sets and, as such, it is a useful tool to add into computational pipelines when dealing with high throughput scRNA-seq data. RANKCORR software is available for download at https://github.com/ahsv/RankCorr with extensive documentation.
| S-EPMC7585212 | biostudies-literature
Project description:BackgroundHematologic and biochemical analytes of Sprague-Dawley rats are commonly used to determine effects that were induced by treatment and to evaluate organ dysfunction in toxicological safety assessments, but reference intervals have not been well established for these analytes. Reference intervals as presently defined for these analytes in Sprague-Dawley rats have not used internationally recommended statistical method nor stratified by sex. Thus, we aimed to establish sex-specific reference intervals for hematologic and biochemical parameters in Sprague-Dawley rats according to Clinical and Laboratory Standards Institute C28-A3 and American Society for Veterinary Clinical Pathology guideline.MethodsHematology and biochemistry blood samples were collected from 500 healthy Sprague-Dawley rats (250 males and 250 females) in the control groups. We measured 24 hematologic analytes with the Sysmex XT-2100i analyzer, 9 biochemical analytes with the Olympus AU400 analyzer. We then determined statistically relevant sex partitions and calculated reference intervals, including corresponding 90% confidence intervals, using nonparametric rank percentile method.ResultsWe observed that most hematologic and biochemical analytes of Sprague-Dawley rats were significantly influenced by sex. Males had higher hemoglobin, hematocrit, red blood cell count, red cell distribution width, mean corpuscular volume, mean corpuscular hemoglobin, white blood cell count, neutrophils, lymphocytes, monocytes, percentage of neutrophils, percentage of monocytes, alanine aminotransferase, aspartate aminotransferase, and triglycerides compared to females. Females had higher mean corpuscular hemoglobin concentration, plateletcrit, platelet count, eosinophils, percentage of lymphocytes, percentage of eosinophils, creatinine, glucose, total cholesterol and urea compared to males. Sex partition was required for most hematologic and biochemical analytes in Sprague-Dawley rats. We established sex-specific reference intervals, including corresponding 90% confidence intervals, for Sprague-Dawley rats.ConclusionsUnderstanding the significant discrepancies in hematologic and biochemical analytes between male and female Sprague-Dawley rats provides important insight into physiological effects in test rats. Establishment of locally sex-specific reference intervals allows a more precise evaluation of animal quality and experimental results of Sprague-Dawley rats in our toxicology safety assessment.
| S-EPMC5738108 | biostudies-literature