A leave-one-out cross-validation SAS macro for the identification of markers associated with survival.
Ontology highlight
ABSTRACT:
SUBMITTER: Rushing C
PROVIDER: S-EPMC4306627 | biostudies-literature | 2015 Feb
REPOSITORIES: biostudies-literature
Publications
A leave-one-out cross-validation SAS macro for the identification of markers associated with survival.
Rushing Christel C Bulusu Anuradha A Hurwitz Herbert I HI Nixon Andrew B AB Pang Herbert H
Computers in biology and medicine 20141209
A proper internal validation is necessary for the development of a reliable and reproducible prognostic model for external validation. Variable selection is an important step for building prognostic models. However, not many existing approaches couple the ability to specify the number of covariates in the model with a cross-validation algorithm. We describe a user-friendly SAS macro that implements a score selection method and a leave-one-out cross-validation approach. We discuss the method and ...[more]
Similar Datasets
Project description:IntroductionEnteric dysbacteriosis is strongly associated with nonalcoholic fatty liver disease (NAFLD). However, the underlying causal relationship remains unknown. Thus, the present study aimed to investigate the relationship between gut microbiota and NAFLD using Mendelian randomization (MR) and analyze the target genes potentially regulated by specific microbiota.MethodsBidirectional two-sample MR analysis was performed using inverse variance weighted (IVW) supplemented by MR-Egger, weighted median, simple mode, and weighted mode methods. Data were pooled from gut microbiota and NAFLD association studies. The least absolute shrinkage, selection operator regression, and the Support Vector Machine algorithm were used to identify genes regulated by these intestinal flora in NAFLD. The liver expression of these genes was verified in methionine choline-deficient (MCD) diet-fed mice.ResultsIVW results confirmed a causal relationship between eight specific gut microbes and NAFLD. Notably, the order Actinomycetales, NB1n, the family Actinomycetaceae, Oxalobacteraceae and the genus Ruminococcaceae UCG005 were positively correlated, whereas Lactobacillaceae, the Christensenellaceae R7 group, and Intestinibacter were negatively correlated with NAFLD onset. In NAFLD, these eight bacteria regulated four genes: colony-stimulating factor 2 receptor β, fucosyltransferase 2, 17-beta-hydroxysteroid dehydrogenase 14, and microtubule affinity regulatory kinase 3 (MAPK3). All genes, except MARK3, were differentially expressed in the liver tissues of MCD diet-fed mice.DiscussionThe abundance of eight gut microbiota species and NAFLD progression displayed a causal relationship based on the expression of the four target genes. Our findings contributed to the advancement of intestinal microecology-based diagnostic technologies and targeted therapies for NAFLD.
| S-EPMC10801729 | biostudies-literature
Project description:Receiver operating characteristic analysis is widely used for evaluating diagnostic systems. Recent studies have shown that estimating an area under receiver operating characteristic curve with standard cross-validation methods suffers from a large bias. The leave-pair-out cross-validation has been shown to correct this bias. However, while leave-pair-out produces an almost unbiased estimate of area under receiver operating characteristic curve, it does not provide a ranking of the data needed for plotting and analyzing the receiver operating characteristic curve. In this study, we propose a new method called tournament leave-pair-out cross-validation. This method extends leave-pair-out by creating a tournament from pair comparisons to produce a ranking for the data. Tournament leave-pair-out preserves the advantage of leave-pair-out for estimating area under receiver operating characteristic curve, while it also allows performing receiver operating characteristic analyses. We have shown using both synthetic and real-world data that tournament leave-pair-out is as reliable as leave-pair-out for area under receiver operating characteristic curve estimation and confirmed the bias in leave-one-out cross-validation on low-dimensional data. As a case study on receiver operating characteristic analysis, we also evaluate how reliably sensitivity and specificity can be estimated from tournament leave-pair-out receiver operating characteristic curves.
| S-EPMC6745617 | biostudies-literature
Project description:Herein, we propose a new deep neural network model based on invariant information clustering (IIC), proposed by Ji et al., to improve the modeling performance of the leave-one-site-out cross-validation (LOSO-CV) for a multi-source dataset. Our Extended IIC (EIIC) is a type of contrastive learning; however, unlike the original IIC, it is characterized by transfer learning with labeled data pairs, but without the need for a data augmentation technique. Each site in LOSO-CV is left out in turn from the remaining sites used for training and receives a value for modeling evaluation. We applied the EIIC to the resting state functional connectivity magnetic resonance imaging dataset of the Autism Brain Imaging Data Exchange. The challenging nature of brain analysis for autism spectrum disorder (ASD) can be attributed to the variability of subjects, particularly the rapid change in the neural system of children as the target ASD age group. However, EIIC demonstrated higher LOSO-CV classification accuracy for the majority of scanning locations than previously used methods. Particularly, with the adjustment of a mini-batch size, EIIC outperformed other classifiers with an accuracy >0.8 for the sites with highest mean age of the subjects. Considering its effectiveness, our proposed method might be promising for harmonization in other domains, owing to its simplicity and intrinsic flexibility.
| S-EPMC8671136 | biostudies-literature
Project description:Leave-one-out green fluorescent protein (LOOn-GFP) is a circularly permuted and truncated GFP lacking the nth ?-strand element. LOO7-GFP derived from the wild-type sequence (LOO7-WT) folds and reconstitutes fluorescence upon addition of ?-strand 7 (S7) as an exogenous peptide. Computational protein design may be used to modify the sequence of LOO7-GFP to fit a different peptide sequence, while retaining the reconstitution activity. Here we present a computationally designed leave-one-out GFP in which wild-type strand 7 has been replaced by a 12-residue peptide (HA) from the H5 antigenic region of the Thailand strain of H5N1 influenza virus hemagglutinin. The DEEdesign software was used to generate a sequence library with mutations at 13 positions around the peptide, coding for approximately 3 × 10(5) sequence combinations. The library was coexpressed with the HA peptide in E. coli and colonies were screened for in vivo fluorescence. Glowing colonies were sequenced, and one (LOO7-HA4) with 7 mutations was purified and characterized. LOO7-HA4 folds, fluoresces in vivo and in vitro, and binds HA. However, binding results in a decrease in fluorescence instead of the expected increase, caused by the peptide-induced dissociation of a novel, glowing oligomeric complex instead of the reconstitution of the native structure. Efforts to improve binding and recover reconstitution using in vitro evolution produced colonies that glowed brighter and matured faster. Two of these were characterized. One lost all affinity for the HA peptide but glowed more brightly in the unbound oligomeric state. The other increased in affinity to the HA peptide but still did not reconstitute the fully folded state. Despite failing to fold completely, peptide binding by computational design was observed and was improved by directed evolution. The ratio of HA to S7 binding increased from 0.0 for the wild-type sequence (no binding) to 0.01 after computational design (weak binding) and to 0.48 (comparable binding) after in vitro evolution. The novel oligomeric state is composed of an open barrel.
| S-EPMC4939794 | biostudies-literature
Project description:The discrete data structure and large sequencing depth of RNA sequencing (RNA-seq) experiments can often generate outlier read counts in one or more RNA samples within a homogeneous group. Thus, how to identify and manage outlier observations in RNA-seq data is an emerging topic of interest. One of the main objectives in these research efforts is to develop statistical methodology that effectively balances the impact of outlier observations and achieves maximal power for statistical testing. To reach that goal, strengthening the accuracy of outlier detection is an important precursor. Current outlier detection algorithms for RNA-seq data are executed within a testing framework and may be sensitive to sparse data and heavy-tailed distributions. Therefore, we propose a univariate algorithm that utilizes a probabilistic approach to measure the deviation between an observation and the distribution generating the remaining data and implement it within in an iterative leave-one-out design strategy. Analyses of real and simulated RNA-seq data show that the proposed methodology has higher outlier detection rates for both non-normalized and normalized negative binomial distributed data.
| S-EPMC4454687 | biostudies-literature
Project description:There are several statistical programmes to compute direct adjusted survival estimates from results of the Cox proportional hazards model. However, when used to analyze observational databases with large sample sizes or highly stratified treatment groups such as in registry-related datasets, these programmes are inefficient or unable to generate confidence bands and simultaneous p values. Also, these programmes do not consider potential left-truncation in retrospectively collected data. To address these deficiencies we developed a new SAS macro %adjsurvlt() able to produce direct adjusted survival estimates based on a stratified Cox model. The macro has improved computational performance and is able to handle left-truncated and right-censored time-to-event data. Several mechanisms were implemented to improve computational efficiency including choosing matrix operations over do-loops and reducing dimensions of co-variate matrices. Compared to the latest SAS macro, %adjsurvlt() used < 0.1% computational time to process a dataset with 100 treatment cohorts and a sample size of 20,000 and showed similar computational efficiency when analyzing left-truncated and right-censored data. We illustrate use of %adjsurvlt() to compare retrospectively collected survival data of 2 transplant cohorts.
| S-EPMC9396933 | biostudies-literature
Project description:Summarystatistics from a meta-analysis of genome-wide association studies (meta-GWAS) can be used for many follow-up analyses. One valuable application is the creation of polygenic scores. However, if polygenic scores are calculated in a validation cohort that was part of the meta-GWAS consortium, this cohort is not independent and analyses will therefore yield inflated results. The R package 'MetaSubtract' was developed to subtract the results of the validation cohort from meta-GWAS summary statistics analytically. The statistical formulas for a meta-analysis were inverted to compute corrected summary statistics of a meta-GWAS leaving one (or more) cohort(s) out. These formulas have been implemented in MetaSubtract for different meta-analyses methods (fixed effects inverse variance or square root sample size weighted z-score) accounting for no, single or double genomic control correction. Results obtained by MetaSubtract correlate very well to those calculated using the traditional way, i.e. by performing a meta-analysis leaving out the validation cohort. In conclusion, MetaSubtract allows researchers to compute meta-GWAS summary statistics that are independent of the GWAS results of the validation cohort without requiring access to the cohort level GWAS results of the corresponding meta-GWAS consortium.Availability and implementationhttps://cran.r-project.org/web/packages/MetaSubtract.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC7750933 | biostudies-literature
Project description:BackgroundSaTScan is a software program written to implement the scan statistic; it can be used to find clusters in space and/or time. It must often be run multiple times per day when doing disease surveillance. Running SaTScan frequently via its graphical user interface can be cumbersome, and the output can be difficult to visualize.ResultsThe SaTScan Macro Accessory for Cartography (SMAC) package consists of four SAS macros and was designed as an easier way to run SaTScan multiple times and add graphical output. The package contains individual macros which allow the user to make the necessary input files for SaTScan, run SaTScan, and create graphical output all from within SAS software. The macros can also be combined to do this all in one step.ConclusionThe SMAC package can make SaTScan easier to use and can make the output more informative.
| S-EPMC1821006 | biostudies-literature
Project description:Background:Any empirical data can be approximated to one of Pearson distributions using the first four moments of the data (Elderton WP, Johnson NL. Systems of Frequency Curves. 1969; Pearson K. Philos Trans R Soc Lond Ser A. 186:343-414 1895; Solomon H, Stephens MA. J Am Stat Assoc. 73(361):153-60 1978). Thus, Pearson distributions made statistical analysis possible for data with unknown distributions. There are both extant, old-fashioned in-print tables (Pearson ES, Hartley HO. Biometrika Tables for Statisticians, vol. II. 1972) and contemporary computer programs (Amos DE, Daniel SL. Tables of percentage points of standardized pearson distributions. 1971; Bouver H, Bargmann RE. Tables of the standardized percentage points of the pearson system of curves in terms of β 1 and β 2. 1974; Bowman KO, Shenton LR. Biometrika. 66(1):147-51 1979; Davis CS, Stephens MA. Appl Stat. 32(3):322-7 1983; Pan W. J Stat Softw. 31(Code Snippet 2):1-6 2009) available for obtaining percentage points of Pearson distributions corresponding to certain pre-specified percentages (or probability values; e.g., 1.0%, 2.5%, 5.0%, etc.), but they are little useful in statistical analysis because we have to rely on unwieldy second difference interpolation to calculate a probability value of a Pearson distribution corresponding to a given percentage point, such as an observed test statistic in hypothesis testing. Results:The present study develops a SAS/IML macro program to identify the appropriate type of Pearson distribution based on either input of dataset or the values of four moments and then compute and graph probability values of Pearson distributions for any given percentage points. Conclusions:The SAS macro program returns accurate approximations to Pearson distributions and can efficiently facilitate researchers to conduct statistical analysis on data with unknown distributions.
| S-EPMC6923921 | biostudies-literature
Project description:The generation of large metabolomic data sets has created a high demand for software that can fit statistical models to one-metabolite-at-a-time on hundreds of metabolites. We provide the %polynova_2way macro in SAS to identify metabolites differentially expressed in study designs with a two-way factorial treatment and hierarchical design structure. For each metabolite, the macro calculates the least squares means using a linear mixed model with fixed and random effects, runs a 2-way ANOVA, corrects the P-values for the number of metabolites using the false discovery rate or Bonferroni procedure, and calculate the P-value for the least squares mean differences for each metabolite. Finally, the %polynova_2way macro outputs a table in excel format that combines all the results to facilitate the identification of significant metabolites for each factor. The macro code is freely available in the Supporting Information.
| S-EPMC7737964 | biostudies-literature