Pseudo-population bootstrap methods for imputed survey data.
Ontology highlight
ABSTRACT:
SUBMITTER: Chen S
PROVIDER: S-EPMC6508281 | biostudies-literature | 2019 Jun
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Many approaches for variable selection with multiply imputed data in the development of a prognostic model have been proposed. However, no method prevails as uniformly best. We conducted a simulation study with a binary outcome and a logistic regression model to compare two classes of variable selection methods in the presence of MI data: (I) Model selection on bootstrap data, using backward elimination based on AIC or lasso, and fit the final model based on the most frequently (e.g. ≥50% ) selected variables over all MI and bootstrap data sets; (II) Model selection on original MI data, using lasso. The final model is obtained by (i) averaging estimates of variables that were selected in any MI data set or (ii) in 50% of the MI data; (iii) performing lasso on the stacked MI data, and (iv) as in (iii) but using individual weights as determined by the fraction of missingness. In all lasso models, we used both the optimal penalty and the 1-se rule. We considered recalibrating models to correct for overshrinkage due to the suboptimal penalty by refitting the linear predictor or all individual variables. We applied the methods on a real dataset of 951 adult patients with tuberculous meningitis to predict mortality within nine months. Overall, applying lasso selection with the 1-se penalty shows the best performance, both in approach I and II. Stacking MI data is an attractive approach because it does not require choosing a selection threshold when combining results from separate MI data sets.
| S-EPMC6492211 | biostudies-literature
Project description:Motivation: Gene-expression data obtained from high throughput technologies are subject to various sources of noise and accordingly the raw data are pre-processed before formally analyzed. Normalization of the data is a key pre-processing step, since it removes systematic variations across arrays. There are numerous normalization methods available in the literature. Based on our experience, in the context of oscillatory systems, such as cell-cycle, circadian clock, etc., the choice of the normalization method may substantially impact the determination of a gene to be rhythmic. Thus rhythmicity of a gene can purely be an artifact of how the data were normalized. Since the determination of rhythmic genes is an important component of modern toxicological and pharmacological studies, it is important to determine truly rhythmic genes that are robust to the choice of a normalization method. Results: In this paper we introduce a rhythmicity measure and a bootstrap methodology to detect rhythmic genes in an oscillatory system. Although the proposed methodology can be used for any high-throughput gene expression data, in this paper we illustrate the proposed methodology using several publicly available circadian clock microarray gene-expression datasets. We demonstrate that the choice of normalization method has very little effect on the proposed methodology. Specifically, for any pair of normalization methods considered in this paper, the resulting values of the rhythmicity measure are highly correlated. Thus it suggests that the proposed measure is robust to the choice of a normalization method. Consequently, the rhythmicity of a gene is potentially not a mere artifact of the normalization method used. Lastly, as demonstrated in the paper, the proposed bootstrap methodology can also be used for simulating data for genes participating in an oscillatory system using a reference dataset. Availability: A user friendly code implemented in R language can be downloaded from http://www.eio.uva.es/~miguel/robustdetectionprocedure.html.
| S-EPMC5801422 | biostudies-literature
Project description:BackgroundAssessing disparities in injury is crucial for injury prevention and for evaluating injury prevention strategies, but efforts have been hampered by missing data. This study aimed to show the utility and reliability of the injury surveillance system as a trustworthy resource for examining disparities by generating multiple imputed companion datasets.MethodsWe employed data from the National Electronic Injury Surveillance System-All Injury Program (NEISS-AIP) for the period 2014-2018. A comprehensive simulation study was conducted to identify the appropriate strategy for addressing missing data limitations in NEISS-AIP. To evaluate the imputation performance more quantitatively, a new method based on Brier Skill Score (BSS) was developed to assess the accuracy of predictions by different approaches. We selected the multiple imputations by fully conditional specification (FCS MI) to generate the imputed companion data to NEISS-AIP 2014-2018. We further assessed health disparities systematically in nonfatal assault injuries treated in U.S. hospital emergency departments (EDs) by race and ethnicity, location of injury and sex.ResultsWe found for the first time that significantly higher age-adjusted nonfatal assault injury rates for ED visits per 100,000 population occurred among non-Hispanic Black persons (1306.8, 95% Confidence Interval [CI]: 660.1 - 1953.5), in public settings (286.3, 95% CI: 183.2 - 389.4) and for males (603.5, 95% CI: 409.4 - 797.5). We also observed similar trends in age-adjusted rates (AARs) by different subgroups for non-Hispanic Black persons, injuries occurring in public settings, and for males: AARs of nonfatal assault injury increased significantly from 2014 through 2017, then declined significantly in 2018.ConclusionsNonfatal assault injury imposes significant health care costs and productivity losses for millions of people each year. This study is the first to specifically look at health disparities in nonfatal assault injuries using multiply imputed companion data. Understanding how disparities differ by various groups may lead to the development of more effective initiatives to prevent such injury.
| S-EPMC10316636 | biostudies-literature
Project description:Penalized regression methods are used in many biomedical applications for variable selection and simultaneous coefficient estimation. However, missing data complicates the implementation of these methods, particularly when missingness is handled using multiple imputation. Applying a variable selection algorithm on each imputed dataset will likely lead to different sets of selected predictors. This paper considers a general class of penalized objective functions which, by construction, force selection of the same variables across imputed datasets. By pooling objective functions across imputations, optimization is then performed jointly over all imputed datasets rather than separately for each dataset. We consider two objective function formulations that exist in the literature, which we will refer to as "stacked" and "grouped" objective functions. Building on existing work, we (a) derive and implement efficient cyclic coordinate descent and majorization-minimization optimization algorithms for continuous and binary outcome data, (b) incorporate adaptive shrinkage penalties, (c) compare these methods through simulation, and (d) develop an R package miselect. Simulations demonstrate that the "stacked" approaches are more computationally efficient and have better estimation and selection properties. We apply these methods to data from the University of Michigan ALS Patients Biorepository aiming to identify the association between environmental pollutants and ALS risk. Supplementary materials are available online.
| S-EPMC9838615 | biostudies-literature
Project description:Long-term observational studies conducted at large (regional) spatial scales contribute to better understanding of landscape effects on population and evolutionary dynamics, including the conditions that affect long-term viability of species, but large-scale studies are expensive and logistically challenging to keep running for a long time. Here, we describe the long-term metapopulation study of the Glanville fritillary butterfly (Melitaea cinxia) that has been conducted since 1991 in a large network of 4000 habitat patches (dry meadows) within a study area of 50 by 70 km in the Åland Islands in Finland. We explain how the landscape structure has been described, including definition, delimitation, and mapping of the habitat patches; methods of field survey, including the logistics, cost, and reliability of the survey; and data management using the EarthCape biodiversity platform. We describe the long-term metapopulation dynamics of the Glanville fritillary based on the survey. There has been no long-term change in the overall size of the metapopulation, but the level of spatial synchrony and hence the amplitude of fluctuations in year-to-year metapopulation dynamics have increased over the years, possibly due to increasing frequency of exceptional weather conditions. We discuss the added value of large-scale and long-term population studies, but also emphasize the need to integrate more targeted experimental studies in the context of long-term observational studies. For instance, in the case of the Glanville fritillary project, the long-term study has produced an opportunity to sample individuals for experiments from local populations with a known demographic history. These studies have demonstrated striking differences in dispersal rate and other life-history traits of individuals from newly established local populations (the offspring of colonizers) versus individuals from old, established local populations. The long-term observational study has stimulated the development of metapopulation models and provided an opportunity to test model predictions. This combination of empirical studies and modeling has facilitated the study of key phenomena in spatial dynamics, such as extinction threshold and extinction debt.
| S-EPMC3810870 | biostudies-other
Project description:Felsenstein's application of the bootstrap method to evolutionary trees is one of the most cited scientific papers of all time. The bootstrap method, which is based on resampling and replications, is used extensively to assess the robustness of phylogenetic inferences. However, increasing numbers of sequences are now available for a wide variety of species, and phylogenies based on hundreds or thousands of taxa are becoming routine. With phylogenies of this size Felsenstein's bootstrap tends to yield very low supports, especially on deep branches. Here we propose a new version of the phylogenetic bootstrap in which the presence of inferred branches in replications is measured using a gradual 'transfer' distance rather than the binary presence or absence index used in Felsenstein's original version. The resulting supports are higher and do not induce falsely supported branches. The application of our method to large mammal, HIV and simulated datasets reveals their phylogenetic signals, whereas Felsenstein's bootstrap fails to do so.
| S-EPMC6030568 | biostudies-literature
Project description:Recent advances in fMRI research highlight the use of multivariate methods for examining whole-brain connectivity. Complementary data-driven methods are needed for determining the subset of predictors related to individual differences. Although commonly used for this purpose, ordinary least squares (OLS) regression may not be ideal due to multi-collinearity and over-fitting issues. Penalized regression is a promising and underutilized alternative to OLS regression. In this paper, we propose a nonparametric bootstrap quantile (QNT) approach for variable selection with neuroimaging data. We use real and simulated data, as well as annotated R code, to demonstrate the benefits of our proposed method. Our results illustrate the practical potential of our proposed bootstrap QNT approach. Our real data example demonstrates how our method can be used to relate individual differences in neural network connectivity with an externalizing personality measure. Also, our simulation results reveal that the QNT method is effective under a variety of data conditions. Penalized regression yields more stable estimates and sparser models than OLS regression in situations with large numbers of highly correlated neural predictors. Our results demonstrate that penalized regression is a promising method for examining associations between neural predictors and clinically relevant traits or behaviors. These findings have important implications for the growing field of functional connectivity research, where multivariate methods produce numerous, highly correlated brain networks.
| S-EPMC4964314 | biostudies-literature
Project description:Time-binned single-molecule Förster resonance energy transfer (smFRET) experiments with surface-tethered nucleic acids or proteins permit to follow folding and catalysis of single molecules in real-time. Due to the intrinsically low signal-to-noise ratio (SNR) in smFRET time traces, research over the past years has focused on the development of new methods to extract discrete states (conformations) from noisy data. However, limited observation time typically leads to pronounced cross-sample variability, i.e., single molecules display differences in the relative population of states and the corresponding conversion rates. Quantification of cross-sample variability is necessary to perform statistical testing in order to assess whether changes observed in response to an experimental parameter (metal ion concentration, the presence of a ligand, etc.) are significant. However, such hypothesis testing has been disregarded to date, precluding robust biological interpretation. Here, we address this problem by a bootstrap-based approach to estimate the experimental variability. Simulated time traces are presented to assess the robustness of the algorithm in conjunction with approaches commonly used in thermodynamic and kinetic analysis of time-binned smFRET data. Furthermore, a pair of functionally important sequences derived from the self-cleaving group II intron Sc.ai5γ (d3'EBS1/IBS1) is used as a model system. Through statistical hypothesis testing, divalent metal ions are shown to have a statistically significant effect on both thermodynamic and kinetic aspects of their interaction. The Matlab source code used for analysis (bootstrap-based analysis of smFRET data, BOBA FRET), as well as a graphical user interface, is available via http://www.aci.uzh.ch/rna/.
| S-EPMC3873958 | biostudies-literature
Project description:Sparse tissue sampling with intensive plasma sampling creates a unique data analysis problem in determining drug exposure in clinically relevant tissues. Tissue exposure may govern drug efficacy, as many drugs exert their actions in tissues. We compared tissue area-under-the-curve (AUC) generated from bootstrapped noncompartmental analysis (NCA) methods and compartmental nonlinear mixed effect (NLME) modeling. A model of observed data after single-dose tenofovir disoproxil fumarate was used to simulate plasma and tissue concentrations for two destructive tissue sampling schemes. Two groups of 100 data sets with densely-sampled plasma and one tissue sample per individual were created. The bootstrapped NCA (SAS 9.3) used a trapezoidal method to calculate geometric mean tissue AUC per dataset. For NLME, individual post hoc estimates of tissue AUC were determined, and the geometric mean from each dataset calculated. Median normalized prediction error (NPE) and absolute normalized prediction error (ANPE) were calculated for each method from the true values of the modeled concentrations. Both methods produced similar tissue AUC estimates close to true values. Although the NLME-generated AUC estimates had larger NPEs, it had smaller ANPEs. Overall, NLME NPEs showed AUC under-prediction but improved precision and fewer outliers. The bootstrapped NCA method produced more accurate estimates but with some NPEs > 100%. In general, NLME is preferred, as it accommodates less intensive tissue sampling with reasonable results, and provides simulation capabilities for optimizing tissue distribution. However, if the main goal is an accurate AUC for the studied scenario, and relatively intense tissue sampling is feasible, the NCA bootstrap method is a reasonable, and potentially less time-intensive solution.
| S-EPMC5693300 | biostudies-literature
Project description:Generalized structured component analysis (GSCA) is a theoretically well-founded approach to component-based structural equation modeling (SEM). This approach utilizes the bootstrap method to estimate the confidence intervals of its parameter estimates without recourse to distributional assumptions, such as multivariate normality. It currently provides the bootstrap percentile confidence intervals only. Recently, the potential usefulness of the bias-corrected and accelerated bootstrap (BCa) confidence intervals (CIs) over the percentile method has attracted attention for another component-based SEM approach-partial least squares path modeling. Thus, in this study, we implemented the BCa CI method into GSCA and conducted a rigorous simulation to evaluate the performance of three bootstrap CI methods, including percentile, BCa, and Student's t methods, in terms of coverage and balance. We found that the percentile method produced CIs closer to the desired level of coverage than the other methods, while the BCa method was less prone to imbalance than the other two methods. Study findings and implications are discussed, as well as limitations and directions for future research.
| S-EPMC6797821 | biostudies-literature