Common pitfalls in statistical analysis: Logistic regression.
Ontology highlight
ABSTRACT:
SUBMITTER: Ranganathan P
PROVIDER: S-EPMC5543767 | biostudies-other | 2017 Jul-Sep
REPOSITORIES: biostudies-other
Similar Datasets
Project description:The objective of this work is to advance the understanding of helicopter accidents by examining and quantifying the association between helicopter-specific configurations (number of main rotor blades, number of engines, rotor diameter, and takeoff weight) and the likelihood of accidents. We leverage a dataset of 8,338 turboshaft helicopters in the U.S. civil fleet and 825 accidents from 2005 to 2015. We use the dataset to develop a logistic regression model using the method of purposeful selection, which we exploit for inferential purposes and highlight the novel insights it reveals. For example, one important question for the design and acquisition of helicopters is whether twin-engine turboshaft helicopters exhibit a smaller likelihood of accidents than their single-engine counterparts, all else being equal. The evidence-based result we derive indicates that the answer is contingent on other covariates, and that a tipping point exists in terms of the rotor diameter beyond which the likelihood of accidents of twin-engines is higher (worse) than that of their single-engine counterparts. Another important result derived here is the association between the number of main rotor blades and likelihood of accidents. We found that for single-engine turboshaft helicopters, the four-bladed ones are associated with the lowest likelihood of accidents. We also identified a clear coupling between the number of engines and the rotor diameter in terms of likelihood of accidents. In summary, we establish important relationships between the different helicopter configurations here considered and the likelihood of accident, but these are associations, not causal in nature. The causal pathway, if it exists, may be confounded or mediated by other variables not accounted for here. The results provided here lend themselves to a rich set of interpretive possibilities, and because of their significant safety implications they deserve careful attention from the rotorcraft community.
| S-EPMC6957302 | biostudies-literature
Project description:In spite of the success of genome-wide association studies in finding many common variants associated with disease, these variants seem to explain only a small proportion of the estimated heritability. Data collection has turned toward exome and whole genome sequencing, but it is well known that single marker methods frequently used for common variants have low power to detect rare variants associated with disease, even with very large sample sizes. In response, a variety of methods have been developed that attempt to cluster rare variants so that they may gather strength from one another under the premise that there may be multiple causal variants within a gene. Most of these methods group variants by gene or proximity, and test one gene or marker window at a time. We propose a penalized regression method (PeRC) that analyzes all genes at once, allowing grouping of all (rare and common) variants within a gene, along with subgrouping of the rare variants, thus borrowing strength from both rare and common variants within the same gene. The method can incorporate either a burden-based weighting of the rare variants or one in which the weights are data driven. In simulations, our method performs favorably when compared to many previously proposed approaches, including its predecessor, the sparse group lasso [Friedman et al., 2010].
| S-EPMC3842118 | biostudies-other
Project description:Two different approaches to analysis of data from diagnostic biomarker studies are commonly employed. Logistic regression is used to fit models for probability of disease given marker values while ROC curves and risk distributions are used to evaluate classification performance. In this paper we present a method that simultaneously accomplishes both tasks. The key step is to standardize markers relative to the non-diseased population before including them in the logistic regression model. Among the advantages of this method are: (i) ensuring that results from regression and performance assessments are consistent with each other; (ii) allowing covariate adjustment and covariate effects on ROC curves to be handled in a familiar way, and (iii) providing a mechanism to incorporate important assumptions about structure in the ROC curve into the fitted risk model. We develop the method in detail for the problem of combining biomarker datasets derived from multiple studies, populations or biomarker measurement platforms, when ROC curves are similar across data sources. The methods are applicable to both cohort and case-control sampling designs. The dataset motivating this application concerns Prostate Cancer Antigen 3 (PCA3) for diagnosis of prostate cancer in patients with or without previous negative biopsy where the ROC curves for PCA3 are found to be the same in the two populations. Estimated constrained maximum likelihood and empirical likelihood estimators are derived. The estimators are compared in simulation studies and the methods are illustrated with the PCA3 dataset.
| S-EPMC3817965 | biostudies-literature
Project description:BackgroundLogistic random effects models are a popular tool to analyze multilevel also called hierarchical data with a binary or ordinal outcome. Here, we aim to compare different statistical software implementations of these models.MethodsWe used individual patient data from 8509 patients in 231 centers with moderate and severe Traumatic Brain Injury (TBI) enrolled in eight Randomized Controlled Trials (RCTs) and three observational studies. We fitted logistic random effects regression models with the 5-point Glasgow Outcome Scale (GOS) as outcome, both dichotomized as well as ordinal, with center and/or trial as random effects, and as covariates age, motor score, pupil reactivity or trial. We then compared the implementations of frequentist and Bayesian methods to estimate the fixed and random effects. Frequentist approaches included R (lme4), Stata (GLLAMM), SAS (GLIMMIX and NLMIXED), MLwiN ([R]IGLS) and MIXOR, Bayesian approaches included WinBUGS, MLwiN (MCMC), R package MCMCglmm and SAS experimental procedure MCMC.Three data sets (the full data set and two sub-datasets) were analysed using basically two logistic random effects models with either one random effect for the center or two random effects for center and trial. For the ordinal outcome in the full data set also a proportional odds model with a random center effect was fitted.ResultsThe packages gave similar parameter estimates for both the fixed and random effects and for the binary (and ordinal) models for the main study and when based on a relatively large number of level-1 (patient level) data compared to the number of level-2 (hospital level) data. However, when based on relatively sparse data set, i.e. when the numbers of level-1 and level-2 data units were about the same, the frequentist and Bayesian approaches showed somewhat different results. The software implementations differ considerably in flexibility, computation time, and usability. There are also differences in the availability of additional tools for model evaluation, such as diagnostic plots. The experimental SAS (version 9.2) procedure MCMC appeared to be inefficient.ConclusionsOn relatively large data sets, the different software implementations of logistic random effects regression models produced similar results. Thus, for a large data set there seems to be no explicit preference (of course if there is no preference from a philosophical point of view) for either a frequentist or Bayesian approach (if based on vague priors). The choice for a particular implementation may largely depend on the desired flexibility, and the usability of the package. For small data sets the random effects variances are difficult to estimate. In the frequentist approaches the MLE of this variance was often estimated zero with a standard error that is either zero or could not be determined, while for Bayesian methods the estimates could depend on the chosen "non-informative" prior of the variance parameter. The starting value for the variance parameter may be also critical for the convergence of the Markov chain.
| S-EPMC3112198 | biostudies-literature
Project description:MOTIVATION:In ordinary regression, imposition of a lasso penalty makes continuous model selection straightforward. Lasso penalized regression is particularly advantageous when the number of predictors far exceeds the number of observations. METHOD:The present article evaluates the performance of lasso penalized logistic regression in case-control disease gene mapping with a large number of SNPs (single nucleotide polymorphisms) predictors. The strength of the lasso penalty can be tuned to select a predetermined number of the most relevant SNPs and other predictors. For a given value of the tuning constant, the penalized likelihood is quickly maximized by cyclic coordinate ascent. Once the most potent marginal predictors are identified, their two-way and higher order interactions can also be examined by lasso penalized logistic regression. RESULTS:This strategy is tested on both simulated and real data. Our findings on coeliac disease replicate the previous SNP results and shed light on possible interactions among the SNPs. AVAILABILITY:The software discussed is available in Mendel 9.0 at the UCLA Human Genetics web site. SUPPLEMENTARY INFORMATION:Supplementary data are available at Bioinformatics online.
| S-EPMC2732298 | biostudies-literature
Project description:Randomly censored covariates arise frequently in epidemiologic studies. The most commonly used methods, including complete case and single imputation or substitution, suffer from inefficiency and bias. They make strong parametric assumptions or they consider limit of detection censoring only. We employ multiple imputation, in conjunction with semi-parametric modeling of the censored covariate, to overcome these shortcomings and to facilitate robust estimation. We develop a multiple imputation approach for randomly censored covariates within the framework of a logistic regression model. We use the non-parametric estimate of the covariate distribution or the semiparametric Cox model estimate in the presence of additional covariates in the model. We evaluate this procedure in simulations, and compare its operating characteristics to those from the complete case analysis and a survival regression approach. We apply the procedures to an Alzheimer's study of the association between amyloid positivity and maternal age of onset of dementia. Multiple imputation achieves lower standard errors and higher power than the complete case approach under heavy and moderate censoring and is comparable under light censoring. The survival regression approach achieves the highest power among all procedures, but does not produce interpretable estimates of association. Multiple imputation offers a favorable alternative to complete case analysis and ad hoc substitution methods in the presence of randomly censored covariates within the framework of logistic regression.
| S-EPMC5047523 | biostudies-other
Project description:In this research, the photoplethysmogram (PPG) waveform analysis is utilized to develop a logistic regression-based predictive model for the classification of diabetes. The classifier has three predictors age, b/a, and SP indices in which they achieved an overall accuracy of 92.3% in the prediction of diabetes. In this study, a total of 587 subjects were enrolled. A total of 459 subjects were used for model training and development, while the rest of the 128 subjects were used for model testing and validation. The classifier was able to diagnose 63 patients correctly as diabetes while 27 subjects were wrongly classified as nondiabetes with an accuracy of 70%. Again, the model classified 479 subjects as nondiabetes correctly while it incorrectly classified 18 subjects as diabetes with an accuracy of 96.4%. Finally, the proposed model revealed an overall predictive accuracy of 92.3% which makes it a reliable surrogate measure for diabetes classification and prediction in clinical settings.
| S-EPMC7439205 | biostudies-literature
Project description:When assessing differential gene expression from RNA sequencing data, commonly used statistical tests tend to have greater power to detect differential expression of genes encoding longer transcripts. This phenomenon, called "length bias", will influence subsequent analyses such as Gene Ontology enrichment analysis. In the presence of length bias, Gene Ontology categories that include longer genes are more likely to be identified as enriched. These categories, however, are not necessarily biologically more relevant. We show that one can effectively adjust for length bias in Gene Ontology analysis by including transcript length as a covariate in a logistic regression model. The logistic regression model makes the statistical issue underlying length bias more transparent: transcript length becomes a confounding factor when it correlates with both the Gene Ontology membership and the significance of the differential expression test. The inclusion of the transcript length as a covariate allows one to investigate the direct correlation between the Gene Ontology membership and the significance of testing differential expression, conditional on the transcript length. We present both real and simulated data examples to show that the logistic regression approach is simple, effective, and flexible.
| S-EPMC3462807 | biostudies-literature
Project description:BACKGROUND:Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS) is a complex disease, whose exact cause remains unclear. A wide range of risk factors has been proposed that helps understanding potential disease pathogenesis. However, there is little consistency for many risk factor associations, thus we undertook an exploratory study of risk factors using data from the UK ME/CFS Biobank participants. We report on risk factor associations in ME/CFS compared with multiple sclerosis participants and healthy controls. METHODS:This was a cross-sectional study of 269 people with ME/CFS, including 214 with mild/moderate and 55 with severe symptoms, 74 people with multiple sclerosis (MS), and 134 healthy controls, who were recruited from primary and secondary health services. Data were collected from participants using a standardised written questionnaire. Data analyses consisted of univariate and multivariable regression analysis (by levels of proximity to disease onset). RESULTS:A history of frequent colds (OR?=?8.26, P <=?0.001) and infections (OR?=?25.5, P =?0.015) before onset were the strongest factors associated with a higher risk of ME/CFS compared to healthy controls. Being single (OR?=?4.41, P <=?0.001), having lower income (OR?=?3.71, P <=?0.001), and a family history of anxiety is associated with a higher risk of ME/CFS compared to healthy controls only (OR?=?3.77, P?<?0.001). History of frequent colds (OR?=?6.31, P <?0.001) and infections before disease onset (OR?=?5.12, P =?0.005), being single (OR?=?3.66, P =?0.003) and having lower income (OR?=?3.48, P =?0.001), are associated with a higher risk of ME/CFS than MS. Severe ME/CFS cases were associated with lower age of ME/CFS onset (OR?=?0.63, P =?0.022) and a family history of neurological illness (OR?=?6.1, P =?0.001). CONCLUSIONS:Notable differences in risk profiles were found between ME/CFS and healthy controls, ME/CFS and MS, and mild-moderate and severe ME/CFS. However, we found some commensurate overlap in risk associations between all cohorts. The most notable difference between ME/CFS and MS in our study is a history of recent infection prior to disease onset. Even recognising that our results are limited by the choice of factors we selected to investigate, our findings are consistent with the increasing body of evidence that has been published about the potential role of infections in the pathogenesis of ME/CFS, including common colds/flu.
| S-EPMC6839177 | biostudies-literature
Project description:Single-locus analysis is often used to analyze genome-wide association (GWA) data, but such analysis is subject to severe multiple comparisons adjustment. Multivariate logistic regression is proposed to fit a multi-locus model for case-control data. However, when the sample size is much smaller than the number of single-nucleotide polymorphisms (SNPs) or when correlation among SNPs is high, traditional multivariate logistic regression breaks down. To accommodate the scale of data from a GWA while controlling for collinearity and overfitting in a high dimensional predictor space, we propose a variable selection procedure using Bayesian logistic regression. We explored a connection between Bayesian regression with certain priors and L1 and L2 penalized logistic regression. After analyzing large number of SNPs simultaneously in a Bayesian regression, we selected important SNPs for further consideration. With much fewer SNPs of interest, problems of multiple comparisons and collinearity are less severe. We conducted simulation studies to examine probability of correctly selecting disease contributing SNPs and applied developed methods to analyze Genetic Analysis Workshop 16 North American Rheumatoid Arthritis Consortium data.
| S-EPMC2795912 | biostudies-literature