Dataset Information

Augmented backward elimination: a pragmatic and purposeful way to develop statistical models.

ABSTRACT: Statistical models are simple mathematical rules derived from empirical data describing the association between an outcome and several explanatory variables. In a typical modeling situation statistical analysis often involves a large number of potential explanatory variables and frequently only partial subject-matter knowledge is available. Therefore, selecting the most suitable variables for a model in an objective and practical manner is usually a non-trivial task. We briefly revisit the purposeful variable selection procedure suggested by Hosmer and Lemeshow which combines significance and change-in-estimate criteria for variable selection and critically discuss the change-in-estimate criterion. We show that using a significance-based threshold for the change-in-estimate criterion reduces to a simple significance-based selection of variables, as if the change-in-estimate criterion is not considered at all. Various extensions to the purposeful variable selection procedure are suggested. We propose to use backward elimination augmented with a standardized change-in-estimate criterion on the quantity of interest usually reported and interpreted in a model for variable selection. Augmented backward elimination has been implemented in a SAS macro for linear, logistic and Cox proportional hazards regression. The algorithm and its implementation were evaluated by means of a simulation study. Augmented backward elimination tends to select larger models than backward elimination and approximates the unselected model up to negligible differences in point estimates of the regression coefficients. On average, regression coefficients obtained after applying augmented backward elimination were less biased relative to the coefficients of correctly specified models than after backward elimination. In summary, we propose augmented backward elimination as a reproducible variable selection algorithm that gives the analyst more flexibility in adopting model selection to a specific statistical modeling situation.

SUBMITTER: Dunkler D

PROVIDER: S-EPMC4240713 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Augmented backward elimination: a pragmatic and purposeful way to develop statistical models.

Dunkler Daniela D Plischke Max M Leffondré Karen K Heinze Georg G

PloS one 20141121 11

Statistical models are simple mathematical rules derived from empirical data describing the association between an outcome and several explanatory variables. In a typical modeling situation statistical analysis often involves a large number of potential explanatory variables and frequently only partial subject-matter knowledge is available. Therefore, selecting the most suitable variables for a model in an objective and practical manner is usually a non-trivial task. We briefly revisit the purpo ...[more]

PMID: 25415265

Similar Datasets

Project description:BackgroundPersistent liver inflammatory damage is the main risk factor for developing liver fibrosis, cirrhosis, and even hepatocellular carcinoma in chronic hepatitis B (CHB) patients. Thus, accurate prediction of the degree of liver inflammation is a high priority and a growing medical need.AimTo build an effective and robust non-invasive model for predicting hepatitis B-related hepatic inflammation.MethodsA total of 650 treatment-naïve CHB (402 HBeAg-positive and 248 HBeAg-negative) patients who underwent liver biopsy were enrolled in this study. Histological inflammation grading was assessed by the Ishak scoring system. Serum quantitative hepatitis B core antibody (qAnti-HBc) levels and 21 immune-related inflammatory factors were measured quantitatively using a chemiluminescent microparticle immunoassay. A backward feature elimination (BFE) algorithm utilizing random forest (RF) was used to select optional features and construct a combined model. The diagnostic abilities of the model or variables were evaluated based on the estimated area under the receiver operating characteristics curve (AUROC) and compared using the DeLong test.ResultsFour features were selected to predict moderate-to-severe inflammation in CHB patients using the RF-BFE method. These predictive features included qAnti-HBc, ALT, AST, and CXCL11. Spearman's correlation analysis indicated that serum qAnti-HBc, ALT, AST, and CXCL11 levels were positively correlated with the histology activity index (HAI) score. These selected features were incorporated into the model to establish a novel model named I-3A index. The AUROC [0.822; 95% confidence interval (CI): 0.790-0.851] of the I-3A index was significantly increased compared with qAnti-HBc alone (0.760, 95%CI: 0.724-0.792, P < 0.0001) in all CHB patients. The use of an I-3A index cutoff value of 0.41 produced a sensitivity of 69.17%, specificity of 81.44%, and accuracy of 73.8%. Additionally, the I-3A index showed significantly improved diagnostic performance for predicting moderate-to-severe inflammation in HBeAg-positive and HBeAg-negative CHB patients (0.829, 95%CI: 0.789-0.865 and 0.810, 95%CI: 0.755-0.857, respectively).ConclusionThe selected features of the I-3A index constructed using the RF-BFE algorithm can effectively predict moderate-to-severe liver inflammation in CHB patients.

Project description:Strong understanding of cardiac anatomy and function are essential components of veterinary medical education; however, the heart is considered challenging to comprehend due to its complexity. This study introduced and assessed a new learning resource, the IVALA® augmented reality (AR) heart program in a cohort of pre-veterinary students. Students were randomly divided into traditional textbook learning and AR learning groups. All students underwent a pre- and post-intervention testing assessing baseline cardiac anatomy knowledge, as well as pre-intervention evaluation of inherent spatial awareness. Teaching and learning included a 60-min cadaveric learning experience guided by either traditional learning resources or the IVALA® program. All students completed a participant survey about their learning experiences. Seventy-four students (36 in the control, and 38 in the IVALA® group) participated in the research. Overall, students improved in cardiac knowledge by an average of 24.5% after intervention regardless of study methodology. No significant difference in post-test improvement was noted between the two groups. On a 20-question assessment, students in the IVALA® group improved by an average of 4.9 questions correct over their pre-intervention test, and the control group improved by an average of 4.8 questions (p = 0.9). A positive correlation was found between spatial awareness scores and post-test improvement regardless of cohort group (p = 0.03). Sixty-two individuals (83.8%) completing the participant survey reported an overwhelming preference for learning with AR compared to traditional methods. This study illustrates student preference of IVALA® program in learning anatomy of the heart and supports its use is as effective as traditional methods of teaching with the benefit of increased enthusiasm and engagement.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-021-01260-8.

Project description:Both nuclear magnetic resonance (NMR) spectroscopy and mass spectrometry (MS) play important roles in metabolomics. The complementary features of NMR and MS make their combination very attractive; however, currently the vast majority of metabolomics studies use either NMR or MS separately, and variable selection that combines NMR and MS for biomarker identification and statistical modeling is still not well developed. In this study focused on methodology, we developed a backward variable elimination partial least-squares discriminant analysis algorithm embedded with Monte Carlo cross validation (MCCV-BVE-PLSDA), to combine NMR and targeted liquid chromatography (LC)/MS data. Using the metabolomics analysis of serum for the detection of colorectal cancer (CRC) and polyps as an example, we demonstrate that variable selection is vitally important in combining NMR and MS data. The combined approach was better than using NMR or LC/MS data alone in providing significantly improved predictive accuracy in all the pairwise comparisons among CRC, polyps, and healthy controls. Using this approach, we selected a subset of metabolites responsible for the improved separation for each pairwise comparison, and we achieved a comprehensive profile of altered metabolite levels, including those in glycolysis, the TCA cycle, amino acid metabolism, and other pathways that were related to CRC and polyps. MCCV-BVE-PLSDA is straightforward, easy to implement, and highly useful for studying the contribution of each individual variable to multivariate statistical models. On the basis of these results, we recommend using an appropriate variable selection step, such as MCCV-BVE-PLSDA, when analyzing data from multiple analytical platforms to obtain improved statistical performance and a more accurate biological interpretation, especially for biomarker discovery. Importantly, the approach described here is relatively universal and can be easily expanded for combination with other analytical technologies.

Dataset Information

Augmented backward elimination: a pragmatic and purposeful way to develop statistical models.

Publications

Augmented backward elimination: a pragmatic and purposeful way to develop statistical models.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets