MISSING DATA IMPUTATION IN THE ELECTRONIC HEALTH RECORD USING DEEPLY LEARNED AUTOENCODERS.
Ontology highlight
ABSTRACT:
SUBMITTER: Beaulieu-Jones BK
PROVIDER: S-EPMC5144587 | biostudies-literature | 2017
REPOSITORIES: biostudies-literature
Publications
MISSING DATA IMPUTATION IN THE ELECTRONIC HEALTH RECORD USING DEEPLY LEARNED AUTOENCODERS.
Beaulieu-Jones Brett K BK Moore Jason H JH
Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing 20170101
Electronic health records (EHRs) have become a vital source of patient outcome data but the widespread prevalence of missing data presents a major challenge. Different causes of missing data in the EHR data may introduce unintentional bias. Here, we compare the effectiveness of popular multiple imputation strategies with a deeply learned autoencoder using the Pooled Resource Open-Access ALS Clinical Trials Database (PRO-ACT). To evaluate performance, we examined imputation accuracy for known val ...[more]
Similar Datasets
Project description:ObjectiveClinical data of patients' measurements and treatment history stored in electronic health record (EHR) systems are starting to be mined for better treatment options and disease associations. A primary challenge associated with utilizing EHR data is the considerable amount of missing data. Failure to address this issue can introduce significant bias in EHR-based research. Currently, imputation methods rely on correlations among the structured phenotype variables in the EHR. However, genetic studies have shown that many EHR-based phenotypes have a heritable component, suggesting that measured genetic variants might be useful for imputing missing data. In this article, we developed a computational model that incorporates patients' genetic information to perform EHR data imputation.Materials and methodsWe used the individual single nucleotide polymorphism's association with phenotype variables in the EHR as input to construct a genetic risk score that quantifies the genetic contribution to the phenotype. Multiple approaches to constructing the genetic risk score were evaluated for optimal performance. The genetic score, along with phenotype correlation, is then used as a predictor to impute the missing values.ResultsTo demonstrate the method performance, we applied our model to impute missing cardiovascular related measurements including low-density lipoprotein, heart failure, and aortic aneurysm disease in the electronic Medical Records and Genomics data. The integration method improved imputation's area-under-the-curve for binary phenotypes and decreased root-mean-square error for continuous phenotypes.ConclusionCompared with standard imputation approaches, incorporating genetic information offers a novel approach that can utilize more of the EHR data for better performance in missing data imputation.
| S-EPMC6748821 | biostudies-literature
Project description:BackgroundMissing data are common when analyzing real data. One popular solution is to impute missing data so that one complete dataset can be obtained for subsequent data analysis. In the present study, we focus on missing data imputation using classification and regression trees (CART).MethodsWe consider a new perspective on missing data in a CART imputation problem and realize the perspective through some resampling algorithms. Several existing missing data imputation methods using CART are compared through simulation studies, and we aim to investigate the methods with better imputation accuracy under various conditions. Some systematic findings are demonstrated and presented. These imputation methods are further applied to two real datasets: Hepatitis data and Credit approval data for illustration.ResultsThe method that performs the best strongly depends on the correlation between variables. For imputing missing ordinal categorical variables, the rpart package with surrogate variables is recommended under correlations larger than 0 with missing completely at random (MCAR) and missing at random (MAR) conditions. Under missing not at random (MNAR), chi-squared test methods and the rpart package with surrogate variables are suggested. For imputing missing quantitative variables, the iterative imputation method is most recommended under moderate correlation conditions.
| S-EPMC11232582 | biostudies-literature
Project description:PurposeWe examined whether weighting techniques could account for longitudinal differences in disease activity by race/ethnicity between research participants and nonparticipants with rheumatoid arthritis (RA).MethodsWe included 377 patients with RA from a public hospital in San Francisco, CA. We estimated the probability of not enrolling in a research study by constructing weights using inverse probability weighting. Disease activity over time by race/ethnicity was analyzed across the entire patient population and among research participants only using multivariable mixed-effects models.ResultsThere were no differences in RA disease activity scores between research participants and nonparticipants at baseline; however, longitudinal differences in disease activity between research participants and nonparticipants were found by race/ethnicity. Weighting research participants in accordance with sociodemographic and clinical characteristics of the nonparticipant population did not result in any meaningful changes in disease activity by race/ethnicity over time.ConclusionsIn our study of patients with RA, inverse probability weighting using select sociodemographic and clinical variables was not sufficient to account for longitudinal disease activity differences by race/ethnicity between research participants and nonparticipants.
| S-EPMC7541711 | biostudies-literature
Project description:Electronic health records (EHRs) are increasingly used for clinical and comparative effectiveness research, but suffer from missing data. Motivated by health services research on diabetes care, we seek to increase the quality of EHRs by focusing on missing values of longitudinal glycosylated hemoglobin (A1c), a key risk factor for diabetes complications and adverse events. Under the framework of multiple imputation (MI), we propose an individualized Bayesian latent profiling approach to capture A1c measurement trajectories subject to missingness. The proposed method is applied to EHRs of adult patients with diabetes in a large academic Midwestern health system between 2003 and 2013 and had Medicare A and B coverage. We combine MI inferences to evaluate the association of A1c levels with the incidence of acute adverse health events and examine patient heterogeneity across identified patient profiles. We investigate different missingness mechanisms and perform imputation diagnostics. Our approach is computationally efficient and fits flexible models that provide useful clinical insights.
| S-EPMC9600600 | biostudies-literature
Project description:BACKGROUND:Readmissions after hospitalization for pneumonia are common, but the few risk-prediction models have poor to modest predictive ability. Data routinely collected in the electronic health record (EHR) may improve prediction. OBJECTIVE:To develop pneumonia-specific readmission risk-prediction models using EHR data from the first day and from the entire hospital stay ("full stay"). DESIGN:Observational cohort study using stepwise-backward selection and cross-validation. SUBJECTS:Consecutive pneumonia hospitalizations from 6 diverse hospitals in north Texas from 2009-2010. MEASURES:All-cause nonelective 30-day readmissions, ascertained from 75 regional hospitals. RESULTS:Of 1463 patients, 13.6% were readmitted. The first-day pneumonia-specific model included sociodemographic factors, prior hospitalizations, thrombocytosis, and a modified pneumonia severity index; the full-stay model included disposition status, vital sign instabilities on discharge, and an updated pneumonia severity index calculated using values from the day of discharge as additional predictors. The full-stay pneumonia-specific model outperformed the first-day model (C statistic 0.731 vs 0.695; P = 0.02; net reclassification index = 0.08). Compared to a validated multi-condition readmission model, the Centers for Medicare and Medicaid Services pneumonia model, and 2 commonly used pneumonia severity of illness scores, the full-stay pneumonia-specific model had better discrimination (C statistic range 0.604-0.681; P < 0.01 for all comparisons), predicted a broader range of risk, and better reclassified individuals by their true risk (net reclassification index range, 0.09-0.18). CONCLUSIONS:EHR data collected from the entire hospitalization can accurately predict readmission risk among patients hospitalized for pneumonia. This approach outperforms a first-day pneumonia-specific model, the Centers for Medicare and Medicaid Services pneumonia model, and 2 commonly used pneumonia severity of illness scores. Journal of Hospital Medicine 2017;12:209-216.
| S-EPMC6296251 | biostudies-literature
Project description:ImportanceSecondary prevention interventions to reduce post-stroke cognitive impairment (PSCI) can be aided by the early identification of high-risk individuals who would benefit from risk factor modification.ObjectiveTo develop and evaluate a predictive model to identify patients at increased risk of PSCI over 5 years using data easily accessible from electronic health records.DesignCohort study with patients enrolled between 2003-2016 with follow-up through 2022.SettingPrimary care practices affiliated with two academic medical centers.ParticipantsIndividuals 45 years or older, without prior stroke or prevalent cognitive impairment, with primary care visits and an incident ischemic stroke between 2003-2016 (development/internal validation cohort) or 2010-2022 (external validation cohort).ExposuresPredictors of PSCI were ascertained from the electronic health record.Main outcomeThe outcome was incident dementia/cognitive impairment within 5 years and beginning 3 months following stroke, ascertained using ICD-9/10 codes. For model variable selection, we considered potential predictors of PSCI and constructed 400 bootstrap samples with two-thirds of the model derivation sample. We ran 10-fold cross-validated Cox proportional hazards models using a least absolute shrinkage and selection operator (LASSO) penalty. Variables selected in >25% of samples were included.ResultsThe analysis included 332 incident diagnoses of PSCI in the development cohort (n=3,741), and 161 and 128 incident diagnoses in the internal (n=1,925) and external (n=2,237) validation cohorts. The c-statistic for predicting PSCI was 0.731 (95% CI: 0.694-0.768) in the internal validation cohort, and 0.724 (95% CI: 0.681-0.766) in the external validation cohort. A risk score based on the beta coefficients of predictors from the development cohort stratified patients into low (0-7 points), intermediate (8-11 points), and high (12-35 points) risk groups. The hazard ratios for incident PSCI were significantly different by risk categories in internal (High, HR: 6.2, 95% CI 4.1-9.3; Intermediate, HR 2.7, 95% CI: 1.8-4.1) and external (High, HR: 6.1, 95% CI: 3.9-9.6; Intermediate, HR 2.8, 95% CI: 1.9-4.3) validation cohorts.Conclusions and relevanceFive-year risk of PSCI can be accurately predicted using routinely collected data. Model output can be used to risk stratify and identify individuals at increased risk for PSCI for preventive efforts.
| S-EPMC10863024 | biostudies-literature
Project description:ObjectiveTo demonstrate that electronic health record (EHR) data can be used in an automated approach to evaluate cataract surgery outcomes.DesignRetrospective analysis.SubjectsResident and faculty surgeons.MethodsElectronic health record data were collected from cataract surgeries performed at the Johns Hopkins Wilmer Eye Institute, and cases were categorized into resident or attending as primary surgeon. Preoperative and postoperative visual acuity (VA) and unplanned return to operating room were extracted from the EHR.Main outcome measuresPostoperative VA and reoperation rate within 90 days.ResultsThis study analyzed 14 537 cataract surgery cases over 32 months. Data were extracted from the EHR using an automated approach to assess surgical outcomes for resident and attending surgeons. Of 337 resident surgeries with both preoperative and postoperative VA data, 248 cases (74%) had better postoperative VA, and 170 cases (51%) had more than 2 lines improvement. There was no statistical difference in the proportion of cases with better postoperative VA or more than 2 lines improvement between resident and attending cases. Attending surgeons had a statistically greater proportion of cases with postoperative VA better than 20/40, but this finding has to be considered in the context that, on average, resident cases started out with poorer baseline VA.A multivariable regression model of VA outcomes vs. resident/attending status that controlled for preoperative VA, patient age, American Society of Anesthesiologists (ASA) score, and estimated income found that resident status, preoperative VA, patient age, ASA score, and estimated income were all significant predictors of VA. The rate of unplanned return to the operating room within 90 days of cataract surgery was not statistically different between resident (1.8%) and attending (1.2%) surgeons.ConclusionsThis study demonstrates that EHR data can be used to evaluate and monitor surgical outcomes in an ongoing way. Analysis of EHR-extracted cataract outcome data showed that preoperative VA, ASA classification, and attending/resident status were important in predicting postoperative VA outcomes. These findings suggest that the utilization of EHR data could enable continuous assessment of surgical outcomes and inform interventions to improve resident training. Financial Disclosure(s): Proprietary or commercial disclosure may be found after the references.
| S-EPMC9852949 | biostudies-literature
Project description:Proper handling of missing data is important for many secondary uses of electronic health record (EHR) data. Data imputation methods can be used to handle missing data, but their use for analyzing EHR data is limited and specific efficacy for postoperative complication detection is unclear. Several data imputation methods were used to develop data models for automated detection of three types (i.e., superficial, deep, and organ space) of surgical site infection (SSI) and overall SSI using American College of Surgeons National Surgical Quality Improvement Project (NSQIP) Registry 30-day SSI occurrence data as a reference standard. Overall, models with missing data imputation almost always outperformed reference models without imputation that included only cases with complete data for detection of SSI overall achieving very good average area under the curve values. Missing data imputation appears to be an effective means for improving postoperative SSI detection using EHR clinical data.
| S-EPMC5474942 | biostudies-literature
Project description:BackgroundIn electronic health records, patterns of missing laboratory test results could capture patients' course of disease as well as reflect clinician's concerns or worries for possible conditions. These patterns are often understudied and overlooked. This study aims to identify informative patterns of missingness among laboratory data collected across 15 healthcare system sites in three countries for COVID-19 inpatients.MethodsWe collected and analyzed demographic, diagnosis, and laboratory data for 69,939 patients with positive COVID-19 PCR tests across three countries from 1 January 2020 through 30 September 2021. We analyzed missing laboratory measurements across sites, missingness stratification by demographic variables, temporal trends of missingness, correlations between labs based on missingness indicators over time, and clustering of groups of labs based on their missingness/ordering pattern.ResultsWith these analyses, we identified mapping issues faced in seven out of 15 sites. We also identified nuances in data collection and variable definition for the various sites. Temporal trend analyses may support the use of laboratory test result missingness patterns in identifying severe COVID-19 patients. Lastly, using missingness patterns, we determined relationships between various labs that reflect clinical behaviors.ConclusionIn this work, we use computational approaches to relate missingness patterns to hospital treatment capacity and highlight the heterogeneity of looking at COVID-19 over time and at multiple sites, where there might be different phases, policies, etc. Changes in missingness could suggest a change in a patient's condition, and patterns of missingness among laboratory measurements could potentially identify clinical outcomes. This allows sites to consider missing data as informative to analyses and help researchers identify which sites are better poised to study particular questions.
| S-EPMC10849195 | biostudies-literature
Project description:Multiple imputation is a well-established general technique for analyzing data with missing values. A convenient way to implement multiple imputation is sequential regression multiple imputation, also called chained equations multiple imputation. In this approach, we impute missing values using regression models for each variable, conditional on the other variables in the data. This approach, however, assumes that the missingness mechanism is missing at random, and it is not well-justified under not-at-random missingness without additional modification. In this paper, we describe how we can generalize the sequential regression multiple imputation imputation procedure to handle missingness not at random in the setting where missingness may depend on other variables that are also missing but not on the missing variable itself, conditioning on fully observed variables. We provide algebraic justification for several generalizations of standard sequential regression multiple imputation using Taylor series and other approximations of the target imputation distribution under missingness not at random. Resulting regression model approximations include indicators for missingness, interactions, or other functions of the missingness not at random missingness model and observed data. In a simulation study, we demonstrate that the proposed sequential regression multiple imputation modifications result in reduced bias in the final analysis compared to standard sequential regression multiple imputation, with an approximation strategy involving inclusion of an offset in the imputation model performing the best overall. The method is illustrated in a breast cancer study, where the goal is to estimate the prevalence of a specific genetic pathogenic variant.
| S-EPMC9205685 | biostudies-literature