Comparing high-dimensional confounder control methods for rapid cohort studies from electronic health records.
Ontology highlight
ABSTRACT: Aims
Electronic health records (EHR), containing rich clinical histories of large patient populations, can provide evidence for clinical decisions when evidence from trials and literature is absent. To enable such observational studies from EHR in real time, particularly in emergencies, rapid confounder control methods that can handle numerous variables and adjust for biases are imperative. This study compares the performance of 18 automatic confounder control methods.Methods
Methods include propensity scores, direct adjustment by machine learning, similarity matching and resampling in two simulated and one real-world EHR datasets.Results & conclusions
Direct adjustment by lasso regression and ensemble models involving multiple resamples have performance comparable to expert-based propensity scores and thus, may help provide real-time EHR-based evidence for timely clinical decisions.
SUBMITTER: Low YS
PROVIDER: S-EPMC4933592 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BACKGROUND:Poor EHR design adds further challenges, especially in the areas of order entry and information visualization, with a net effect of increased rates of incidents, accidents, and mortality in ICU settings. OBJECTIVE:The purpose of this study was to propose a novel, mixed-methods framework to understand EHR-related information overload by identifying and characterizing areas of suboptimal usability and clinician frustration within a vendor-based, provider-facing EHR interface. METHODS:A mixed-methods, live observational usability study was conducted at a single, large, tertiary academic medical center in the Southeastern US utilizing a commercial, vendor based EHR. Physicians were asked to complete usability patient cases, provide responses to three surveys, and participant in a semi-structured interview. RESULTS:Of the 25 enrolled ICU physician participants, there were 5(20%) attending physicians, 9 (36%) fellows, and 11 (44%) residents; 52% of participants were females. On average, residents were the quickest in completing the tasks while attending physician took the longest to complete the same task. Poor usability, complex interface screens, and difficulty to navigate the EHR significantly correlated with high frustration levels. Significant association were found between the occurrence of error messages and temporal demand such that more error messages resulted in longer completion time (p?=?.03). DISCUSSION:Physicians remain frustrated with the EHR due to difficulty in finding patient information. EHR usability remains a critical challenge in healthcare, with implications for medical errors, patient safety, and clinician burnout. There is a need for scientific findings on current information needs and ways to improve EHR-related information overload.
| S-EPMC6584062 | biostudies-literature
Project description:electronic Medical Records & Genomics (eMERGE)
| PRJNA158491 | ENA
Project description:BACKGROUND:Relying on diagnostic categories of neuropsychiatric illness obscures the complexity of these disorders. Capturing multiple dimensional measures of neuropathology could facilitate the clinical and neurobiological investigation of cognitive and behavioral phenotypes. METHODS:We developed a natural language processing-based approach to extract five symptom dimensions, based on the National Institute of Mental Health Research Domain Criteria definitions, from narrative clinical notes. Estimates of Research Domain Criteria loading were derived from a cohort of 3619 individuals with 4623 hospital admissions. We applied this tool to a large corpus of psychiatric inpatient admission and discharge notes (2010-2015), and using the same cohort we examined face validity, predictive validity, and convergent validity with gold standard annotations. RESULTS:In mixed-effect models adjusted for sociodemographic and clinical features, greater negative and positive symptom domains were associated with a shorter length of stay (? = -.88, p = .001 and ? = -1.22, p < .001, respectively), while greater social and arousal domain scores were associated with a longer length of stay (? = .93, p < .001 and ? = .81, p = .007, respectively). In fully adjusted Cox regression models, a greater positive domain score at discharge was also associated with a significant increase in readmission risk (hazard ratio = 1.22, p < .001). Positive and negative valence domains were correlated with expert annotation (by analysis of variance [df = 3], R2 = .13 and .19, respectively). Likewise, in a subset of patients, neurocognitive testing was correlated with cognitive performance scores (p < .008 for three of six measures). CONCLUSIONS:This shows that natural language processing can be used to efficiently and transparently score clinical notes in terms of cognitive and psychopathologic domains.
| S-EPMC5972065 | biostudies-literature
Project description:BACKGROUND:Genetic studies of neuropsychiatric disease strongly suggest an overlap in liability. There are growing efforts to characterize these diseases dimensionally rather than categorically, but the extent to which such dimensional models correspond to biology is unknown. METHODS:We applied a newly developed natural language processing method to extract five symptom dimensions based on the National Institute of Mental Health Research Domain Criteria definitions from narrative hospital discharge notes in a large biobank. We conducted a genome-wide association study to examine whether common variants were associated with each of these dimensions as quantitative traits. RESULTS:Among 4687 individuals, loci in three of five domains exceeded a genome-wide threshold for statistical significance. These included a locus spanning the neocortical development genes RFPL3 and RFPL3S for arousal (p = 2.29 × 10-8) and one spanning the FPR3 gene for cognition (p = 3.22 × 10-8). CONCLUSIONS:Natural language processing identifies dimensional phenotypes that may facilitate the discovery of common genetic variation that is relevant to psychopathology.
| S-EPMC5972060 | biostudies-literature
Project description:BackgroundTo better understand the impact of common coronaviruses, we compared outcomes in inpatients and outpatients, pre-COVID19, who were infected with either coronavirus or influenza.MethodsUsing de-identified EHR data from the Geisinger-Regeneron DiscovEHR partnership, we compared patients with confirmed RT-PCR positive tests for the four common coronaviruses (229E, HKU1, NL63, OC43) or influenza (A and B) performed from June 2016 to February 2019.ResultsOverall, 52,833 patients were tested for coronaviruses and influenza viruses. For patients >=21 years old, 1,555 and 3,991 patient encounters had confirmed positive coronavirus and influenza tests, respectively. Both groups had similar ICU admission rates (7.2% vs. 6.1%, p=0.12), though patients with coronavirus had significantly more pneumonia (15% vs. 7.4%, p<0.001) and a higher death rate within 30 days of testing (4.9% vs. 3.0%, p<0.001). After controlling for other covariates, coronavirus infection still had a higher risk of death and pneumonia than influenza (OR 1.64 and 2.05, p<0.001), with no significant difference in ICU admission rates.ConclusionsCommon coronaviruses cause significant morbidity, with potentially worse outcomes than influenza. These findings may help identify a subset of patients who are more susceptible to poor outcomes from common coronavirus infections and may help plan clinical interventions in patients with suspected infections.
| S-EPMC7797744 | biostudies-literature
Project description:The linkage between electronic health records (EHRs) and genotype data makes it plausible to study the genetic susceptibility of a wide range of disease phenotypes. Despite that EHR-derived phenotype data are subjected to misclassification, it has been shown useful for discovering susceptible genes, particularly in the setting of phenome-wide association studies (PheWAS). It is essential to characterize discovered associations using gold standard phenotype data by chart review. In this work, we propose a genotype stratified case-control sampling strategy to select subjects for phenotype validation. We develop a closed-form maximum-likelihood estimator for the odds ratio parameters and a score statistic for testing genetic association using the combined validated and error-prone EHR-derived phenotype data, and assess the extent of power improvement provided by this approach. Compared with case-control sampling based only on EHR-derived phenotype data, our genotype stratified strategy maintains nominal type I error rates, and result in higher power for detecting associations. It also corrects the bias in the odds ratio parameter estimates, and reduces the corresponding variance especially when the minor allele frequency is small.
| S-EPMC5891135 | biostudies-literature
Project description:BackgroundElectronic health records (EHRs) provide rich data on many domains not routinely available in other data, as such, they are a promising source to study changes in health outcomes using longitudinal study designs (eg, cohort studies, natural experiments, etc.). Yet, patient attrition rates in these data are unknown.ObjectiveThe objective of this study was to estimate overall and among adults with diabetes or hypertension: (1) patient attrition over a 3-year period at community health centers; and (2) the likelihood that patients with Medicaid permanently switched their source of primary care.Research designA retrospective cohort study of 2012-2017 data from the Accelerating Data Value Across a National Community Health Center Network (ADVANCE) Clinical Data Research Network of community health centers were used to assess EHR data attrition. Oregon Medicaid enrollment and claims data were used to estimate the likelihood of changing the source of primary care.SubjectsA total of 827,657 patients aged 19-64 with ≥1 ambulatory visit from 76 community health center systems across 20 states. In all, 232,891 Oregon Medicaid enrollees (aged 19-64) with a gap of ≥6 months following a claim for a visit billed to a primary care source.MeasuresPercentage of patients not returning within 3 years of their qualifying visit (attrition). The probability that a patient with Medicaid permanently changed their primary care source.ResultsAttrition over the 3 years averaged 33.5%; attrition rates were lower (<25%) among patients with diabetes and/or hypertension. Among Medicaid enrollees, the percentage of provider change after a 6-month gap between visits was 12% for community health center patients compared with 39% for single-provider practice patients. Over 3 years, the likelihood of a patient changing to a new provider increased with length of time since their last visit but remained lowest among community health center patients.ConclusionThis study demonstrates the use of the EHR dataset is a reliable source of data to support longitudinal studies while highlighting variability in attrition by primary care source and chronic conditions.
| S-EPMC7365658 | biostudies-literature
Project description:Synthetic electronic health records (EHRs) that are both realistic and privacy-preserving offer alternatives to real EHRs for machine learning (ML) and statistical analysis. However, generating high-fidelity EHR data in its original, high-dimensional form poses challenges for existing methods. We propose Hierarchical Autoregressive Language mOdel (HALO) for generating longitudinal, high-dimensional EHR, which preserve the statistical properties of real EHRs and can train accurate ML models without privacy concerns. HALO generates a probability density function over medical codes, clinical visits, and patient records, allowing for generating realistic EHR data without requiring variable selection or aggregation. Extensive experiments demonstrated that HALO can generate high-fidelity data with high-dimensional disease code probabilities closely mirroring (above 0.9 R2 correlation) real EHR data. HALO also enhances the accuracy of predictive modeling and enables downstream ML models to attain similar accuracy as models trained on genuine data.
| S-EPMC10471716 | biostudies-literature
Project description:Electronic health record (EHR) systems provide an opportunity to use a novel data source for population health surveillance. Validation studies that compare prevalence estimates from EHRs and surveys most often use difference testing, which can, because of large sample sizes, lead to detection of significant differences that are not meaningful. We explored a novel application of the two one-sided t test (TOST) to assess the equivalence of prevalence estimates in 2 population-based surveys to inform margin selection for validating EHR-based surveillance prevalence estimates derived from large samples.We compared prevalence estimates of health indicators in the 2013 Community Health Survey (CHS) and the 2013-2014 New York City Health and Nutrition Examination Survey (NYC HANES) by using TOST, a 2-tailed t test, and other goodness-of-fit measures.A ±5 percentage-point equivalence margin for a TOST performed well for most health indicators. For health indicators with a prevalence estimate of less than 10% (extreme obesity [CHS, 3.5%; NYC HANES, 5.1%] and serious psychological distress [CHS, 5.2%; NYC HANES, 4.8%]), a ±2.5 percentage-point margin was more consistent with other goodness-of-fit measures than the larger percentage-point margins.A TOST with a ±5 percentage-point margin was useful in establishing equivalence, but a ±2.5 percentage-point margin may be appropriate for health indicators with a prevalence estimate of less than 10%. Equivalence testing can guide future efforts to validate EHR data.
| S-EPMC5467464 | biostudies-other
Project description:IntroductionBy linking datasets, electronic records can be used to build large birth-cohorts, enabling researchers to cost-effectively answer questions relevant to populations over the life-course. Currently, around 5.8 million Palestinian refugees live in five settings: Jordan, Lebanon, Syria, West Bank, and Gaza Strip. The United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) provides them with free primary health and elementary-school services. It maintains electronic records to do so.We aimed to establish a birth cohort of Palestinian refugees born between 1st January 2010 and 31st December 2020 living in five settings by linking mother obstetric records with child health and education records and to describe some of the cohort characteristics. In future, we plan to assess effects of size-at-birth on growth, health and educational attainment, among other questions.MethodsWe extracted all available data from 140 health centres and 702 schools across five settings, i.e. all UNRWA service users. Creating the cohort involved examining IDs and other data, preparing data, de-duplicating records, and identifying live-births, linking the mothers' and children's data using different deterministic linking algorithms, and understanding reasons for non-linkage.ResultsWe established a birth cohort of Palestinian refugees using electronic records of 972,743 live births. We found high levels of linkage to health records overall (83%), which improved over time (from 73% to 86%), and variations in linkage rates by setting: these averaged 93% in Gaza, 89% in Lebanon, 75% in Jordan, 73% in West Bank and 68% in Syria. Of the 423,580 children age-eligible to go to school, 47% went to UNRWA schools and comprised of 197,479 children with both health and education records, and 2,447 children with only education records. In addition to year and setting, other factors associated with non-linkage included mortality and having a non-refugee mother. Misclassification errors were minimal.ConclusionThis linked open birth-cohort is unique for refugees and the Arab region and forms the basis for many future studies, including to elucidate pathways for improved health and education in this vulnerable, understudied population. Our characterization of the cohort leads us to recommend using different sub-sets of the cohort depending on the research question and analytic purposes.
| S-EPMC10898319 | biostudies-literature