Dataset Information

Automated generation of comparator patients in the electronic medical record.

ABSTRACT:

Background

Well-designed randomized trials provide high-quality clinical evidence but are not always feasible or ethical. In their absence, the electronic medical record (EMR) presents a platform to conduct comparative effectiveness research, central to the emerging academic learning health system (aLHS) model. A barrier to realizing this vision is the lack of a process to efficiently generate a reference comparison group for each patient.

Objective

To test a multi-step process for the selection of comparators in the EMR.

Materials and methods

We conducted a mixed-methods study within a large aLHS in North Carolina. We (1) created a list of 35 candidate variables; (2) surveyed 270 researchers to assess the importance of candidate variables; and (3) built consensus rankings around survey-identified variables (ie, importance scores >7) across two panels of 7-8 clinical research experts. Prioritized algorithm inputs were collected from the EMR and applied using a greedy matching technique. Feasibility was measured as the percentage of patients with 100 matched comparators and performance was measured via computational time and Euclidean distance.

Results

Nine variables were selected: age, sex, race, ethnicity, body mass index, insurance status, smoking status, Charlson Comorbidity Index, and neighborhood percentage in poverty. The final process successfully generated 100 matched comparators for each of 1.8 million candidate patients, executed in less than 100 min for the majority of strata, and had average Euclidean distance 0.043.

Conclusion

EMR-derived matching is feasible to implement across a diverse patient population and can provide a reproducible, efficient source of comparator data for observational studies, with additional testing in clinical research applications needed.

SUBMITTER: Rigdon J

PROVIDER: S-EPMC10797581 | biostudies-literature | 2024 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Automated generation of comparator patients in the electronic medical record.

Rigdon Joseph J Ostasiewski Brian B Woelfel Kamah K Wiseman Kimberly D KD Hetherington Tim T Downs Stephen S Kowalkowski Marc M

Learning health systems 20230328 1

<h4>Background</h4>Well-designed randomized trials provide high-quality clinical evidence but are not always feasible or ethical. In their absence, the electronic medical record (EMR) presents a platform to conduct comparative effectiveness research, central to the emerging academic learning health system (aLHS) model. A barrier to realizing this vision is the lack of a process to efficiently generate a reference comparison group for each patient.<h4>Objective</h4>To test a multi-step process fo ...[more]

PMID: 38249842

Similar Datasets

Project description:Background. While often first treated in the emergency department (ED), identification of sepsis is difficult. Electronic medical record (EMR) clinical decision tools offer a novel strategy for identifying patients with sepsis. The objective of this study was to test the accuracy of an EMR-based, automated sepsis identification system. Methods. We tested an EMR-based sepsis identification tool at a major academic, urban ED with 64,000 annual visits. The EMR system collected vital sign and laboratory test information on all ED patients, triggering a "sepsis alert" for those with ≥2 SIRS (systemic inflammatory response syndrome) criteria (fever, tachycardia, tachypnea, leukocytosis) plus ≥1 major organ dysfunction (SBP ≤ 90 mm Hg, lactic acid ≥2.0 mg/dL). We confirmed the presence of sepsis through manual review of physician, nursing, and laboratory records. We also reviewed a random selection of ED cases that did not trigger a sepsis alert. We evaluated the diagnostic accuracy of the sepsis identification tool. Results. From January 1 through March 31, 2012, there were 795 automated sepsis alerts. We randomly selected 300 cases without a sepsis alert from the same period. The true prevalence of sepsis was 355/795 (44.7%) among alerts and 0/300 (0%) among non-alerts. The positive predictive value of the sepsis alert was 44.7% (95% CI [41.2-48.2%]). Pneumonia and respiratory infections (38%) and urinary tract infection (32.7%) were the most common infections among the 355 patients with true sepsis (true positives). Among false-positive sepsis alerts, the most common medical conditions were gastrointestinal (26.1%), traumatic (25.7%), and cardiovascular (20.0%) conditions. Rates of hospital admission were: true-positive sepsis alert 91.0%, false-positive alert 83.0%, no sepsis alert 5.7%. Conclusions. This ED EMR-based automated sepsis identification system was able to detect cases with sepsis. Automated EMR-based detection may provide a viable strategy for identifying sepsis in the ED.

Project description:BackgroundElectronic medical record (EMR) systems and electronic messages are an increasingly common conduit between physicians and patients. Clear benefits of this type of communication have been established, especially among cancer patients. Studies suggest that patient portals and electronic messaging platforms can help with care coordination between oncology providers and facilitate asynchronous patient-provider communication. Despite the many benefits, there is little research regarding EMR and secure messaging use, particularly among patients with breast cancer.ObjectivesThe objective of this systematic review was to examine the evidence supporting the use of EMR-based messaging systems in patients with breast cancer.MethodsA systematic literature search of Ovid MEDLINE, PubMed, Scopus, Web of Science CINAHL, and Cochrane Library was conducted. Studies were required to be published between 2005 and 2022 and report data on demographic information and electronic messaging between patients and providers. Studies were excluded if they reported insufficient data, did not include breast cancer patients, or were not published in English.ResultsThis study identified 10 articles that met inclusion criteria. The resulting studies investigated topics such as: patterns of messaging and medication adherence, cancer screening, messaging as a predictor of behavior or outcomes, and symptom management. The literature indicates that electronic messaging with providers was associated with clinical benefits for breast cancer patients and improved screening behaviors.ConclusionThis review uncovered multiple areas to focus future research on, including ideal volume of electronic messages sent and their relation to prescription adherence, studies focusing solely on the breast cancer population, racial disparities in electronic messaging, and provider perceptions of electronic messaging. It is vital that more work be done to understand barriers and gaps in EMR usage to ensure that all individuals can access this increasingly essential medical service while minimizing physician workload and burnout.

Project description:BackgroundAlthough the rate of pediatric postoperative mortality is low, the development and validation of perioperative risk assessment models have allowed for the stratification of those at highest risk, including the Pediatric Risk Assessment (PRAm) score. The clinical application of such tools requires manual data entry, which may be inaccurate or incomplete, compromise efficiency, and increase physicians' clerical obligations. We aimed to create an electronically derived, automated PRAm score and to evaluate its agreement with the original American College of Surgery National Surgical Quality Improvement Program (ACS NSQIP)-derived and validated score.MethodsWe performed a retrospective observational study of children <18 years who underwent noncardiac surgery from 2017 through 2021 at Boston Children's Hospital (BCH). An automated PRAm score was developed via electronic derivation of International Classification of Disease (ICD) -9 and -10 codes. The primary outcome was agreement and correlation among PRAm scores obtained via automation, NSQIP data, and manual physician entry from the same BCH cohort. The secondary outcome was discriminatory ability of the 3 PRAm versions. Fleiss Kappa, Spearman correlation (rho), and intraclass correlation coefficient (ICC) and receiver operating characteristic (ROC) curve analyses with area under the curve (AUC) were applied accordingly.ResultsOf the 6014 patients with NSQIP and automated PRAm scores (manual scores: n = 5267), the rate of 30-day mortality was 0.18% (n = 11). Agreement and correlation were greater between the NSQIP and automated scores (rho = 0.78; 95% confidence interval [CI], 0.76-0.79; P <.001; ICC = 0.80; 95% CI, 0.79-0.81; Fleiss kappa = 0.66; 95% CI, 0.65-0.67) versus the NSQIP and manual scores (rho = 0.73; 95% CI, 0.71-0.74; P < .001; ICC = 0.78; 95% CI, 0.77-0.79; Fleiss kappa = 0.56; 95% CI, 0.54-0.57). ROC analysis with AUC showed the manual score to have the greatest discrimination (AUC = 0.976; 95% CI, 0.959,0.993) compared to the NSQIP (AUC = 0.904; 95% CI, 0.792-0.999) and automated (AUC = 0.880; 95% CI, 0.769-0.999) scores.ConclusionsDevelopment of an electronically derived, automated PRAm score that maintains good discrimination for 30-day mortality in neonates, infants, and children after noncardiac surgery is feasible. The automated PRAm score may reduce the preoperative clerical workload and provide an efficient and accurate means by which to risk stratify neonatal and pediatric surgical patients with the goal of improving clinical outcomes and resource utilization.

Dataset Information

Automated generation of comparator patients in the electronic medical record.

Background

Objective

Materials and methods

Results

Conclusion

Publications

Automated generation of comparator patients in the electronic medical record.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets