Dataset Information

Validation of an electronic trigger to measure missed diagnosis of stroke in emergency departments.

ABSTRACT:

Objective

Diagnostic errors are major contributors to preventable patient harm. We validated the use of an electronic health record (EHR)-based trigger (e-trigger) to measure missed opportunities in stroke diagnosis in emergency departments (EDs).

Methods

Using two frameworks, the Safer Dx Trigger Tools Framework and the Symptom-disease Pair Analysis of Diagnostic Error Framework, we applied a symptom-disease pair-based e-trigger to identify patients hospitalized for stroke who, in the preceding 30 days, were discharged from the ED with benign headache or dizziness diagnoses. The algorithm was applied to Veteran Affairs National Corporate Data Warehouse on patients seen between 1/1/2016 and 12/31/2017. Trained reviewers evaluated medical records for presence/absence of missed opportunities in stroke diagnosis and stroke-related red-flags, risk factors, neurological examination, and clinical interventions. Reviewers also estimated quality of clinical documentation at the index ED visit.

Results

We applied the e-trigger to 7,752,326 unique patients and identified 46,931 stroke-related admissions, of which 398 records were flagged as trigger-positive and reviewed. Of these, 124 had missed opportunities (positive predictive value for "missed" = 31.2%), 93 (23.4%) had no missed opportunity (non-missed), 162 (40.7%) were miscoded, and 19 (4.7%) were inconclusive. Reviewer agreement was high (87.3%, Cohen's kappa = 0.81). Compared to the non-missed group, the missed group had more stroke risk factors (mean 3.2 vs 2.6), red flags (mean 0.5 vs 0.2), and a higher rate of inadequate documentation (66.9% vs 28.0%).

Conclusion

In a large national EHR repository, a symptom-disease pair-based e-trigger identified missed diagnoses of stroke with a modest positive predictive value, underscoring the need for chart review validation procedures to identify diagnostic errors in large data sets.

SUBMITTER: Vaghani V

PROVIDER: S-EPMC8449630 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Differences in the prevalence of undiagnosed HIV between different types of emergency departments (EDs) are not well understood. We seek to define missed opportunities for HIV diagnosis within 3 geographically proximate EDs serving different patient populations in a single metropolitan area.For an urban academic, an urban community, and a suburban community ED located within 10 miles of one another, we reviewed visit records for a cohort of patients who received a new diagnosis of HIV between July 1999 and June 2003. Missed opportunities for earlier HIV diagnosis were defined as ED visits in the year before diagnosis, during which there was no documented ED HIV testing offer or test. Outcomes were the number of missed opportunity visits and the number of patients with a missed opportunity for each ED. We secondarily reviewed medical records for missed opportunity encounters, using an extensive list of indications that might conceivably trigger testing.Among 276 patients with a new HIV diagnosis, 123 (44.5%) visited an ED in the year before diagnosis or received a diagnosis in the ED. The urban academic ED HIV testing program diagnosed 23 (8.3%) cases and offered testing to 24 (8.7%) patients who declined. Missed opportunities occurred during 187 visits made by 76 (27.5%) patients. These included 70 patients with 157 visits at the urban academic ED, 9 patients with 24 visits at the urban community ED, and 4 patients with 6 visits at the suburban community ED. Medical records were available for 172 of the 187 missed opportunity visits. Visits were characterized by the following potential testing indicators: HIV risk factors (58; 34%), related diagnosis indicating risk (7; 4%), AIDS-defining illness (8; 5%), physician suspicion of HIV (29; 17%), and nonspecific signs or symptoms of illness potentially consistent with HIV (126; 73%).Geographically proximate EDs differ in their opportunities for earlier HIV diagnosis, but all 3 sites had missed opportunities. Many ED patients with undiagnosed HIV have potential indications for testing documented even in the absence of a dedicated risk assessment, although most of these are nonspecific signs or symptoms of illness that may not be clinically useful selection criteria.

Project description:ObjectiveMissed diagnoses of acute ischemic stroke (AIS) in the ED may result in lost opportunities to treat AIS. Our objectives were to describe the rate and clinical characteristics of missed AIS in the ED, to determine clinical predictors of missed AIS, and to report tissue plasminogen (tPA) eligibility among those with missed strokes.MethodsAmong a population of 1.3 million in a five-county region of southwest Ohio and northern Kentucky, cases of AIS that presented to 16 EDs during 2010 were identified using ICD-9 codes followed by physician verification of cases. Missed ED diagnoses were physician-verified strokes that did not receive a diagnosis indicative of stroke in the ED. Bivariate analyses were used to compare clinical characteristics between patients with and without an ED diagnosis of AIS. Logistic regression was used to evaluate predictors of missed AIS diagnoses. Alternative diagnoses given to those with missed AIS were codified. Eligibility for tPA was reported between those with and without a missed stroke diagnosis.ResultsOf 2,027 AIS cases, 14.0% (n = 283) were missed in the ED. Race, sex, and stroke subtypes were similar between those with missed AIS diagnoses and those identified in the ED. Hospital length of stay was longer in those with a missed diagnosis (5 days vs. 3 days, p < 0.0001). Younger age (adjusted odds ratio [aOR] = 0.94, 95% confidence interval [CI] = 0.89 to 0.98) and decreased level of consciousness (LOC) (aOR = 3.58, 95% CI = 2.63 to 4.87) were associated with higher odds of missed AIS. Altered mental status was the most common diagnosis among those with missed AIS. Only 1.1% of those with a missed stroke diagnosis were eligible for tPA.ConclusionIn a large population-based sample of AIS cases, one in seven cases were not diagnosed as AIS in the ED, but the impact on acute treatment rates is likely small. Missed diagnosis was more common among those with decreased LOC, suggesting the need for improved diagnostic approaches in these patients.

Project description:ObjectivesThe objective was to measure the variation in missed diagnosis and costs of care for older acute myocardial infarction (AMI) patients presenting to emergency departments (EDs) and to identify the hospital and ED characteristics associated with this variation.MethodsUsing 2004-2005 Medicare inpatient and outpatient records, the authors identified a cohort of AMI patients age 65 years and older who presented to the ED for initial care. The primary outcome was missed diagnosis of AMI, i.e., AMI hospital admission within 7 days of an ED discharge for a condition suggestive of cardiac ischemia. Costs were defined as Medicare hospital payments for all services associated with and immediately resulting from the ED evaluation. The effect of ED and hospital characteristics on quality and costs were estimated using multilevel models with hospital random effects.ResultsThere were 371,638 AMI patients age 65 and older included in the study, of whom 4,707 were discharged home from their initial ED visits and subsequently admitted to the hospital. The median unadjusted hospital-level missed diagnosis percentage was 0.52% (interquartile range [IQR] = 0 to 3.45%). ED characteristics protective of adverse outcomes include higher ED chest pain acuity (adjusted odds ratio [aOR] = 0.23, 99% confidence interval [CI] = 0.19 to 0.27) and American Board of Emergency Medicine (ABEM) certification (aOR = 0.60, 99% CI = 0.50 to 0.73). Protective hospital characteristics include larger hospital size (aOR = 0.46, 99% CI = 0.37 to 0.57) and academic status (aOR = 0.74, 99% CI = 0.58 to 0.94). All of these characteristics were associated with higher costs as well.ConclusionsThe proportion of missed AMI diagnoses and cost of care for patients age 65 years and older presenting to EDs with AMI varies across hospitals. Hospitals with more board-certified emergency physicians (EPs) and higher average acuity are associated with significantly higher quality. All hospital characteristics associated with better ED outcomes are associated with higher costs.

Project description:BackgroundElectronic discharge communication tools (EDCTs) are increasingly common in pediatric emergency departments (EDs). These tools have been shown to improve patient-centered communication, support postdischarge care at home, and reduce unnecessary return visits to the ED.ObjectiveThis study aimed to map and assess the evidence base for EDCTs used in pediatric EDs according to their functionalities, intended purpose, implementation context features, and outcomes.MethodsA systematic review was conducted following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) procedures for identification, screening, and eligibility. A total of 7 databases (EBSCO, MEDLINE, CINAHL, PsycINFO, EMBASE Scopus, and Web of Science) were searched for studies published between 1989 and 2021. Studies evaluating discharge communication-related outcomes using electronic tools (eg, text messages, videos, and kiosks) in pediatric EDs were included. In all, 2 researchers independently assessed the eligibility. Extracted data related to study identification, methodology, settings and demographics, intervention features, outcome implementation features, and practice, policy, and research implications. The Mixed Method Appraisal Tool was used to assess methodological quality. The synthesis of results involved structured tabulation, vote counting, recoding into common metrics, inductive thematic analysis, descriptive statistics, and heat mapping.ResultsIn total, 231 full-text articles and abstracts were screened for review inclusion with 49 reports (representing 55 unique tools) included. In all, 70% (26/37) of the studies met at least three of five Mixed Method Appraisal Tool criteria. The most common EDCTs were videos, text messages, kiosks, and phone calls. The time required to use the tools ranged from 120 seconds to 80 minutes. The EDCTs were evaluated for numerous presenting conditions (eg, asthma, fracture, head injury, fever, and otitis media) that required a range of at-home care needs after the ED visit. The most frequently measured outcomes were knowledge acquisition, caregiver and patient beliefs and attitudes, and health service use. Unvalidated self-report measures were typically used for measurement. Health care provider satisfaction or system-level impacts were infrequently measured in studies. The directionality of primary outcomes pointed to positive effects for the primary measure (44/55, 80%) or no significant difference (10/55, 18%). Only one study reported negative findings, with an increase in return visits to the ED after receiving the intervention compared with the control group.ConclusionsThis review is the first to map the broad literature of EDCTs used in pediatric EDs. The findings suggest a promising evidence base, demonstrating that EDCTs have been successfully integrated across clinical contexts and deployed via diverse technological modalities. Although caregiver and patient satisfaction with EDCTs is high, future research should use robust trials using consistent measures of communication quality, clinician experience, cost-effectiveness, and health service use to accumulate evidence regarding these outcomes.Trial registrationPROSPERO CRD42020157500; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=157500.

Project description:IntroductionFor early detection of sepsis, automated systems within the electronic health record have evolved to alert emergency department (ED) personnel to the possibility of sepsis, and in some cases link them to suggested care pathways. We conducted a systematic review of automated sepsis-alert detection systems in the ED.MethodsWe searched multiple health literature databases from the earliest available dates to August 2018. Articles were screened based on abstract, again via manuscript, and further narrowed with set inclusion criteria: 1) adult patients in the ED diagnosed with sepsis, severe sepsis, or septic shock; 2) an electronic system that alerts a healthcare provider of sepsis in real or near-real time; and 3) measures of diagnostic accuracy or quality of sepsis alerts. The final, detailed review was guided by QUADAS-2 and GRADE criteria. We tracked all articles using an online tool (Covidence), and the review was registered with PROSPERO registry of reviews. A two-author consensus was reached at the article choice stage and final review stage. Due to the variation in alert criteria and methods of sepsis diagnosis confirmation, the data were not combined for meta-analysis.ResultsWe screened 693 articles by title and abstract and 20 by full text; we then selected 10 for the study. The articles were published between 2009-2018. Two studies had algorithm-based alert systems, while eight had rule-based alert systems. All systems used different criteria based on systemic inflammatory response syndrome (SIRS) to define sepsis. Sensitivities ranged from 10-100%, specificities from 78-99%, and positive predictive value from 5.8-54%. Negative predictive value was consistently high at 99-100%. Studies showed some evidence for improved process-of-care markers, including improved time to antibiotics. Length of stay improved in two studies. One low quality study showed improved mortality.ConclusionThe limited evidence available suggests that sepsis alerts in the ED setting can be set to high sensitivity. No high-quality studies showed a difference in mortality, but evidence exists for improvements in process of care. Significant further work is needed to understand the consequences of alert fatigue and sensitivity set points.

Project description:BackgroundTelehealth for emergency stroke care delivery (telestroke) has had widespread adoption, enabling many hospitals to obtain stroke center certification. Telehealth for pediatric emergency care has been less widely adopted.ObjectiveOur primary objective was to determine whether differences in policy or certification requirements contributed to differential uptake of telestroke versus pediatric telehealth. We hypothesized that differences in financial incentives, based on differences in patient volume, prehospital routing policy, and certification requirements, contributed to differential emergency department (ED) adoption of telestroke versus pediatric telehealth.MethodsWe used the 2016 National Emergency Department Inventory-USA to identify EDs that were using telestroke and pediatric telehealth services. We surveyed all EDs using pediatric telehealth services (n=339) and a convenience sample of the 1758 EDs with telestroke services (n=366). The surveys characterized ED staffing, transfer patterns, reasons for adoption, and frequency of use. We used bivariate comparisons to examine differences in reasons for adoption and use between EDs with only telestroke services, only pediatric telehealth services, or both.ResultsOf the 442 EDs surveyed, 378 (85.5%) indicated use of telestroke, pediatric telehealth, or both. EDs with both services were smaller in bed size, volume, and ED attending coverage than those with only telestroke services or only pediatric telehealth services. EDs with telestroke services reported more frequent use, overall, than EDs with pediatric telehealth services: 14.1% (45/320) of EDs with telestroke services reported weekly use versus 2.9% (8/272) of EDs with pediatric telehealth services (P<.001). In addition, 37 out of 272 (13.6%) EDs with pediatric telehealth services reported no consults in the past year. Across applications, the most frequently selected reason for adoption was "improving level of clinical care." Policy-related reasons (ie, for compliance with outside certification or standards or for improving ED performance on quality metrics) were rarely indicated as the most important, but these reasons were indicated slightly more often for telestroke adoption (12/320, 3.8%) than for pediatric telehealth adoption (1/272, 0.4%; P=.003).ConclusionsIn 2016, more US EDs had telestroke services than pediatric telehealth services; among EDs with the technology, consults were more frequently made for stroke than for pediatric patients. The most frequently indicated reason for adoption among all EDs was related to clinical care.

Project description:ObjectivesThe objective was to evaluate safety of intravenous (IV) tissue plasminogen activator (tPA) delivered without dedicated thrombolytic stroke teams.MethodsThis was a retrospective, observational study of patients treated between 1996 and 2005 at four southeastern Michigan hospital emergency departments (EDs) with a prospectively defined comparison to the National Institute of Neurological Disorders and Stroke (NINDS) tPA stroke study cohort. Main outcome measures were mortality, intracerebral hemorrhage (ICH), systemic hemorrhage, neurologic recovery, and guideline violations.ResultsA total of 273 consecutive stroke patients were treated by 95 emergency physicians (EPs) using guidelines and local neurology resources. One-year mortality was 27.8%. Unadjusted Cox model relative risk (RR) of mortality compared to the NINDS tPA treatment and placebo groups was 1.20 (95% confidence interval [CI] = 0.87 to 1.64) and 1.04 (95% CI = 0.76 to 1.41), respectively. The rate of significant ICH by computed tomography (CT) criteria was 6.6% (odds ratio [OR] = 1.03, 95% CI = 0.56 to 1.90 compared to the NINDS tPA treatment group). The proportions of symptomatic ICH by two other prespecified sets of clinical criteria were 4.8 and 7.0%. The rate of any ICH within 36 hours of treatment was 9.9% (RR = 0.94, 95% CI = 0.58 to 1.51 compared to the NINDS tPA group). The occurrence of major systemic hemorrhage (requiring transfusion) was 1.1%. Functional recovery by the modified Rankin Scale score (mRS = 0 to 2) at discharge occurred in 38% of patients with a premorbid disability mRS < 2. Guideline deviations occurred in the ED in 26% of patients and in 25% of patients following admission.ConclusionsIn these EDs there was no evidence of increased risk with respect to mortality, ICH, systemic hemorrhage, or worsened functional outcome when tPA was administered without dedicated thrombolytic stroke teams. Additional effort is needed to improve guideline compliance.