Dataset Information

Diagnostic Performance of Emergency Physician Gestalt for Predicting Acute Appendicitis in Patients Age 5 to 20 Years.

ABSTRACT:

Objectives

Pediatric appendicitis remains a challenging diagnosis in the emergency department (ED). Available risk prediction algorithms may contribute to excessive ED imaging studies. Incorporation of physician gestalt assessment could help refine predictive tools and improve diagnostic imaging decisions.

Methods

This study was a subanalysis of a parent study that prospectively enrolled patients ages 5 to 20.9 years with a chief complaint of abdominal pain presenting to 11 community EDs within an integrated delivery system between October 1, 2016, and September 30, 2018. Prior to diagnostic imaging, attending emergency physicians enrolled patients with ≤5 days of right-sided or diffuse abdominal pain using a Web-based application embedded in the electronic health record. Predicted risk (gestalt) of acute appendicitis was prospectively entered using a sliding scale from 1% to 100%. As a planned secondary analysis, we assessed the performance of gestalt via c-statistics of receiver operating characteristic (ROC) curves; tested associations between gestalt performance and patient, physician, and facility characteristics; and examined clinical characteristics affecting gestalt estimates.

Results

Of 3,426 patients, 334 (9.8%) had confirmed appendicitis. Physician gestalt had excellent ROC curve characteristics (c-statistic = 0.83, 95% confidence interval = 0.81 to 0.85), performing particularly well in the low-risk strata (appendicitis rate = 1.1% in gestalt 1%-10% range, negative predictive value of 98.9% for appendicitis diagnosis). Physicians with ≥5 years since medical school graduation demonstrated improved gestalt performance over those with less experience (p = 0.007). All clinical characteristics tested, except pain <24 hours, were significantly associated with physician gestalt value (p < 0.05).

Conclusion

Physician gestalt for acute appendicitis diagnosis performed well, especially in low-risk patients and when employed by experienced physicians.

SUBMITTER: Simon LE

PROVIDER: S-EPMC8310728 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundBedside inferior vena cava (IVC) ultrasound has been proposed as a non-invasive measure of volume status. We compared ultrasound measurements of the caval index (CI) and physician gestalt to predict blood pressure response in patients requiring intravenous fluid resuscitation.MethodsThis was a prospective study of adult emergency department patients requiring fluid resuscitation. A structured data sheet was used to record serial vital signs and the treating clinician's impression of patient volume status and cause of hypotension. Bedside ultrasound CI measurements were performed at baseline and after each 500mL of fluid. Receiver operating characteristic (ROC) curve analysis was performed to characterize the relationship between CI and Physician gestalt, and the change in mean arterial pressure (MAP).ResultsWe enrolled 364 patients, 52% male, mean age 36 years. Indications for fluid resuscitation were haemorrhage (54%), dehydration (30%), and sepsis (17%). Receiver operating characteristic curve analysis found optimal CI cut-off values of 45%, 52% and 53% to predict a MAP rise of 5, 8 and 10 mmHg per litre of fluid, respectively. The sensitivity and specificity of CI of 50% for predicting a 10mmHg increase in MAP per litre were 88% (95%CI 81-93%) and 73% (95%CI 67-79%), respectively, area under the curve (AUC) = 0.85 (0.81-0.89). The sensitivity and specificity of physician gestalt estimate of volume depletion severity were 68% (95%CI 60-75%) and 86% (95%CI 80-90%), respectively, AUC = 0.83 (95% CI: 0.79-0.87). Those with a baseline CI ≥ 50% (51% of patients) had a 2.8-fold greater fluid responsiveness than those with a baseline CI<50% (p<0.0001).ConclusionUltrasound measurement of the CI can predict blood pressure response among patients requiring intravenous fluid resuscitation and may be useful in early identification of patients who will benefit most from volume resuscitation, and those who will likely require other interventions.

Project description:BackgroundModified systemic inflammatory response syndrome (mSIRS) criteria for the pediatric population together with the provider gestalt have the potential to predict clinical outcomes. However, this has not been studied in low-income countries. We investigated the ability of mSIRS and provider gestalt to predict mortality and morbidity among children presenting to the ED of a tertiary level hospital in Tanzania.MethodsThis prospective observational study enrolled a convenience sample of children under 5 years old, presenting to the Emergency Medicine Department of Muhimbili National Hospital from September 2015 to April 2016. Trained researchers used a structured case report form to record patient demographics, clinical presentation, initial provider gestalt of severity of illness, and the mSIRS criteria. Primary outcomes were 24-h mortality and overall in-hospital mortality. Data was analyzed using simple descriptive statistics, Kruskal-Wallis, Mann-Whitney U, and chi-squared tests.ResultsWe enrolled 1350 patients, median age 17 months (interquartile range 8-32 months), and 58% were male. Provider gestalt estimates of illness severity were recorded for all patients and 1030 (76.3%) had complete data for mSIRS categorization. Provider gestalt classified 97 (7.2%) patients as healthy, 546 (40.4%) as mildly ill, 457 (33.9%) as moderately ill, and 250 (18.5%) as severely ill. Of the patients, classifiable by mSIRS, 411/1030 (39.9%) had ≥ 2 mSIRS criteria. In predicting 24-h mortality, the ≥ 2 mSIRS and gestalt "severely ill" had sensitivities of 82% and 81%, respectively, and specificity of 61% and 84%, respectively. In predicting overall in-hospital mortality, the ≥ 2 mSIRS and gestalt "severely ill" had sensitivities of 66% and 70% with a specificity of 62% and 86% respectively.ConclusionBoth the mSIRS and provider gestalt were highly specific for predicting 24-h and overall in-hospital mortality in our patient population. The clinical utility of these assessment methods is limited by the low positive predictive value.

Project description:IntroductionThe diagnostic performance of capillary ketonemia (CK) has been previously evaluated in context of pediatric acute gastroenteritis. To our knowledge, there is no literature on its performance in the setting of pediatric acute appendicitis (PAA).Materials and methodsIn this study, 151 patients were prospectively included and divided into two groups: (1) patients with non-surgical abdominal pain in whom the diagnosis of PAA was excluded (n = 53) and (2) patients with a confirmed diagnosis of PAA (n = 98). In 80 patients (Group 1, n = 23 and group 2, n = 57) a CK was measured at the time of diagnosis. The PAA group was further classified into complicated (n = 18) and uncomplicated PAA (n = 39). Quantitative variables were compared between groups using the Mann-Whitney U test. Diagnostic performance of CK was evaluated with ROC curves.ResultsCK values were 0.3 [0.1-0.9] mmol/L in group 1 and 0.7 [0.4-1.4] mmol/L in group 2 (p = 0.01). Regarding the type of PAA, CK values were 0.6 [0.4-0.9] mmol/L in uncomplicated PAA and 1.2 [0.8-1.4] mmol/L in complicated PAA (p = 0.02). The AUC for the discrimination between groups 1 and 2 was 0.68 (95% IC 0.53-0.82) (p = 0.24) and the AUC for the discrimination between uncomplicated PAA and complicated PAA was 0.69 (95% IC 0.54-0.85) (p = 0.04). The best cut-off point (group 1 vs group 2) resulted in 0.4 mmol/L, with a sensitivity of 80.7% and a specificity of 52.2%. The best cut-off point (non-complicated vs complicated PAA) resulted in 1.1 mmol/L, with a sensitivity of 61.1% and a specificity of 76.9%.ConclusionsThis study found significantly higher levels of CK in patients with PAA than in those with NSAP. Similarly, significantly higher levels were observed in patients with complicated than in those with uncomplicated PAA. Nevertheless, the diagnostic performance of CK was only moderate in the two settings analyzed. The potential usefulness of CK determination as a tool to guide the preoperative rehydration regimen of patients with PAA to prevent postoperative hyporexia and vomiting is a promising line of research and should be evaluated in future studies.

Project description:ImportanceDiagnostic acumen is a fundamental skill in the practice of medicine. Scalable, practical, and objective tools to assess diagnostic performance are lacking.ObjectiveTo validate a new method of assessing diagnostic performance that uses automated techniques to assess physicians' diagnostic performance on brief, open-ended case simulations.Design, setting, and participantsRetrospective cohort study of 11 023 unique attempts to solve case simulations on an online software platform, The Human Diagnosis Project (Human Dx). A total of 1738 practicing physicians, residents (internal medicine, family medicine, and emergency medicine), and medical students throughout the United States voluntarily used Human Dx software between January 21, 2016, and January 15, 2017.Main outcomes and measuresInternal structure validity was assessed by 3 measures of diagnostic performance: accuracy, efficiency, and a combined score (Diagnostic Acumen Precision Performance [DAPP]). These were each analyzed by level of training. Association with other variables' validity evidence was evaluated by correlating diagnostic performance and affiliation with an institution ranked in the top 25 medical schools by US News and World Report.ResultsData were analyzed for 239 attending physicians, 926 resident physicians, 347 intern physicians, and 226 medical students. Attending physicians had higher mean accuracy scores than medical students (difference, 8.1; 95% CI, 4.2-12.0; P < .001), as did residents (difference, 8.0; 95% CI, 4.8-11.2; P < .001) and interns (difference, 5.9; 95% CI, 2.3-9.6; P < .001). Attending physicians had higher mean efficiency compared with residents (difference, 4.8; 95% CI, 1.8-7.8; P < .001), interns (difference, 5.0; 95% CI, 1.5-8.4; P = .001), and medical students (difference, 5.4; 95% CI, 1.4-9.3; P = .003). Attending physicians also had significantly higher mean DAPP scores than residents (difference, 2.6; 95% CI, 0.0-5.2; P = .05), interns (difference, 3.6; 95% CI, 0.6-6.6; P = .01), and medical students (difference, 6.7; 95% CI, 3.3-10.2; P < .001). Attending physicians affiliated with a US News and World Report-ranked institution had higher mean DAPP scores compared with nonaffiliated attending physicians (80 [95% CI, 77-83] vs 72 [95% CI, 70-74], respectively; P < .001). Resident physicians affiliated with an institution ranked in the top 25 medical schools by US News and World Report also had higher mean DAPP scores compared with nonaffiliated peers (75 [95% CI, 73-77] vs 71 [95% CI, 69-72], respectively; P < .001).Conclusions and relevanceThe data suggest that diagnostic performance is higher in those with more training and that DAPP scores may be a valid measure to appraise diagnostic performance. This diagnostic assessment tool allows individuals to receive immediate feedback on performance through an openly accessible online platform.

Project description:BACKGROUND:No reliably specific method for complicated appendicitis has been identified in children younger than five years of age. This study aimed to analyze the independent factors for complicated appendicitis in children younger than five years of age, develop and validate a prediction model for the differentiation of simple and complicated appendicitis. METHODS:A retrospective study of 382 children younger than five years of age with acute appendicitis from January 2007 to December 2016 was conducted with assessments of demographic data, clinical symptoms and signs, and pre-operative laboratory results. According to intraoperative findings and postoperative pathological results, acute appendicitis was divided into simple and complicated appendicitis. Univariate and multivariate analyses were used to screen out the independent factors of complicated appendicitis, and develop a prediction model for complicated appendicitis. Then 156 such patients from January 2017 to December 2019 were collected as validation sample to validate the prediction model. Test performance of the prediction model was compared with the ALVARADO score and Pediatric Appendicitis Score (PAS). RESULTS:Of the 382 patients, 244 (63.9%) had complicated appendicitis. Age, white blood cell count, and duration of symptoms were the independent factors for complicated appendicitis in children younger than five years of age. The final predication model for complicated appendicitis included factors above. In validation sample, the prediction model exhibited a high degree of discrimination (area under the curve [AUC]: 0.830; 95% confidence interval [CI]: 0.762-0.885) corresponding to a optimal cutoff value of 0.62, and outperformed the PAS (AUC: 0.735; 95% CI: 0.658-0.802), ALVARADO score (AUC: 0.733; 95% CI: 0.657-0.801). CONCLUSION:Age, white blood cell count, and duration of symptoms could be used to predict complicated appendicitis in children younger than five years of age with acute appendicitis. The prediction model is a novel but promising method that aids in the differentiation of acute simple and complicated appendicitis.

Project description:BackgroundBurnout is a significant public health concern affecting more than half of the healthcare workforce; however, passive screening tools to detect burnout are lacking. We investigated the ability of machine learning (ML) techniques to identify burnout using passively collected electronic health record (EHR)-based audit log data.MethodPhysician trainees participated in a longitudinal study where they completed monthly burnout surveys and provided access to their EHR-based audit logs. Using the monthly burnout scores as the target outcome, we trained ML models using combinations of features derived from audit log data-aggregate measures of clinical workload, time series-based temporal measures of EHR use, and the baseline burnout score. Five ML models were constructed to predict burnout as a continuous score: penalized linear regression, support vector machine, neural network, random forest, and gradient boosting machine.Results88 trainee physicians participated and completed 416 surveys; greater than10 million audit log actions were collected (Mean [Standard Deviation] = 25,691 [14,331] actions per month, per physician). The workload feature set predicted burnout score with a mean absolute error (MAE) of 0.602 (95% Confidence Interval (CI), 0.412-0.826), and was able to predict burnout status with an average AUROC of 0.595 (95% CI 0.355-0.808) and average accuracy 0.567 (95% CI 0.393-0.742). The temporal feature set had a similar performance, with MAE 0.596 (95% CI 0.391-0.826), and AUROC 0.581 (95% CI 0.343-0.790). The addition of the baseline burnout score to the workload features improved the model performance to a mean AUROC of 0.829 (95% CI 0.607-0.996) and mean accuracy of 0.781 (95% CI 0.587-0.936); however, this performance was not meaningfully different than using the baseline burnout score alone.ConclusionsCurrent findings illustrate the complexities of predicting burnout exclusively based on clinical work activities as captured in the EHR, highlighting its multi-factorial and individualized nature. Future prediction studies of burnout should account for individual factors (e.g., resilience, physiological measurements such as sleep) and associated system-level factors (e.g., leadership).