Dataset Information

Use of natural language processing to improve predictive models for imaging utilization in children presenting to the emergency department.

ABSTRACT: OBJECTIVE:To examine the association between the medical imaging utilization and information related to patients' socioeconomic, demographic and clinical factors during the patients' ED visits; and to develop predictive models using these associated factors including natural language elements to predict the medical imaging utilization at pediatric ED. METHODS:Pediatric patients' data from the 2012-2016 United States National Hospital Ambulatory Medical Care Survey was included to build the models to predict the use of imaging in children presenting to the ED. Multivariable logistic regression models were built with structured variables such as temperature, heart rate, age, and unstructured variables such as reason for visit, free text nursing notes and combined data available at triage. NLP techniques were used to extract information from the unstructured data. RESULTS:Of the 27,665 pediatric ED visits included in the study, 8394 (30.3%) received medical imaging in the ED, including 6922 (25.0%) who had an X-ray and 1367 (4.9%) who had a computed tomography (CT) scan. In the predictive model including only structured variables, the c-statistic was 0.71 (95% CI: 0.70-0.71) for any imaging use, 0.69 (95% CI: 0.68-0.70) for X-ray, and 0.77 (95% CI: 0.76-0.78) for CT. Models including only unstructured information had c-statistics of 0.81 (95% CI: 0.81-0.82) for any imaging use, 0.82 (95% CI: 0.82-0.83) for X-ray, and 0.85 (95% CI: 0.83-0.86) for CT scans. When both structured variables and free text variables were included, the c-statistics reached 0.82 (95% CI: 0.82-0.83) for any imaging use, 0.83 (95% CI: 0.83-0.84) for X-ray, and 0.87 (95% CI: 0.86-0.88) for CT. CONCLUSIONS:Both CT and X-rays are commonly used in the pediatric ED with one third of the visits receiving at least one. Patients' socioeconomic, demographic and clinical factors presented at ED triage period were associated with the medical imaging utilization. Predictive models combining structured and unstructured variables available at triage performed better than models using structured or unstructured variables alone, suggesting the potential for use of NLP in determining resource utilization.

SUBMITTER: Zhang X

PROVIDER: S-EPMC6937987 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Emergency department triage is the first point in time when a patient's acuity level is determined. The time to assign a priority at triage is short and it is vital to accurately stratify patients at this stage, since under-triage can lead to increased morbidity, mortality and costs. Our aim was to present a model that can assist healthcare professionals in triage decision making, namely in the stratification of patients through the risk prediction of a composite critical outcome-mortality and cardiopulmonary arrest. Our study cohort consisted of 235826 adult patients triaged at a Portuguese Emergency Department from 2012 to 2016. Patients were assigned to emergent, very urgent or urgent priorities of the Manchester Triage System (MTS). Demographics, clinical variables routinely collected at triage and the patients' chief complaint were used. Logistic regression, random forests and extreme gradient boosting were developed using all available variables. The term frequency-inverse document frequency (TF-IDF) natural language processing weighting factor was applied to vectorize the chief complaint. Stratified random sampling was used to split the data into train (70%) and test (30%) data sets. Ten-fold cross validation was performed in train to optimize model hyper-parameters. The performance obtained with the best model was compared against the reference model-a regularized logistic regression trained using only triage priorities. Extreme gradient boosting exhibited good calibration properties and yielded areas under the receiver operating characteristic and precision-recall curves of 0.96 (95% CI 0.95-0.97) and 0.31 (95% CI 0.26-0.36), respectively. The predictors ranked with higher importance by this model were the Glasgow coma score, the patients' age, pulse oximetry and arrival mode. Compared to the reference, the extreme gradient boosting model using clinical variables and the chief complaint presented higher recall for patients assigned MTS-3 and can identify those who are at risk of the composite outcome.

Project description:ObjectivesVeteran persons living with dementia (PLWDs) have high acute care utilization. We aim to understand why PLWDs seek care in the emergency department (ED) and how their utilization differs from older Veterans with no dementia diagnosis. We demonstrate the use of a novel national chief complaint data set in the Veteran Affairs Health Care System.MethodsThis was a retrospective observational study of ED users 65 years or older as of FY2017. The primary outcome is presence of one or more ED visits in FYs 2017-2018 using a logistic regression model controlling for dementia and other variables. Secondary outcomes include counts of ED visits by disposition, Emergency Severity Index, chief complaints defined by a natural language processing program, and ED encounter diagnoses defined by primary International Statistical Classification of Diseases, Tenth Revision (ICD-10-CM) code.ResultsOur cohort of Veterans comprised 3,115,263 patients. Of those, 255,372 (8.2%) had a diagnosis of dementia. Logistic regression modeling demonstrated that dementia is a significant predictor of ED use (p < 0.0001), with PLWDs more likely to have an ED visit (odds ratio 1.96, 95% confidence interval 1.94-1.98). PLWDs were admitted at higher rates when accounting for age and acuity. Chief complaints that were more common among PLWDs included falls (6.7% dementia vs. 3.3% without dementia), weakness (3.6% vs. 2.2%), and abnormal mental state (2.2% vs. 0.4%). ICD-10-CM codes were largely similar between the two groups.ConclusionsOur results reinforce that the ED is a common access point for Veterans with dementia. These patients require special consideration as they are more likely to visit the ED and be admitted. Our use of a novel national chief complaint data set suggests that they more commonly present with certain geriatric syndromes and nonspecific complaints. Further work is needed to determine whether these would warrant targeted interventions to improve quality of acute care.

Project description:BackgroundEmergency department (ED) crowding is associated with negative health outcomes, patient dissatisfaction, and longer length of stay (LOS). The addition of advanced diagnostic imaging (ADI), namely CT, ultrasound (U/S), and MRI to ED encounter work up is a predictor of longer length of stay. Earlier and improved prediction of patients' need for advanced imaging may improve overall ED efficiency. The aim of the study was to detect the association between ADI utilization and the structured and unstructured information immediately available during ED triage, and to develop and validate models to predict utilization of ADI during an ED encounter.MethodsWe used the United States National Hospital Ambulatory Medical Care Survey data from 2009 to 2014 to examine which sociodemographic and clinical factors immediately available at ED triage were associated with the utilization of CT, U/S, MRI, and multiple ADI during a patient's ED stay. We used natural language processing (NLP) topic modeling to incorporate free-text reason for visit data available at time of ED triage in addition to other structured patient data to predict the use of ADI using multivariable logistic regression models.ResultsAmong the 139,150 adult ED visits from a national probability sample of hospitals across the U.S, 21.9% resulted in ADI use, including 16.8% who had a CT, 3.6% who had an ultrasound, 0.4% who had an MRI, and 1.2% of the population who had multiple types of ADI. The c-statistic of the predictive models was greater than or equal to 0.78 for all imaging outcomes, and the addition of text-based reason for visit information improved the accuracy of all predictive models.ConclusionsPatient information immediately available during ED triage can accurately predict the eventual use of advanced diagnostic imaging during an ED visit. Such models have the potential to be incorporated into the ED triage workflow in order to more rapidly identify patients who may require advanced imaging during their ED stay and assist with medical decision-making.

Project description:Leukostasis is a life-threatening complication of acute hyperleukocytic leukemia, and is associated with substantial mortality. Management of leukostasis requires time-sensitive diagnostics and therapeutics, and leukapheresis remains a mainstay of treatment in select patients. Leukapheresis requires coordination of multi-disciplinary resources, which can prove challenging in the emergency department setting, and delays in treatment due to the complexity and coordination required are common. The objective of this study was to assess the effect of utilization of an emergency department-ICU and a multidisciplinary care pathway on outcomes of critically ill leukostasis patients presenting to the emergency department.DesignRetrospective cohort study.SettingSingle large academic medical center in the United States.PatientsAdult emergency department patients with signs and symptoms of leukostasis requiring emergent leukapheresis from 2012-2019.InterventionsImplementation of a hybrid emergency department-ICU setting (emergency critical care center) and a multidisciplinary care pathway with members from Emergency Medicine, Hematology, Blood Bank, and Clinical Pathology.Measurements and main resultsA total of 70 patients were identified and included for analysis: 14 preemergency critical care center; 32 postemergency critical care center, premultidisciplinary care pathway; and 24 postemergency critical care center, postmultidisciplinary care pathway. A statistically significant reduction in the time from emergency department presentation to initiation of leukapheresis was observed from preemergency critical care center to postemergency critical care center, premultidisciplinary care pathway and postemergency critical care center, postmultidisciplinary care pathway (11.5 vs 7.9 vs 7.7 hr; p = 0.004). Statistically significant reductions in in-hospital mortality were observed from preemergency critical care center to postemergency critical care center, premultidisciplinary care pathway and postemergency critical care center, postmultidisciplinary care pathway (64.3% vs 21.9% vs 25.0%; p = 0.01). A trend toward decreased inpatient ICU utilization was observed, although was not statistically significant (35.7% vs 12.5% vs 25.0%; p = 0.14.).Conclusions and relevanceImplementation of a multidisciplinary care pathway via use of an emergency department-ICU for critically ill patients with leukostasis was associated with statistically significant reductions in time to leukapheresis and in-hospital mortality. These findings suggest an emergency department-ICU model may allow for maximal resource and care coordination at the point of contact with critically ill patients and improved clinical outcomes.

Project description:BackgroundPeripheral artery disease (PAD) is underrecognized, undertreated, and understudied: each of these endeavors requires efficient and accurate identification of patients with PAD. Currently, PAD patient identification relies on diagnosis/procedure codes or lists of patients diagnosed or treated by specific providers in specific locations and ways. The goal of this research was to leverage natural language processing to more accurately identify patients with PAD in an electronic health record system compared with a structured data-based approach.MethodsThe clinical notes from a cohort of 6861 patients in our health system whose PAD status had previously been adjudicated were used to train, test, and validate a natural language processing model using 10-fold cross-validation. The performance of this model was described using the area under the receiver operating characteristic and average precision curves; its performance was quantitatively compared with an administrative data-based least absolute shrinkage and selection operator (LASSO) approach using the DeLong test.ResultsThe median (SD) of the area under the receiver operating characteristic curve for the natural language processing model was 0.888 (0.009) versus 0.801 (0.017) for the LASSO-based approach alone (DeLong P<0.0001). The median (SD) of the area under the precision curve was 0.909 (0.008) versus 0.816 (0.012) for the structured data-based approach. When sensitivity was set at 90%, the precision for LASSO was 65% and the machine learning approach was 74%, while the specificity for LASSO was 41% and for the machine learning approach was 62%.ConclusionsUsing a natural language processing approach in addition to partial cohort preprocessing with a LASSO-based model, we were able to meaningfully improve our ability to identify patients with PAD compared with an approach using structured data alone. This model has potential applications to both interventions targeted at improving patient care as well as efficient, large-scale PAD research. Graphic Abstract: A graphic abstract is available for this article.

Dataset Information

Use of natural language processing to improve predictive models for imaging utilization in children presenting to the emergency department.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets