Dataset Information

Validation of chief complaints, medical history, medications, and physician diagnoses structured with an integrated emergency department information system in Japan: the Next Stage ER system.

ABSTRACT: Aim:Emergency department information systems (EDIS) facilitate free-text data use for clinical research; however, no study has validated whether the Next Stage ER system (NSER), an EDIS used in Japan, accurately translates electronic medical records (EMRs) into structured data. Methods:This is a retrospective cohort study using data from the emergency department (ED) of a tertiary care hospital from 2018 to 2019. We used EMRs of 500 random samples from 27,000 ED visits during the study period. Through the NSER system, chief complaints were translated into 231 chief complaint categories based on the Japan Triage and Acuity Scale. Medical history and physician's diagnoses were encoded using the International Classification of Diseases, 10th Revision; medications were encoded as Anatomical Therapeutic Chemical Classification System codes. Two reviewers independently reviewed 20 items (e.g., presence of fever) for each study component (e.g., chief complaints). We calculated association measures of the structured data by the NSER system, using the chart review results as the gold standard. Results:Sensitivities were very high (>90%) in 17 chief complaints. Positive predictive values were high for 14 chief complaints (?80%). Negative predictive values were ?96% for all chief complaints. For medical history and medications, most of the association measures were very high (>90%). For physicians' ED diagnoses, sensitivities were very high (>93%) in 16 diagnoses; specificities and negative predictive values were very high (>97%). Conclusions:Chief complaints, medical history, medications, and physician's ED diagnoses in EMRs were well-translated into existing categories or coding by the NSER system.

SUBMITTER: Goto T

PROVIDER: S-EPMC7453131 | biostudies-literature | 2020 Jan-Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of chief complaints, medical history, medications, and physician diagnoses structured with an integrated emergency department information system in Japan: the Next Stage ER system.

Goto Tadahiro T Hara Konan K Hashimoto Katsuhiko K Soeno Shoko S Shirakawa Toru T Sonoo Tomohiro T Nakamura Kensuke K

Acute medicine & surgery 20200101 1

<h4>Aim</h4>Emergency department information systems (EDIS) facilitate free-text data use for clinical research; however, no study has validated whether the Next Stage ER system (NSER), an EDIS used in Japan, accurately translates electronic medical records (EMRs) into structured data.<h4>Methods</h4>This is a retrospective cohort study using data from the emergency department (ED) of a tertiary care hospital from 2018 to 2019. We used EMRs of 500 random samples from 27,000 ED visits during the ...[more]

PMID: 32884825

Similar Datasets

Project description:Objective:We learn contextual embeddings for emergency department (ED) chief complaints using Bidirectional Encoder Representations from Transformers (BERT), a state-of-the-art language model, to derive a compact and computationally useful representation for free-text chief complaints. Materials and methods:Retrospective data on 2.1 million adult and pediatric ED visits was obtained from a large healthcare system covering the period of March 2013 to July 2019. A total of 355 497 (16.4%) visits from 65 737 (8.9%) patients were removed for absence of either a structured or unstructured chief complaint. To ensure adequate training set size, chief complaint labels that comprised less than 0.01%, or 1 in 10 000, of all visits were excluded. The cutoff threshold was incremented on a log scale to create seven datasets of decreasing sparsity. The classification task was to predict the provider-assigned label from the free-text chief complaint using BERT, with Long Short-Term Memory (LSTM) and Embeddings from Language Models (ELMo) as baselines. Performance was measured as the Top-k accuracy from k?=?1:5 on a hold-out test set comprising 5% of the samples. The embedding for each free-text chief complaint was extracted as the final 768-dimensional layer of the BERT model and visualized using t-distributed stochastic neighbor embedding (t-SNE). Results:The models achieved increasing performance with datasets of decreasing sparsity, with BERT outperforming both LSTM and ELMo. The BERT model yielded Top-1 accuracies of 0.65 and 0.69, Top-3 accuracies of 0.87 and 0.90, and Top-5 accuracies of 0.92 and 0.94 on datasets comprised of 434 and 188 labels, respectively. Visualization using t-SNE mapped the learned embeddings in a clinically meaningful way, with related concepts embedded close to each other and broader types of chief complaints clustered together. Discussion:Despite the inherent noise in the chief complaint label space, the model was able to learn a rich representation of chief complaints and generate reasonable predictions of their labels. The learned embeddings accurately predict provider-assigned chief complaint labels and map semantically similar chief complaints to nearby points in vector space. Conclusion:Such a model may be used to automatically map free-text chief complaints to structured fields and to assist the development of a standardized, data-driven ontology of chief complaints for healthcare institutions.

Project description:With the continuing coronavirus disease 2019 (COVID-19) pandemic coupled with phased reopening, it is critical to identify risk factors associated with susceptibility and severity of disease in a diverse population to help shape government policies, guide clinical decision making, and prioritize future COVID-19 research. In this retrospective case-control study, we used de-identified electronic health records (EHR) from the University of California Los Angeles (UCLA) Health System between March 9th, 2020 and June 14th, 2020 to identify risk factors for COVID-19 susceptibility (severe acute respiratory distress syndrome coronavirus 2 (SARS-CoV-2) PCR test positive), inpatient admission, and severe outcomes (treatment in an intensive care unit or intubation). Of the 26,602 individuals tested by PCR for SARS-CoV-2, 992 were COVID-19 positive (3.7% of Tested), 220 were admitted in the hospital (22% of COVID-19 positive), and 77 had a severe outcome (35% of Inpatient). Consistent with previous studies, males and individuals older than 65 years old had increased risk of inpatient admission. Notably, individuals self-identifying as Hispanic or Latino constituted an increasing percentage of COVID-19 patients as disease severity escalated, comprising 24% of those testing positive, but 40% of those with a severe outcome, a disparity that remained after correcting for medical comorbidities. Cardiovascular disease, hypertension, and renal disease were premorbid risk factors present before SARS-CoV-2 PCR testing associated with COVID-19 susceptibility. Less well-established risk factors for COVID-19 susceptibility included pre-existing dementia (odds ratio (OR) 5.2 [3.2-8.3], p=2.6 x 10-10), mental health conditions (depression OR 2.1 [1.6-2.8], p=1.1 x 10-6) and vitamin D deficiency (OR 1.8 [1.4-2.2], p=5.7 x 10-6). Renal diseases including end-stage renal disease and anemia due to chronic renal disease were the predominant premorbid risk factors for COVID-19 inpatient admission. Other less established risk factors for COVID-19 inpatient admission included previous renal transplant (OR 9.7 [2.8-39], p=3.2x10-4) and disorders of the immune system (OR 6.0 [2.3, 16], p=2.7x10-4). Prior use of oral steroid medications was associated with decreased COVID-19 positive testing risk (OR 0.61 [0.45, 0.81], p=4.3x10-4), but increased inpatient admission risk (OR 4.5 [2.3, 8.9], p=1.8x10-5). We did not observe that prior use of angiotensin converting enzyme inhibitors or angiotensin receptor blockers increased the risk of testing positive for SARS-CoV-2, being admitted to the hospital, or having a severe outcome. This study involving direct EHR extraction identified known and less well-established demographics, and prior diagnoses and medications as risk factors for COVID-19 susceptibility and inpatient admission. Knowledge of these risk factors including marked ethnic disparities observed in disease severity should guide government policies, identify at-risk populations, inform clinical decision making, and prioritize future COVID-19 research.

Project description:IntroductionPatients with mental health diagnoses (MHD) are among the most frequent emergency department (ED) users, suggesting the importance of identifying additional factors associated with their ED use frequency. In this study we assessed various patient sociodemographic and clinical characteristics, and service use associated with low ED users (1-3 visits/year), compared to high (4-7) and very high (8+) ED users with MHD.MethodsOur study was conducted in four large Quebec (Canada) ED networks. A total of 299 patients with MHD were randomly recruited from these ED in 2021-2022. Structured interviews complemented data from network health records, providing extensive data on participant profiles and their quality of care. We used multivariable multinomial logistic regression to compare low ED use to high and very high ED use.ResultsOver a 12-month period, 39% of patients were low ED users, 37% high, and 24% very high ED users. Compared with low ED users, those at greater probability for high or very high ED use exhibited more violent/disturbed behaviors or social problems, chronic physical illnesses, and barriers to unmet needs. Patients previously hospitalized 1-2 times had lower risk of high or very high ED use than those not previously hospitalized. Compared with low ED users, high and very high ED users showed higher prevalence of personality disorders and suicidal behaviors, respectively. Women had greater probability of high ED use than men. Patients living in rental housing had greater probability of being very high ED users than those living in private housing. Using at least 5+ primary care services and being recurrent ED users two years prior to the last year of ED use had increased probability of very high ED use.ConclusionFrequency of ED use was associated with complex issues and higher perceived barriers to unmet needs among patients. Very high ED users had more severe recurrent conditions, such as isolation and suicidal behaviors, despite using more primary care services. Results suggested substantial reduction of barriers to care and improvement on both access and continuity of care for these vulnerable patients, integrating crisis resolution and supported housing services. Limited hospitalizations may sometimes be indicated, protecting against ED use.

Project description:BACKGROUND:Nonspecific complaint (NSC) is a common presenting complaint in the emergency setting, especially in the elderly population. Individual studies have shown that it is associated with significant morbidity and mortality. This prognostic systematic review draws a synthesis of reported outcomes for patients presenting with NSC and compares them with outcomes for patients presenting with a specific complaint. METHODS:We conducted a literature search for publications, abstracts and conference presentations from Ovid, Scopus and Web of Science for the past 20?years. Studies were included which treated adult patients presenting to the Emergency Medical Services or Emergency Department with NSC. 2599 studies were screened for eligibility and quality was assessed using the SIGN assessment for bias tool. We excluded any low-quality studies, resulting in nine studies for quantitative analysis. We analysed the included studies for in-hospital mortality, triage category, emergency department length of stay, admission rate, hospital length of stay, intensive care admissions and re-visitation rate and compared outcomes to patients presenting with specific complaints (SC), where data were available. We grouped discharge diagnoses by ICD-10 category. RESULTS:We found that patients presenting with NSC were mostly older adults. Mortality for patients with NSC was significantly increased compared to patients presenting with SC [OR 2.50 (95% CI 1.40-4.47)]. They were triaged as urgent less often than SC patients [OR 2.12 (95% CI 1.08-4.16)]. Emergency department length of stay was increased in two out of three studies. Hospital length of stay was increased by 1-3?days. Admission rates were high in most studies, 55 to 84%, and increased in comparison to patients with SC [OR 3.86 (95% CI 1.76-8.47)]. These patients seemed to require more resources than patients with SC. The number for intensive care admissions did not seem to be increased. Data were insufficient to make conclusions regarding re-visitation rates. Discharge diagnoses were spread throughout the ICD-10 main chapters, infections being the most prevalent. CONCLUSIONS:Patients with NSC have a high risk of mortality and their care in the Emergency Department requires more time and resources than for patients with SC. We suggest that NSC should be considered a major emergency presentation.

Project description:ImportanceEvaluation of trainees in graduate medical education training programs using Milestones has been in place since 2013. It is not known whether trainees who have lower ratings during the last year of training go on to have concerns related to interactions with patients in posttraining practice.ObjectiveTo investigate the association between resident Milestone ratings and posttraining patient complaints.Design, setting, and participantsThis retrospective cohort study included physicians who completed Accreditation Council for Graduate Medical Education (ACGME)-accredited programs between July 1, 2015, and June 30, 2019, and worked at a site that participated in the national Patient Advocacy Reporting System (PARS) program for at least 1 year. Milestone ratings from ACGME training programs and patient complaint data from PARS were collected. Data analysis was conducted from March 2022 to February 2023.ExposuresLowest professionalism (P) and interpersonal and communication skills (ICS) Milestones ratings 6 months prior to the end of training.Main outcomes and measuresPARS year 1 index scores, based on recency and severity of complaints.ResultsThe cohort included 9340 physicians with median (IQR) age of 33 (31-35) years; 4516 (48.4%) were women physicians. Overall, 7001 (75.0%) had a PARS year 1 index score of 0, 2023 (21.7%) had a score of 1 to 20 (moderate), and 316 (3.4%) had a score of 21 or greater (high). Among physicians in the lowest Milestones group, 34 of 716 (4.7%) had high PARS year 1 index scores, while 105 of 3617 (2.9%) with Milestone ratings of 4.0 (proficient), had high PARS year 1 index scores. In a multivariable ordinal regression model, physicians in the 2 lowest Milestones rating groups (0-2.5 and 3.0-3.5) were statistically significantly more likely to have higher PARS year 1 index scores than the reference group with Milestones ratings of 4.0 (0-2.5 group: odds ratio, 1.2 [95% CI, 1.0-1.5]; 3.0-3.5 group: odds ratio, 1.2 [95% CI, 1.1-1.3]).Conclusions and relevanceIn this study, trainees with low Milestone ratings in P and ICS near the end of residency were at increased risk for patient complaints in their early posttraining independent physician practice. Trainees with lower Milestone ratings in P and ICS may need more support during graduate medical education training or in the early part of their posttraining practice career.

Dataset Information

Validation of chief complaints, medical history, medications, and physician diagnoses structured with an integrated emergency department information system in Japan: the Next Stage ER system.

Publications

Validation of chief complaints, medical history, medications, and physician diagnoses structured with an integrated emergency department information system in Japan: the Next Stage ER system.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets