Dataset Information

Using Neural Networks with Routine Health Records to Identify Suicide Risk: Feasibility Study.

ABSTRACT:

Background

Each year, approximately 800,000 people die by suicide worldwide, accounting for 1-2 in every 100 deaths. It is always a tragic event with a huge impact on family, friends, the community and health professionals. Unfortunately, suicide prevention and the development of risk assessment tools have been hindered by the complexity of the underlying mechanisms and the dynamic nature of a person's motivation and intent. Many of those who die by suicide had contact with health services in the preceding year but identifying those most at risk remains a challenge.

Objective

To explore the feasibility of using artificial neural networks with routinely collected electronic health records to support the identification of those at high risk of suicide when in contact with health services.

Methods

Using the Secure Anonymised Information Linkage Databank UK, we extracted the data of those who died by suicide between 2001 and 2015 and paired controls. Looking at primary (general practice) and secondary (hospital admissions) electronic health records, we built a binary feature vector coding the presence of risk factors at different times prior to death. Risk factors included: general practice contact and hospital admission; diagnosis of mental health issues; injury and poisoning; substance misuse; maltreatment; sleep disorders; and the prescription of opiates and psychotropics. Basic artificial neural networks were trained to differentiate between the suicide cases and paired controls. We interpreted the output score as the estimated suicide risk. System performance was assessed with 10x10-fold repeated cross-validation, and its behavior was studied by representing the distribution of estimated risk across the cases and controls, and the distribution of factors across estimated risks.

Results

We extracted a total of 2604 suicide cases and 20 paired controls per case. Our best system attained a mean error rate of 26.78% (SD 1.46; 64.57% of sensitivity and 81.86% of specificity). While the distribution of controls was concentrated around estimated risks < 0.5, cases were almost uniformly distributed between 0 and 1. Prescription of psychotropics, depression and anxiety, and self-harm increased the estimated risk by ~0.4. At least 95% of those presenting these factors were identified as suicide cases.

Conclusions

Despite the simplicity of the implemented system, the proposed methodology obtained an accuracy like other published methods based on specialized questionnaire generated data. Most of the errors came from the heterogeneity of patterns shown by suicide cases, some of which were identical to those of the paired controls. Prescription of psychotropics, depression and anxiety, and self-harm were strongly linked with higher estimated risk scores, followed by hospital admission and long-term drug and alcohol misuse. Other risk factors like sleep disorders and maltreatment had more complex effects.

SUBMITTER: DelPozo-Banos M

PROVIDER: S-EPMC6035342 | biostudies-literature | 2018 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using Neural Networks with Routine Health Records to Identify Suicide Risk: Feasibility Study.

DelPozo-Banos Marcos M John Ann A Petkov Nicolai N Berridge Damon Mark DM Southern Kate K LLoyd Keith K Jones Caroline C Spencer Sarah S Travieso Carlos Manuel CM

JMIR mental health 20180622 2

<h4>Background</h4>Each year, approximately 800,000 people die by suicide worldwide, accounting for 1-2 in every 100 deaths. It is always a tragic event with a huge impact on family, friends, the community and health professionals. Unfortunately, suicide prevention and the development of risk assessment tools have been hindered by the complexity of the underlying mechanisms and the dynamic nature of a person's motivation and intent. Many of those who die by suicide had contact with health servic ...[more]

PMID: 29934287

Similar Datasets

Project description:OBJECTIVE:The authors sought to develop and validate models using electronic health records to predict suicide attempt and suicide death following an outpatient visit. METHOD:Across seven health systems, 2,960,929 patients age 13 or older (mean age, 46 years; 62% female) made 10,275,853 specialty mental health visits and 9,685,206 primary care visits with mental health diagnoses between Jan. 1, 2009, and June 30, 2015. Health system records and state death certificate data identified suicide attempts (N=24,133) and suicide deaths (N=1,240) over 90 days following each visit. Potential predictors included 313 demographic and clinical characteristics extracted from records for up to 5 years before each visit: prior suicide attempts, mental health and substance use diagnoses, medical diagnoses, psychiatric medications dispensed, inpatient or emergency department care, and routinely administered depression questionnaires. Logistic regression models predicting suicide attempt and death were developed using penalized LASSO (least absolute shrinkage and selection operator) variable selection in a random sample of 65% of the visits and validated in the remaining 35%. RESULTS:Mental health specialty visits with risk scores in the top 5% accounted for 43% of subsequent suicide attempts and 48% of suicide deaths. Of patients scoring in the top 5%, 5.4% attempted suicide and 0.26% died by suicide within 90 days. C-statistics (equivalent to area under the curve) for prediction of suicide attempt and suicide death were 0.851 (95% CI=0.848, 0.853) and 0.861 (95% CI=0.848, 0.875), respectively. Primary care visits with scores in the top 5% accounted for 48% of subsequent suicide attempts and 43% of suicide deaths. C-statistics for prediction of suicide attempt and suicide death were 0.853 (95% CI=0.849, 0.857) and 0.833 (95% CI=0.813, 0.853), respectively. CONCLUSIONS:Prediction models incorporating both health record data and responses to self-report questionnaires substantially outperform existing suicide risk prediction tools.

Project description:BackgroundSuicide is a serious public health issue, accounting for 1.4% of all deaths worldwide. Current risk assessment tools are reported as performing little better than chance in predicting suicide. New methods for studying dynamic features in electronic health records (EHRs) are being increasingly explored. One avenue of research involves using sentiment analysis to examine clinicians' subjective judgments when reporting on patients. Several recent studies have used general-purpose sentiment analysis tools to automatically identify negative and positive words within EHRs to test correlations between sentiment extracted from the texts and specific medical outcomes (eg, risk of suicide or in-hospital mortality). However, little attention has been paid to analyzing the specific words identified by general-purpose sentiment lexicons when applied to EHR corpora.ObjectiveThis study aims to quantitatively and qualitatively evaluate the coverage of six general-purpose sentiment lexicons against a corpus of EHR texts to ascertain the extent to which such lexical resources are fit for use in suicide risk assessment.MethodsThe data for this study were a corpus of 198,451 EHR texts made up of two subcorpora drawn from a 1:4 case-control study comparing clinical notes written over the period leading up to a suicide attempt (cases, n=2913) with those not preceding such an attempt (controls, n=14,727). We calculated word frequency distributions within each subcorpus to identify representative keywords for both the case and control subcorpora. We quantified the relative coverage of the 6 lexicons with respect to this list of representative keywords in terms of weighted precision, recall, and F score.ResultsThe six lexicons achieved reasonable precision (0.53-0.68) but very low recall (0.04-0.36). Many of the most representative keywords in the suicide-related (case) subcorpus were not identified by any of the lexicons. The sentiment-bearing status of these keywords for this use case is thus doubtful.ConclusionsOur findings indicate that these 6 sentiment lexicons are not optimal for use in suicide risk assessment. We propose a set of guidelines for the creation of more suitable lexical resources for distinguishing suicide-related from non-suicide-related EHR texts.

Project description:BackgroundIndividualising mental healthcare at times when a patient is most at risk of suicide involves shifting research emphasis from static risk factors to those that may be modifiable with interventions. Currently, risk assessment is based on a range of extensively reported stable risk factors, but critical to dynamic suicide risk assessment is an understanding of each individual patient's health trajectory over time. The use of electronic health records (EHRs) and analysis using machine learning has the potential to accelerate progress in developing early warning indicators.SettingEHR data from the South London and Maudsley NHS Foundation Trust (SLaM) which provides secondary mental healthcare for 1.8 million people living in four South London boroughs.ObjectivesTo determine whether the time window proximal to a hospitalised suicide attempt can be discriminated from a distal period of lower risk by analysing the documentation and mental health clinical free text data from EHRs and (i) investigate whether the rate at which EHR documents are recorded per patient is associated with a suicide attempt; (ii) compare document-level word usage between documents proximal and distal to a suicide attempt; and (iii) compare n-gram frequency related to third-person pronoun use proximal and distal to a suicide attempt using machine learning.MethodsThe Clinical Record Interactive Search (CRIS) system allowed access to de-identified information from the EHRs. CRIS has been linked with Hospital Episode Statistics (HES) data for Admitted Patient Care. We analysed document and event data for patients who had at some point between 1 April 2006 and 31 March 2013 been hospitalised with a HES ICD-10 code related to attempted suicide (X60-X84; Y10-Y34; Y87.0/Y87.2).Findingsn = 8,247 patients were identified to have made a hospitalised suicide attempt. Of these, n = 3,167 (39.8%) of patients had at least one document available in their EHR prior to their first suicide attempt. N = 1,424 (45.0%) of these patients had been "monitored" by mental healthcare services in the past 30 days. From 60 days prior to a first suicide attempt, there was a rapid increase in the monitoring level (document recording of the past 30 days) increasing from 35.1 to 45.0%. Documents containing words related to prescribed medications/drugs/overdose/poisoning/addiction had the highest odds of being a risk indicator used proximal to a suicide attempt (OR 1.88; precision 0.91 and recall 0.93), and documents with words citing a care plan were associated with the lowest risk for a suicide attempt (OR 0.22; precision 1.00 and recall 1.00). Function words, word sequence, and pronouns were most common in all three representations (uni-, bi-, and tri-gram).ConclusionEHR documentation frequency and language use can be used to distinguish periods distal from and proximal to a suicide attempt. However, in our study 55.0% of patients with documentation, prior to their first suicide attempt, did not have a record in the preceding 30 days, meaning that there are a high number who are not seen by services at their most vulnerable point.

Project description:Background: Drug-induced coagulopathy (DIC) is a severe adverse reaction and has become a significantly increased clinical problem in children. It is crucial to the detection of the DIC safety signal for drug post-marketing scientific supervision purposes. Therefore, this study aimed to detect potential signals for DIC in children using the routine electronic medical record (EMR) data. Methods: This study extracted EMR data from Beijing Children's Hospital between 2009 and 2020. A two-stage modeling method was developed to detect the signal of DIC. We calculated the crude incidence by mining cases of coagulopathy to select the potential suspected drugs; then, propensity score-matched retrospective cohorts of specific screened drugs from the first stage were constructed and estimated the odds ratio (OR) and 95% confidence interval (CI) using conditional logistic regression models. The current literature evidence was used to assess the novelty of the signal. Results:In the study, from a total of 340 drugs, 22 drugs were initially screened as potentially inducing coagulopathy. In total, we identified 19 positive DIC associations. Of these, potential DIC risk of omeprazole (OR: 2.23, 95% CI: 1.88-2.65), chlorpheniramine (OR:3.04, 95% CI:2.56-3.60), and salbutamol sulfate (OR:1.36, 95% CI:1.07-1.73) were three new DIC signals in both children and adults. Twelve associations between coagulopathy and drugs, meropenem (OR: 3.38, 95% CI: 2.72-4.20), cefoperazone sulbactam (OR: 2.80, 95% CI: 2.30-3.41), fluconazole (OR: 2.11, 95% CI: 1.71-2.59), voriconazole (OR: 2.82, 95% CI: 2.20-3.61), ambroxol hydrochloride (OR: 2.12, 95% CI: 1.74-2.58), furosemide (OR: 2.36, 95% CI: 2.08-2.67), iodixanol (OR: 2.21, 95% CI: 1.72-2.85), cefamandole (OR: 1.82, 95% CI: 1.56-2.13), ceftizoxime (OR: 1.95, 95% CI: 1.44-2.63), ceftriaxone (OR: 1.95, 95% CI: 1.44-2.63), latamoxef sodium (OR: 1.76, 95% CI: 1.49-2.07), and sulfamethoxazole (OR: 1.29, 95% CI: 1.01-1.64), were considered as new signals in children. Conclusion: The two-stage algorithm developed in our study to detect safety signals of DIC found nineteen signals of DIC, including twelve new signals in a pediatric population. However, these safety signals of DIC need to be confirmed by further studies based on population study and mechanism research.

Project description:BackgroundHospital antimicrobial stewardship (AMS) programmes are multidisciplinary initiatives to optimize antimicrobial use. Most hospitals depend on time-consuming manual audits to monitor clinicians' prescribing. But much of the information needed could be sourced from electronic health records (EHRs).ObjectivesTo develop an informatics methodology to analyse characteristics of hospital AMS practice using routine electronic prescribing and laboratory records.MethodsFeasibility study using electronic prescribing, laboratory and clinical coding records from adult patients admitted to six specialities at Queen Elizabeth Hospital, Birmingham, UK (September 2017-August 2018). The study involved: (i) a review of AMS standards of care; (ii) their translation into concepts measurable from commonly available EHRs; and (iii) a pilot application in an EHR cohort study (n = 61679 admissions).ResultsWe developed data modelling methods to characterize antimicrobial use (antimicrobial therapy episode linkage methods, therapy table, therapy changes). Prescriptions were linked into antimicrobial therapy episodes (mean 2.4 prescriptions/episode; mean length of therapy 5.8 days), enabling several actionable findings. For example, 22% of therapy episodes for low-severity community-acquired pneumonia were congruent with prescribing guidelines, with a tendency to use broader-spectrum antibiotics. Analysis of therapy changes revealed IV to oral therapy switching was delayed by an average 3.6 days (95% CI: 3.4-3.7). Microbial cultures were performed prior to treatment initiation in just 22% of antibacterial prescriptions. The proposed methods enabled fine-grained monitoring of AMS practice down to specialities, wards and individual clinical teams by case mix, enabling more meaningful peer comparison.ConclusionsIt is feasible to use hospital EHRs to construct rapid, meaningful measures of prescribing quality with potential to support quality improvement interventions (audit/feedback to prescribers), engagement with front-line clinicians on optimizing prescribing, and AMS impact evaluation studies.

Project description:ObjectivePreventing suicide in US youth is of paramount concern, with rates increasing over 50% between 2007 and 2018. Statistical modeling using electronic health records may help identify at-risk youth before a suicide attempt. While electronic health records contain diagnostic information, which are known risk factors, they generally lack or poorly document social determinants (e.g., social support), which are also known risk factors. If statistical models are built incorporating not only diagnostic records, but also social determinants measures, additional at-risk youth may be identified before a suicide attempt.MethodsSuicide attempts were predicted in hospitalized patients, ages 10-24, from the State of Connecticut's Hospital Inpatient Discharge Database (HIDD; N = 38943). Predictors included demographic information, diagnosis codes, and using a data fusion framework, social determinants features transferred or fused from an external source of survey data, The National Longitudinal Study of Adolescent to Adult Health (Add Health). Social determinant information for each HIDD patient was generated by averaging values from their most similar Add Health individuals (e.g., top 10), based upon matching shared features between datasets (e.g., Pearson's r). Attempts were then modelled using an elastic net logistic regression with both HIDD features and fused Add Health features.ResultsThe model including fused social determinants outperformed the conventional model (AUC = 0.83 v. 0.82). Sensitivity and positive predictive values at 90 and 95% specificity were almost 10% higher when including fused features (e.g., sensitivity at 90% specificity = 0.48 v. 0.44). Among social determinants variables, the perception that their mother cares and being non-religious appeared particularly important to performance improvement.DiscussionThis proof-of-concept study showed that incorporating social determinants measures from an external survey database could improve prediction of youth suicide risk from clinical data using a data fusion framework. While social determinant data directly from patients might be ideal, estimating these characteristics via data fusion avoids the task of data collection, which is generally time-consuming, expensive, and suffers from non-compliance.

Dataset Information

Using Neural Networks with Routine Health Records to Identify Suicide Risk: Feasibility Study.

Background

Objective

Methods

Results

Conclusions

Publications

Using Neural Networks with Routine Health Records to Identify Suicide Risk: Feasibility Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets