Dataset Information

Detection of overdose and underdose prescriptions—An unsupervised machine learning approach

ABSTRACT: Overdose prescription errors sometimes cause serious life-threatening adverse drug events, while underdose errors lead to diminished therapeutic effects. Therefore, it is important to detect and prevent these errors. In the present study, we used the one-class support vector machine (OCSVM), one of the most common unsupervised machine learning algorithms for anomaly detection, to identify overdose and underdose prescriptions. We extracted prescription data from electronic health records in Kyushu University Hospital between January 1, 2014 and December 31, 2019. We constructed an OCSVM model for each of the 21 candidate drugs using three features: age, weight, and dose. Clinical overdose and underdose prescriptions, which were identified and rectified by pharmacists before administration, were collected. Synthetic overdose and underdose prescriptions were created using the maximum and minimum doses, defined by drug labels or the UpToDate database. We applied these prescription data to the OCSVM model and evaluated its detection performance. We also performed comparative analysis with other unsupervised outlier detection algorithms (local outlier factor, isolation forest, and robust covariance). Twenty-seven out of 31 clinical overdose and underdose prescriptions (87.1%) were detected as abnormal by the model. The constructed OCSVM models showed high performance for detecting synthetic overdose prescriptions (precision 0.986, recall 0.964, and F-measure 0.973) and synthetic underdose prescriptions (precision 0.980, recall 0.794, and F-measure 0.839). In comparative analysis, OCSVM showed the best performance. Our models detected the majority of clinical overdose and underdose prescriptions and demonstrated high performance in synthetic data analysis. OCSVM models, constructed using features such as age, weight, and dose, are useful for detecting overdose and underdose prescriptions.

SUBMITTER: Nagata K

PROVIDER: S-EPMC8604308 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ImportanceCurrent approaches to identifying individuals at high risk for opioid overdose target many patients who are not truly at high risk.ObjectiveTo develop and validate a machine-learning algorithm to predict opioid overdose risk among Medicare beneficiaries with at least 1 opioid prescription.Design, setting, and participantsA prognostic study was conducted between September 1, 2017, and December 31, 2018. Participants (n = 560 057) included fee-for-service Medicare beneficiaries without cancer who filled 1 or more opioid prescriptions from January 1, 2011, to December 31, 2015. Beneficiaries were randomly and equally divided into training, testing, and validation samples.ExposuresPotential predictors (n = 268), including sociodemographics, health status, patterns of opioid use, and practitioner-level and regional-level factors, were measured in 3-month windows, starting 3 months before initiating opioids until loss of follow-up or the end of observation.Main outcomes and measuresOpioid overdose episodes from inpatient and emergency department claims were identified. Multivariate logistic regression (MLR), least absolute shrinkage and selection operator-type regression (LASSO), random forest (RF), gradient boosting machine (GBM), and deep neural network (DNN) were applied to predict overdose risk in the subsequent 3 months after initiation of treatment with prescription opioids. Prediction performance was assessed using the C statistic and other metrics (eg, sensitivity, specificity, and number needed to evaluate [NNE] to identify one overdose). The Youden index was used to identify the optimized threshold of predicted score that balanced sensitivity and specificity.ResultsBeneficiaries in the training (n = 186 686), testing (n = 186 685), and validation (n = 186 686) samples had similar characteristics (mean [SD] age of 68.0 [14.5] years, and approximately 63% were female, 82% were white, 35% had disabilities, 41% were dual eligible, and 0.60% had at least 1 overdose episode). In the validation sample, the DNN (C statistic = 0.91; 95% CI, 0.88-0.93) and GBM (C statistic = 0.90; 95% CI, 0.87-0.94) algorithms outperformed the LASSO (C statistic = 0.84; 95% CI, 0.80-0.89), RF (C statistic = 0.80; 95% CI, 0.75-0.84), and MLR (C statistic = 0.75; 95% CI, 0.69-0.80) methods for predicting opioid overdose. At the optimized sensitivity and specificity, DNN had a sensitivity of 92.3%, specificity of 75.7%, NNE of 542, positive predictive value of 0.18%, and negative predictive value of 99.9%. The DNN classified patients into low-risk (76.2% [142 180] of the cohort), medium-risk (18.6% [34 579] of the cohort), and high-risk (5.2% [9747] of the cohort) subgroups, with only 1 in 10 000 in the low-risk subgroup having an overdose episode. More than 90% of overdose episodes occurred in the high-risk and medium-risk subgroups, although positive predictive values were low, given the rare overdose outcome.Conclusions and relevanceMachine-learning algorithms appear to perform well for risk prediction and stratification of opioid overdose, especially in identifying low-risk subgroups that have minimal risk of overdose.

Project description:BACKGROUND:Timely data is key to effective public health responses to epidemics. Drug overdose deaths are identified in surveillance systems through ICD-10 codes present on death certificates. ICD-10 coding takes time, but free-text information is available on death certificates prior to ICD-10 coding. The objective of this study was to develop a machine learning method to classify free-text death certificates as drug overdoses to provide faster drug overdose mortality surveillance. METHODS:Using 2017-2018 Kentucky death certificate data, free-text fields were tokenized and features were created from these tokens using natural language processing (NLP). Word, bigram, and trigram features were created as well as features indicating the part-of-speech of each word. These features were then used to train machine learning classifiers on 2017 data. The resulting models were tested on 2018 Kentucky data and compared to a simple rule-based classification approach. Documented code for this method is available for reuse and extensions: https://github.com/pjward5656/dcnlp. RESULTS:The top scoring machine learning model achieved 0.96 positive predictive value (PPV) and 0.98 sensitivity for an F-score of 0.97 in identification of fatal drug overdoses on test data. This machine learning model achieved significantly higher performance for sensitivity (p<0.001) than the rule-based approach. Additional feature engineering may improve the model's prediction. This model can be deployed on death certificates as soon as the free-text is available, eliminating the time needed to code the death certificates. CONCLUSION:Machine learning using natural language processing is a relatively new approach in the context of surveillance of health conditions. This method presents an accessible application of machine learning that improves the timeliness of drug overdose mortality surveillance. As such, it can be employed to inform public health responses to the drug overdose epidemic in near-real time as opposed to several weeks following events.

Project description:ObjectivesTo stratify patients with multiple sclerosis (pwMS) based on brain MRI-derived volumetric features using unsupervised machine learning.MethodsThe 3-T brain MRIs of relapsing-remitting pwMS including 3D-T1w and FLAIR-T2w sequences were retrospectively collected, along with Expanded Disability Status Scale (EDSS) scores and long-term (10 ± 2 years) clinical outcomes (EDSS, cognition, and progressive course). From the MRIs, volumes of demyelinating lesions and 116 atlas-defined gray matter regions were automatically segmented and expressed as z-scores referenced to external populations. Following feature selection, baseline MRI-derived biomarkers entered the Subtype and Stage Inference (SuStaIn) algorithm, which estimates subgroups characterized by distinct patterns of biomarker evolution and stages within subgroups. The trained model was then applied to longitudinal MRIs. Stability of subtypes and stage change over time were assessed via Krippendorf's α and multilevel linear regression models, respectively. The prognostic relevance of SuStaIn classification was assessed with ordinal/logistic regression analyses.ResultsWe selected 425 pwMS (35.9 ± 9.9 years; F/M: 301/124), corresponding to 1129 MRI scans, along with healthy controls (N = 148; 35.9 ± 13.0 years; F/M: 77/71) and external pwMS (N = 80; 40.4 ± 11.9 years; F/M: 56/24) as reference populations. Based on 11 biomarkers surviving feature selection, two subtypes were identified, designated as "deep gray matter (DGM)-first" subtype (N = 238) and "cortex-first" subtype (N = 187) according to the atrophy pattern. Subtypes were consistent over time (α = 0.806), with significant annual stage increase (b = 0.20; p < 0.001). EDSS was associated with stage and DGM-first subtype (p ≤ 0.02). Baseline stage predicted long-term disability, transition to progressive course, and cognitive impairment (p ≤ 0.03), with the latter also associated with DGM-first subtype (p = 0.005).ConclusionsUnsupervised learning modelling of brain MRI-derived volumetric features provides a biologically reliable and prognostically meaningful stratification of pwMS.Key points• The unsupervised modelling of brain MRI-derived volumetric features can provide a single-visit stratification of multiple sclerosis patients. • The so-obtained classification tends to be consistent over time and captures disease-related brain damage progression, supporting the biological reliability of the model. • Baseline stratification predicts long-term clinical disability, cognition, and transition to secondary progressive course.

Dataset Information

Detection of overdose and underdose prescriptions—An unsupervised machine learning approach

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets