Dataset Information

Machine Learning Analysis of Handgun Transactions to Predict Firearm Suicide Risk.

ABSTRACT:

Importance

Evidence suggests that limiting access to firearms among individuals at high risk of suicide can be an effective means of suicide prevention, yet accurately identifying those at risk to intervene remains a key challenge. Firearm purchasing records may offer a large-scale and objective data source for the development of tools to predict firearm suicide risk.

Objective

To test whether a statewide database of handgun transaction records, coupled with machine learning techniques, can be used to forecast firearm suicide risk.

Design, setting, and participants

This prognostic study used the California database of 4 976 391 handgun transaction records from 1 951 006 individuals from January 1, 1996, to October 6, 2015. Transaction-level random forest classification was implemented to predict firearm suicide risk, and the relative predictive power of features in the algorithm was estimated via permutation importance. Analyses were performed from December 1, 2020, to May 19, 2022.

Main outcomes and measures

The main outcome was firearm suicide within 1 year of a firearm transaction, derived from California death records (1996-2016). With the use of California's Dealer's Records of Sale (1996-2015), 41 handgun, transaction, purchaser, and community-level predictor variables were generated.

Results

There are a total of 4 976 391 transactions in the California's Dealer's Record of Sale database representing 1 951 006 individuals (1 525 754 men [78.2% of individuals]; mean [SD] age, 43.4 [13.9] years). Firearm suicide within 1 year occurred in 0.07% of handgun transactions (3278 transactions among 2614 individuals). A total of 38.6% of observed firearm suicides were among transactions classified in the highest-risk ventile (379 of 983 transactions), with 95% specificity. Among the small number of transactions with a random forest score above 0.95, more than two-thirds (24 of 35 [68.6%]) were associated with a purchaser who died by firearm suicide within 1 year. Important features included known risk factors, such as older age at first purchase, and previously unreported predictors, including distance to firearms dealer and month of purchase.

Conclusions and relevance

This prognostic study presented the first large-scale machine learning analysis of individual-level handgun transaction records. The results suggested the potential utility of such records in identifying high-risk individuals to aid suicide prevention efforts. It also identified handgun, individual, and community characteristics that have strong predictive relationships with firearm suicide and may warrant further study.

SUBMITTER: Laqueur HS

PROVIDER: S-EPMC9274320 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveSeveral prognostic models of suicide risk have been published; however, few have been implemented in Japan using longitudinal cohort data. The aim of this study was to identify suicide risk factors for suicidal ideation in the Japanese population and to develop a machine-learning model to predict suicide risk in Japan.Materials and methodsData was obtained from Wave1 Time 1 (November 2016) and Time 2 (March 2017) of the National Survey for Stress and Health in Japan, were incorporated into a suicide risk prediction machine-learning model, trained using 65 items related to trauma and stress. The study included 3,090 and 2,163 survey respondents >18 years old at Time 1 and Time 2, respectively. The mean (standard deviation, SD) age was 44.9 (10.9) years at Time 1 and 46.0 (10.7) years at Time 2. We analyzed the participants with increased suicide risk at Time 2 survey. Model performance, including the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity, were also analyzed.ResultsThe model showed a good performance (AUC = 0.830, 95% confidence interval = 0.795-0.866). Overall, the model achieved an accuracy of 78.8%, sensitivity of 75.4%, specificity of 80.4%, positive predictive value of 63.4%, and negative predictive value of 87.9%. The most important risk factor for suicide risk was the participants' Suicidal Ideation Attributes Scale score, followed by the Sheehan Disability Scale score, Patient Health Questionnaire-9 scores, Cross-Cutting Symptom Measure (CCSM-suicidal ideation domain, Dissociation Experience Scale score, history of self-harm, Generalized Anxiety Disorder-7 score, Post-Traumatic Stress Disorder check list-5 score, CCSM-dissociation domain, and Impact of Event Scale-Revised scores at Time 1.ConclusionsThis prognostic study suggests the ability to identify patients at a high risk of suicide using an online survey method. In addition to confirming several well-known risk factors of suicide, new risk measures related to trauma and trauma-related experiences were also identified, which may help guide future clinical assessments and early intervention approaches.

Project description:BackgroundPrevious studies suggest that deficits in cognition may increase the risk of suicide. Our study aims to develop a machine learning (ML) algorithm-based suicide risk prediction model using cognition in patients with major depressive disorder (MDD).MethodsParticipants comprised 52 depressed suicide attempters (DSA) and 61 depressed non-suicide attempters (DNS), and 98 healthy controls (HC). All participants were required to complete a series of questionnaires, the Suicide Stroop Task (SST) and the Iowa Gambling Task (IGT). The performance in IGT was analyzed using repeated measures ANOVA. ML with extreme gradient boosting (XGBoost) classification algorithm and locally explanatory techniques assessed performance and relative importance of characteristics for predicting suicide attempts. Prediction performances were compared with the area under the curve (AUC), decision curve analysis (DCA), and net reclassification improvement (NRI).ResultsDSA and DNS preferred to select the card from disadvantageous decks (decks "A" + "B") under risky situation (p = 0.023) and showed a significantly poorer learning effect during the IGT (F = 2.331, p = 0.019) compared with HC. Performance of XGBoost model based on demographic and clinical characteristics was compared with that of the model created after adding cognition data (AUC, 0.779 vs. 0.819, p > 0.05). The net benefit of model was improved and cognition resulted in continuous reclassification improvement with NRI of 5.3%. Several clinical dimensions were significant predictors in the XGBoost classification algorithm.LimitationsA limited sample size and failure to include sufficient suicide risk factors in the predictive model.ConclusionThis study demonstrate that cognitive deficits may serve as an important risk factor to predict suicide attempts in patients with MDD. Combined with other demographic characteristics and attributes drawn from clinical questionnaires, cognitive function can improve the predictive effectiveness of the ML model. Additionally, explanatory ML models can help clinicians detect specific risk factors for each suicide attempter within MDD patients. These findings may be helpful for clinicians to detect those at high risk of suicide attempts quickly and accurately, and help them make proactive treatment decisions.

Project description:ImportanceUnderstanding the differences and potential synergies between traditional clinician assessment and automated machine learning might enable more accurate and useful suicide risk detection.ObjectiveTo evaluate the respective and combined abilities of a real-time machine learning model and the Columbia Suicide Severity Rating Scale (C-SSRS) to predict suicide attempt (SA) and suicidal ideation (SI).Design, setting, and participantsThis cohort study included encounters with adult patients (aged ≥18 years) at a major academic medical center. The C-SSRS was administered during routine care, and a Vanderbilt Suicide Attempt and Ideation Likelihood (VSAIL) prediction was generated in the electronic health record. Encounters took place in the inpatient, ambulatory surgical, and emergency department settings. Data were collected from June 2019 to September 2020.Main outcomes and measuresPrimary outcomes were the incidence of SA and SI, encoded as International Classification of Diseases codes, occurring within various time periods after an index visit. We evaluated the retrospective validity of the C-SSRS, VSAIL, and ensemble models combining both. Discrimination metrics included area under the receiver operating curve (AUROC), area under the precision-recall curve (AUPR), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).ResultsThe cohort included 120 398 unique index visits for 83 394 patients (mean [SD] age, 51.2 [20.6] years; 38 107 [46%] men; 45 273 [54%] women; 13 644 [16%] Black; 63 869 [77%] White). Within 30 days of an index visit, the combined models had higher AUROC (SA: 0.874-0.887; SI: 0.869-0.879) than both the VSAIL (SA: 0.729; SI: 0.773) and C-SSRS (SA: 0.823; SI: 0.777) models. In the highest risk-decile, ensemble methods had PPV of 1.3% to 1.4% for SA and 8.3% to 8.7% for SI and sensitivity of 77.6% to 79.5% for SA and 67.4% to 70.1% for SI, outperforming VSAIL (PPV for SA: 0.4%; PPV for SI: 3.9%; sensitivity for SA: 28.8%; sensitivity for SI: 35.1%) and C-SSRS (PPV for SA: 0.5%; PPV for SI: 3.5%; sensitivity for SA: 76.6%; sensitivity for SI: 68.8%).Conclusions and relevanceIn this study, suicide risk prediction was optimal when leveraging both in-person screening (for acute measures of risk in patient-reported suicidality) and historical EHR data (for underlying clinical factors that can quantify a patient's passive risk level). To improve suicide risk classification, prediction systems could combine pretrained machine learning with structured clinician assessment without needing to retrain the original model.