Dataset Information

Identification of low risk of violent crime in severe mental illness with a clinical prediction tool (Oxford Mental Illness and Violence tool [OxMIV]): a derivation and validation study.

ABSTRACT:

Background

Current approaches to stratify patients with psychiatric disorders into groups on the basis of violence risk are limited by inconsistency, variable accuracy, and unscalability. To address the need for a scalable and valid tool to assess violence risk in patients with schizophrenia spectrum or bipolar disorder, we describe the derivation of a score based on routinely collected factors and present findings from external validation.

Methods

On the basis of a national cohort of 75 158 Swedish individuals aged 15-65 years with a diagnosis of severe mental illness (schizophrenia spectrum or bipolar disorder) with 574 018 patient episodes between Jan 1, 2001, and Dec 31, 2008, we developed predictive models for violent offending (primary outcome) within 1 year of hospital discharge for inpatients or clinical contact with psychiatric services for outpatients (patient episode) through linkage of population-based registers. We developed a derivation model to determine the relative influence of prespecified criminal history and sociodemographic and clinical risk factors, which are mostly routinely collected, and then tested it in an external validation. We measured discrimination and calibration for prediction of violent offending at 1 year using specified risk cutoffs.

Findings

Of the cohort of 75 158 patients with schizophrenia spectrum or bipolar disorder, we assigned 58 771 (78%) to the derivation sample and 16 387 (22%) to the validation sample. In the derivation sample, 830 (1%) individuals committed a violent offence within 12 months of their patient episode. We developed a 16-item model. The strongest predictors of violent offending within 12 months were conviction for previous violent crime (adjusted odds ratio 5·03 [95% CI 4·23-5·98]; p<0·0001), male sex (2·32 [1·91-2·81]; p<0·0001), and age (0·63 per 10 years of age [0·58-0·67]; p<0·0001). In external validation, the model showed good measures of discrimination (c-index 0·89 [0·85-0·93]) and calibration. For risk of violent offending at 1 year, with a 5% cutoff, sensitivity was 62% (95% CI 55-68) and specificity was 94% (93-94). The positive predictive value was 11% and the negative predictive value was more than 99%. We used the model to generate a simple web-based risk calculator (Oxford Mental Illness and Violence tool [OxMIV]).

Interpretation

We have developed a prediction score in a national cohort of patients with schizophrenia spectrum or bipolar disorder, which can be used as an adjunct to decision making in clinical practice by identifying those who are at low risk of violent offending. The low positive predictive value suggests that further clinical assessment in individuals at high risk of violent offending is required to establish who might benefit from additional risk management. Further validation in other countries is needed.

Funding

Wellcome Trust and Swedish Research Council.

SUBMITTER: Fazel S

PROVIDER: S-EPMC5447135 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundOxford Mental Illness and Suicide tool (OxMIS) is a brief, scalable, freely available, structured risk assessment tool to assess suicide risk in patients with severe mental illness (schizophrenia-spectrum disorders or bipolar disorder). OxMIS requires further external validation, but a lack of large-scale cohorts with relevant variables makes this challenging. Electronic health records provide possible data sources for external validation of risk prediction tools. However, they contain large amounts of information within free-text that is not readily extractable. In this study, we examined the feasibility of identifying suicide predictors needed to validate OxMIS in routinely collected electronic health records.MethodsIn study 1, we manually reviewed electronic health records of 57 patients with severe mental illness to calculate OxMIS risk scores. In study 2, we examined the feasibility of using natural language processing to scale up this process. We used anonymized free-text documents from the Clinical Record Interactive Search database to train a named entity recognition model, a machine learning technique which recognizes concepts in free-text. The model identified eight concepts relevant for suicide risk assessment: medication (antidepressant/antipsychotic treatment), violence, education, self-harm, benefits receipt, drug/alcohol use disorder, suicide, and psychiatric admission. We assessed model performance in terms of precision (similar to positive predictive value), recall (similar to sensitivity) and F1 statistic (an overall performance measure).ResultsIn study 1, we estimated suicide risk for all patients using the OxMIS calculator, giving a range of 12 month risk estimates from 0.1-3.4%. For 13 out of 17 predictors, there was no missing information in electronic health records. For the remaining 4 predictors missingness ranged from 7-26%; to account for these missing variables, it was possible for OxMIS to estimate suicide risk using a range of scores. In study 2, the named entity recognition model had an overall precision of 0.77, recall of 0.90 and F1 score of 0.83. The concept with the best precision and recall was medication (precision 0.84, recall 0.96) and the weakest were suicide (precision 0.37), and drug/alcohol use disorder (recall 0.61).ConclusionsIt is feasible to estimate suicide risk with the OxMIS tool using predictors identified in routine clinical records. Predictors could be extracted using natural language processing. However, electronic health records differ from other data sources, particularly for family history variables, which creates methodological challenges.

Project description:Importance:People with mental illness are more likely to have contact with the criminal justice system, but research to date has focused on risk of offense perpetration, while less is known about risk of being subjected to crime and violence. Objectives:To establish the incidence of being subjected to all types of criminal offenses, and by violent crimes separately, after onset of mental illness across the full diagnostic spectrum compared with those in the population without mental illness. Design, Setting, and Participants:This investigation was a longitudinal national cohort study using register data in Denmark. Participants were a cohort of more than 2 million persons born between 1965 and 1998 and followed up from 2001 or from their 15th birthday until December 31, 2013. Analysis was undertaken from November 2016 until February 2018. Exposures:Cohort members were followed up for onset of mental illness, recorded as first contact with outpatient or inpatient mental health services. Diagnoses across the full spectrum of psychiatric diagnoses were considered separately for men and women. Main Outcomes and Measures:Incidence rate ratios (IRRs) were estimated for first subjection to crime event (any crime and violent crime) reported to police after onset of mental illness. The IRRs were adjusted for cohort member's own criminal offending, in addition to several sociodemographic factors. Results:In a total cohort of 2 058 063 (48.7% male; 51.3% female), the adjusted IRRs for being subjected to crime associated with any mental disorder were 1.49 (95% CI, 1.46-1.51) for men and 1.64 (95% CI, 1.61-1.66) for women. The IRRs were higher for being subjected to violent crime at 1.76 (95% CI, 1.72-1.80) for men and 2.72 (95% CI, 2.65-2.79) for women. The strongest associations were for persons diagnosed as having substance use disorders and personality disorders, but significant risk elevations were found across almost all diagnostic groups examined. Conclusions and Relevance:Onset of mental illness is associated with increased risk of exposure to crime, and violent crime in particular. Elevated risk is not confined to specific diagnostic groups. Women with mental illness are especially vulnerable to being subjected to crime. Individual's own offending accounts for some but not all of the increased vulnerability to being subjected to crime.

Project description:BackgroundThe life expectancy of people with severe mental illness (SMI) is shorter than those without SMI, with multimorbidity and poorer physical health contributing to health inequality. Screening tools could potentially assist the optimisation of medicines to protect the physical health of people with SMI. The aim of our research was to design and validate a medicines optimisation tool (OPTIMISE) to help clinicians to optimise physical health in people with SMI.MethodsA review of existing published guidelines, PubMed and Medline was carried out. Literature was examined for medicines optimisation recommendations and also for reference to the management of physical illness in people with mental illness. Potential indicators were grouped according to physiological system. A multidisciplinary team with expertise in mental health and the development of screening tools agreed that 83 indicators should be included in the first draft of OPTIMISE. The Delphi consensus technique was used to develop and validate the contents. A 17-member multidisciplinary panel of experts from the UK and Ireland completed 2 rounds of Delphi consensus, rating their level of agreement to 83 prescribing indicators using a 5-point Likert scale. Indicators were accepted for inclusion in the OPTIMISE tool after achieving a median score of 1 or 2, where 1 indicated strongly agree and 2 indicated agree, and 75th centile value of ≤ 2. Interrater reliability was assessed among 4 clinicians across 20 datasets and the chance corrected level of agreement (kappa) was calculated. The kappa statistic was interpreted as poor if 0.2 or less, fair if 0.21-0.4, moderate if 0.41-0.6, substantial if 0.61-0.8, and good if 0.81-1.0.ResultsConsensus was achieved after 2 rounds of Delphi for 62 prescribing indicators where 53 indicators were accepted after round 1 and a further 9 indicators were accepted after round 2. Interrater reliability of OPTIMISE between physicians and pharmacists indicated a substantial level of agreement with a kappa statistic of 0.75.ConclusionsOPTIMISE is a 62 indicator medicines optimisation tool designed to assist decision making in those treating adults with SMI. It was developed using a Delphi consensus methodology and interrater reliability is substantial. OPTIMISE has the potential to improve medicines optimisation by ensuring preventative medicines are considered when clinically indicated. Further research involving the implementation of OPTIMISE is required to demonstrate its true benefit.Trial registrationThis article does not report the results of a health care intervention on human participants.

Project description:Interventions: We are assessing the impact of the National Bowel Cancer Screening Program (NBCSP) by comparing participation rates of people with and without Severe Mental Illness (SMI) and looking at health outcomes. We will be using data collected from Aug 2006 - latest available. We are linking data using Commonwealth data (NBCSP, Medicare Benefits Schedule, Pharmaceutical Benefits Scheme, Australian Cancer Database & the National Death Index) to compare bowel cancer screening participation in people with SMI to those from the general population. We will additionally link these to the NSW cancer registry and hospital data to examine care pathways from diagnosis through treatment and end-of-life care. We will also conduct a consultation with people with experience of SMI and Colorectal cancer and people with SMI in peer support roles who can provide their perspective on the barriers faced by people with SMI to gaining timely screening, diagnosis and optimal care. These participants will be recruited from New South Wales consumer organisations and organisations with a strong focus on provision of peer support and advocacy. We will use a semi structured group interview schedule to facilitate discussion of a single focus group of 15 people. The group will consist of both people with lived experience who have direct experience of bowel cancer (n=10), as well as other people with lived experience who have supported people in this situation – as peer support workers or in other consumer advocacy/support roles (n=5). We will use this qualitative arm of the study to further develop our understanding of the quantitative findings. The consultation will also develop ideas on how to improve access to care. Primary outcome(s): Participation rates in the National Bowel Cancer Screening Program assessed using data from the NBCSP.[Person-years will be calculated from entry into the study (2006) (the date of commencement of the NBCSP) or from the year that people become eligible for screening (i.e. age 50), whichever occurs later.. This is a retrospective cohort study, so all of the outcomes have already occurred and were recorded in the administrative data. This will be assessed when we receive the data.];Colonoscopy rates assessed using data from the NBCSP [Person-years will be calculated from entry into the study (2006 the date of commencement of the NBCSP), or from the year that people become eligible for screening (i.e. age 50), whichever occurs later, until colonoscopy. This is a retrospective cohort study, so all of the outcomes have already occurred and have been recorded in the administrative data.];Cancer diagnosis using data from the Australian Cancer Database[Person-years will be calculated from entry into the study (2006 the date of commencement of the NBCSP), or from the year that people become eligible for screening (i.e. age 50), whichever occurs later, until cancer diagnosis. This is a retrospective cohort study, so all of the outcomes have already occurred and have been recorded in the administrative data.] Study Design: Purpose: Screening;Duration: Longitudinal;Selection: Case control;Timing: Both

Project description:BACKGROUND:Physical health among people with severe mental illness (SMI) is a global concern. However, many people with SMI do not receive regular comprehensive health checks. There is currently no validated physical health check instrument systematically used in Finnish mental health services. Therefore, this study aims to validate and establish the potential clinical utility of the translated Health Improvement Profile (HIP) tool for Finnish patients with SMI and compare differences in physical health risk items across genders. METHODS:The content validity of the two-way translated Finnish HIP (HIP-F) was evaluated by five nurses and four patients with SMI using cognitive debriefing (to assess the clarity and relevance of each item and the recommended actions of the HIP tool). The potential clinical utility was assessed using a pilot test involving 47 patients. The prevalence of red-flagged (risk) items in the whole sample, across female and male participants, and the frequencies of any type of missing item response were calculated and analysed using descriptive statistics. A chi-square test was used to determine differences in frequencies of red-flagged items across genders. RESULTS:Based on the cognitive debriefing, the HIP-F was found to have moderate content validity regarding the clarity and relevance of the items and recommended actions (the average scale level content validity index, S-CVI/Ave, 0.74). In the pilot test, some missing item responses were identified, but in the sample, nurses identified 399 areas of health and health behaviour risks (mean 8.6 per patient) using the HIP-F. The most frequently red-flagged items were body mass index (BMI) and waist circumference (83.0%), smoking status (48.9%) and lipid levels (46.8%). Female patients had a higher frequency of red-flagged items than males in BMI (92.6% vs. 70.0%, p?=?0.04) and waist circumference (96.3% vs. 65.0%, p?=?0.01). CONCLUSIONS:The results demonstrate that the Finnish HIP has moderate content validity and preliminary clinical utility for evaluating the physical health and health behaviours of people with SMI. The HIP-F findings help to sign-post evidence-based interventions for identified areas of concern. Additional nurse training may be necessary to realise the potential clinical utility of the tool in Finland.

Project description:Background: Risk assessment informs decisions around admission to and discharge from secure psychiatric hospital and contributes to treatment and supervision. There are advantages to using brief, scalable, free online tools with similar accuracy to instruments currently used. We undertook a study of one such risk assessment, the Forensic Psychiatry and Violence Oxford (FoVOx) tool, examining its acceptability, feasibility, and practicality. Methods: We completed the FoVOx tool on all discharges from six secure psychiatric hospitals in one region in England over two years. We interviewed 11 senior forensic psychiatrists regarding each discharge using a standardized questionnaire. Their patient's FoVOx score was compared to clinical risk assessment, and the senior clinicians were asked if they considered FoVOx scores accurate and useful. A modified thematic analysis was conducted, and clinicians were surveyed about current risk assessment practice on discharge. Results: Of 90 consecutive discharges, 84 were included in the final analysis. The median FoVOx probability score was 11% risk of violent recidivism in two years after discharge. We estimated that 12 (14%) individuals reoffended since discharge; all were in the medium or high risk FoVOx categories. Clinical assessment of risk agreed with the FoVOx categories in around half the cases. Clinicians were more likely to provide lower risk categories compared with FoVOx ones. FoVOx was considered to be an accurate representation of risk in 67% of cases; clinicians revised their view on some patient's risk assessment after being informed of their FoVOx scores. Completing FoVOx was reported to be helpful in the majority of cases. Reasons included improved communication with other agencies, reassurance to clinical teams, and identifying additional factors not fully considered. 10 of the 11 respondents reported that FoVOx was practical, and seven of 11 reported that they would use it in the future, highlighting its brevity and speed of use compared to existing risk assessment tools. Conclusions: Senior clinicians in this regional forensic psychiatric service found the FoVOx risk assessment tool feasible, practical, and easy to use. Its use addressed a lack of consistency around risk assessment at the point of discharge and, if used routinely, could assist in clinical decision-making.

Project description:BackgroundAntipsychotics and mood stabilisers are prescribed widely to patients with psychiatric disorders worldwide. Despite clear evidence for their efficacy in relapse prevention and symptom relief, their effect on some adverse outcomes, including the perpetration of violent crime, is unclear. We aimed to establish the effect of antipsychotics and mood stabilisers on the rate of violent crime committed by patients with psychiatric disorders in Sweden.MethodsWe used linked Swedish national registers to study 82,647 patients who were prescribed antipsychotics or mood stabilisers, their psychiatric diagnoses, and subsequent criminal convictions in 2006-09. We did within-individual analyses to compare the rate of violent criminality during the time that patients were prescribed these medications versus the rate for the same patients while they were not receiving the drugs to adjust for all confounders that remained constant within each participant during follow-up. The primary outcome was the occurrence of violent crime, according to Sweden's national crime register.FindingsIn 2006-09, 40,937 men in Sweden were prescribed antipsychotics or mood stabilisers, of whom 2657 (6·5%) were convicted of a violent crime during the study period. In the same period, 41,710 women were prescribed these drugs, of whom 604 (1·4 %) had convictions for violent crime. Compared with periods when participants were not on medication, violent crime fell by 45% in patients receiving antipsychotics (hazard ratio [HR] 0·55, 95% CI 0·47-0·64) and by 24% in patients prescribed mood stabilisers (0·76, 0·62-0·93). However, we identified potentially important differences by diagnosis-mood stabilisers were associated with a reduced rate of violent crime only in patients with bipolar disorder. The rate of violence reduction for antipsychotics remained between 22% and 29% in sensitivity analyses that used different outcomes (any crime, drug-related crime, less severe crime, and violent arrest), and was stronger in patients who were prescribed higher drug doses than in those prescribed low doses. Notable reductions in violent crime were also recorded for depot medication (HR adjusted for concomitant oral medications 0·60, 95% CI 0·39-0·92).InterpretationIn addition to relapse prevention and psychiatric symptom relief, the benefits of antipsychotics and mood stabilisers might also include reductions in the rates of violent crime. The potential effects of these drugs on violence and crime should be taken into account when treatment options for patients with psychiatric disorders are being considered.FundingThe Wellcome Trust, the Swedish Prison and Probation Service, the Swedish Research Council, and the Swedish Research Council for Health, Working Life and Welfare.