Dataset Information

The DUNDRUM Quartet: validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services.

ABSTRACT: BACKGROUND: Moving a forensic mental health patient from one level of therapeutic security to a lower level or to the community is influenced by more than risk assessment and risk management. We set out to construct and validate structured professional judgement instruments for consistency and transparency in decision making METHODS: Two instruments were developed, the seven-item DUNDRUM-3 programme completion instrument and the six item DUNDRUM-4 recovery instrument. These were assessed for all 95 forensic patients at Ireland's only forensic mental health hospital. RESULTS: The two instruments had good internal consistency (Cronbach's alpha 0.911 and 0.887). Scores distinguished those allowed no leave or accompanied leave from those with unaccompanied leave (ANOVA F = 38.1 and 50.3 respectively, p < 0.001). Scores also distinguished those in acute/high security units from those in medium or in low secure/pre-discharge units. Each individual item distinguished these levels of need significantly. The DUNDRUM-3 and DUNDRUM-4 correlated moderately with measures of dynamic risk and with the CANFOR staff rated unmet need (Spearman r = 0.5, p < 0.001). CONCLUSIONS: The DUNDRUM-3 programme completion items distinguished significantly between levels of therapeutic security while the DUNDRUM-4 recovery items consistently distinguished those given unaccompanied leave outside the hospital and those in the lowest levels of therapeutic security. This data forms the basis for a prospective study of outcomes now underway.

SUBMITTER: O'Dwyer S

PROVIDER: S-EPMC3146857 | biostudies-other | 2011

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

The DUNDRUM Quartet: validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services.

O'Dwyer Sarah S Davoren Mary M Abidin Zareena Z Doyle Elaine E McDonnell Kim K Kennedy Harry G HG

BMC research notes 20110703

<h4>Background</h4>Moving a forensic mental health patient from one level of therapeutic security to a lower level or to the community is influenced by more than risk assessment and risk management. We set out to construct and validate structured professional judgement instruments for consistency and transparency in decision making<h4>Methods</h4>Two instruments were developed, the seven-item DUNDRUM-3 programme completion instrument and the six item DUNDRUM-4 recovery instrument. These were ass ...[more]

PMID: 21722396

Similar Datasets

Project description:BACKGROUND: The START and SAPROF are newly developed fourth generation structured professional judgement instruments assessing strengths and protective factors. The DUNDRUM-3 and DUNDRUM-4 also measure positive factors, programme completion and recovery in forensic settings. METHODS: We compared these instruments with other validated risk instruments (HCR-20, S-RAMM), a measure of psychopathology (PANSS) and global function (GAF). We prospectively tested whether any of these instruments predict violence or self harm in a secure hospital setting (n?=?98) and whether they had true protective effects, interacting with and off-setting risk measures. RESULTS: SAPROF and START-strengths had strong inverse (negative) correlations with the HCR-20 and S-RAMM. SAPROF correlated strongly with GAF (r?=?0.745). In the prospective in-patient study, SAPROF predicted absence of violence, AUC?=?0.847 and absence of self-harm AUC?=?0.766. START-strengths predicted absence of violence AUC?=?0.776, but did not predict absence of self-harm AUC?=?0.644. The DUNDRUM-3 programme completion and DUNDRUM-4 recovery scales also predicted in-patient violence (AUC 0.832 and 0.728 respectively), and both predicted in-patient self-harm (AUC 0.750 and 0.713 respectively). When adjusted for the HCR-20 total score however, SAPROF, START-S, DUNDRUM-3 and DUNDRUM-4 scores were not significantly different for those who were violent or for those who self harmed. The SAPROF had a significant interactive effect with the HCR-dynamic score. Item to outcome studies often showed a range of strengths of association with outcomes, which may be specific to the in-patient setting and patient group studied. CONCLUSIONS: The START and SAPROF, DUNDRUM-3 and DUNDRUM-4 can be used to assess both reduced and increased risk of violence and self-harm in mentally ill in-patients in a secure setting. They were not consistently better than the GAF, HCR-20, S-RAMM, or PANSS when predicting adverse events. Only the SAPROF had an interactive effect with the HCR-20 risk assessment indicating a true protective effect but as structured professional judgement instruments all have additional content (items) complementary to existing risk assessments, useful for planning treatment and risk management.

Project description:BackgroundAlthough structured tools have been widely used to predict violence risk in specialist mental health settings, there is uncertainty about the extent and quality of evidence of their predictive performance. We aimed to systematically review the predictive performance of tools used to assess violence risk in forensic mental health, where they are routinely administered.MethodsIn our systematic review and meta-analysis, we followed PRISMA guidelines and searched four databases (PsycINFO, Embase, Medline, and Global Health) from database inception to Nov 1, 2022, to identify studies examining the predictive performance of risk assessment tools in people discharged from forensic (secure) mental health hospitals. Systematic and narrative reviews were excluded from the review. Performance measures and descriptive statistics were extracted from published reports. A quality assessment was performed for each study using the Prediction Model Risk of Bias Assessment Tool. Meta-analysis was conducted on the performance of instruments that were independently externally validated with a sample size greater than 100. The study was registered with PROSPERO, CRD42022304716.FindingsWe conducted a systematic review of 50 eligible publications, assessing the predictive performance of 36 tools, providing data for 10 460 participants (88% men, 12% women; median age [from 47 studies] was 35 years, IQR 33-38) from 12 different countries. Post-discharge interpersonal violence and crime was most often measured by new criminal offences or recidivism (47 [94%] of 50 studies); only three studies used informant or self-report data on physical aggression or violent behaviour. Overall, the predictive performance of risk assessment tools was mixed. Most studies reported one discrimination metric, the area under the receiver operating characteristic curve (AUC); other key performance measures such as calibration, sensitivity, and specificity were not presented. Most studies had a high risk of bias (49 [98%] of 50), partly due to poor analytical approaches. A meta-analysis was conducted for violent recidivism on 29 independent external validations from 19 studies with at least 100 patients. Pooled AUCs for predicting violent outcomes ranged from 0·72 (0·65-0·79; I2=0%) for H10, to 0·69 for the Historical Clinical Risk Management-20 version 2 (95% CI 0·65-0·72; I2=0%) and Violence Risk Appraisal Guide (0·63-0·75; I2=0%), to 0·64 for the Static-99 (0·53-0·73; I2=45%).InterpretationCurrent violence risk assessment tools in forensic mental health have mixed evidence of predictive performance. Forensic mental health services should review their use of current risk assessment tools and consider implementing those with higher-quality evidence in support.FundingWellcome Trust.

Project description:BACKGROUND AND AIMS:Violent behaviour by forensic psychiatric inpatients is common. We aimed to systematically review the performance of structured risk assessment tools for violence in these settings. METHODS:The nine most commonly used violence risk assessment instruments used in psychiatric hospitals were examined. A systematic search of five databases (CINAHL, Embase, Global Health, PsycINFO and PubMed) was conducted to identify studies examining the predictive accuracy of these tools in forensic psychiatric inpatient settings. Risk assessment instruments were separated into those designed for imminent (within 24 hours) violence prediction and those designed for longer-term prediction. A range of accuracy measures and descriptive variables were extracted. A quality assessment was performed for each eligible study using the QUADAS-2. Summary performance measures (sensitivity, specificity, positive and negative predictive values, diagnostic odds ratio, and area under the curve value) and HSROC curves were produced. In addition, meta-regression analyses investigated study and sample effects on tool performance. RESULTS:Fifty-two eligible publications were identified, of which 43 provided information on tool accuracy in the form of AUC statistics. These provided data on 78 individual samples, with information on 6,840 patients. Of these, 35 samples (3,306 patients from 19 publications) provided data on all performance measures. The median AUC value for the wider group of 78 samples was higher for imminent tools (AUC 0.83; IQR: 0.71-0.85) compared with longer-term tools (AUC 0.68; IQR: 0.62-0.75). Other performance measures indicated variable accuracy for imminent and longer-term tools. Meta-regression indicated that no study or sample-related characteristics were associated with between-study differences in AUCs. INTERPRETATION:The performance of current tools in predicting risk of violence beyond the first few days is variable, and the selection of which tool to use in clinical practice should consider accuracy estimates. For more imminent violence, however, there is evidence in support of brief scalable assessment tools.

Project description:AimsRecovery Colleges are opening internationally. The evaluation focus has been on outcomes for Recovery College students who use mental health services. However, benefits may also arise for: staff who attend or co-deliver courses; the mental health and social care service hosting the Recovery College; and wider society. A theory-based change model characterising how Recovery Colleges impact at these higher levels is needed for formal evaluation of their impact, and to inform future Recovery College development. The aim of this study was to develop a stratified theory identifying candidate mechanisms of action and outcomes (impact) for Recovery Colleges at staff, services and societal levels.MethodsInductive thematic analysis of 44 publications identified in a systematised review was supplemented by collaborative analysis involving a lived experience advisory panel to develop a preliminary theoretical framework. This was refined through semi-structured interviews with 33 Recovery College stakeholders (service user students, peer/non-peer trainers, managers, community partners, clinicians) in three sites in England.ResultsCandidate mechanisms of action and outcomes were identified at staff, services and societal levels. At the staff level, experiencing new relationships may change attitudes and associated professional practice. Identified outcomes for staff included: experiencing and valuing co-production; changed perceptions of service users; and increased passion and job motivation. At the services level, Recovery Colleges often develop somewhat separately from their host system, reducing the reach of the college into the host organisation but allowing development of an alternative culture giving experiential learning opportunities to staff around co-production and the role of a peer workforce. At the societal level, partnering with community-based agencies gave other members of the public opportunities for learning alongside people with mental health problems and enabled community agencies to work with people they might not have otherwise. Recovery Colleges also gave opportunities to beneficially impact on community attitudes.ConclusionsThis study is the first to characterise the mechanisms of action and impact of Recovery Colleges on mental health staff, mental health and social care services, and wider society. The findings suggest that a certain distance is needed in the relationship between the Recovery College and its host organisation if a genuine cultural alternative is to be created. Different strategies are needed depending on what level of impact is intended, and this study can inform decision-making about mechanisms to prioritise. Future research into Recovery Colleges should include contextual evaluation of these higher level impacts, and investigate effectiveness and harms.

Dataset Information

The DUNDRUM Quartet: validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services.

Publications

The DUNDRUM Quartet: validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets