Instruments for the assessment of suicide risk: A systematic review evaluating the certainty of the evidence.
Ontology highlight
ABSTRACT: Background
Instruments have been developed to facilitate suicide risk assessment. We aimed to evaluate the evidence for these instruments including assessment of risk of bias and diagnostic accuracy for suicide and suicide attempt.Methods
PubMed (NLM), PsycInfo, Embase, Cinahl and the Cochrane Library databases were searched until December 2014. We assessed risk of bias with QUADAS-2. The average sensitivity and specificity of each instrument was estimated and the certainty of the evidence was assessed with GRADE. We considered instruments with a sensitivity > 80% and a specificity > 50% to have sufficient diagnostic accuracy.Results
Thirty-five relevant studies were identified but 14 were considered to have high risk of bias, leaving 21 studies evaluating altogether 15 risk assessment instruments. We could carry out meta-analyses for five instruments. For the outcome suicide attempt SAD PERSONS Scale had a sensitivity of 15% (95% CI 8-24) and specificity of 97% (96-98), and the Manchester Self-Harm Rule (MSHR) a sensitivity of 97% (97-97) and a specificity of 20% (20-21). ReACT, which is a modification of MSHR, had a similar low specificity, as did the Sodersjukhuset Self Harm Rule. For the outcome suicide, the Beck Hopelessness Scale had a sensitivity of 89% (78-95) and specificity of 42% (40-43).Conclusions
Most suicide risk assessment instruments were supported by too few studies to allow for evaluation of accuracy. Among those that could be evaluated, none fulfilled requirements for sufficient diagnostic accuracy.
SUBMITTER: Runeson B
PROVIDER: S-EPMC5517300 | biostudies-literature | 2017
REPOSITORIES: biostudies-literature
Publications
Instruments for the assessment of suicide risk: A systematic review evaluating the certainty of the evidence.
Runeson Bo B Odeberg Jenny J Pettersson Agneta A Edbom Tobias T Jildevik Adamsson Ingalill I Waern Margda M
PloS one 20170719 7
<h4>Background</h4>Instruments have been developed to facilitate suicide risk assessment. We aimed to evaluate the evidence for these instruments including assessment of risk of bias and diagnostic accuracy for suicide and suicide attempt.<h4>Methods</h4>PubMed (NLM), PsycInfo, Embase, Cinahl and the Cochrane Library databases were searched until December 2014. We assessed risk of bias with QUADAS-2. The average sensitivity and specificity of each instrument was estimated and the certainty of th ...[more]
Similar Datasets
Project description:UNLABELLED:We systematically reviewed the literature on the performance of osteoporosis absolute fracture risk assessment instruments. Relatively few studies have evaluated the calibration of instruments in populations separate from their development cohorts, and findings are mixed. Many studies had methodological limitations making susceptibility to bias a concern. INTRODUCTION:The aim of this study was to systematically review the literature on the performance of osteoporosis clinical fracture risk assessment instruments for predicting absolute fracture risk, or calibration, in populations other than their derivation cohorts. METHODS:We performed a systematic review, and MEDLINE, Embase, Cochrane Library, and multiple other literature sources were searched. Inclusion and exclusion criteria were applied and data extracted, including information about study participants, study design, potential sources of bias, and predicted and observed fracture probabilities. RESULTS:A total of 19,949 unique records were identified for review. Fourteen studies met inclusion criteria. There was substantial heterogeneity among included studies. Six studies assessed the WHO's Fracture Risk Assessment (FRAX) instrument in five separate cohorts, and a variety of risk assessment instruments were evaluated in the remainder of the studies. Approximately half found good instrument calibration, with observed fracture probabilities being close to predicted probabilities for different risk categories. Studies that assessed the calibration of FRAX found mixed performance in different populations. A similar proportion of studies that evaluated simple risk assessment instruments (?5 variables) found good calibration when compared with studies that assessed complex instruments (>5 variables). Many studies had methodological features making them susceptible to bias. CONCLUSIONS:Few studies have evaluated the performance or calibration of osteoporosis fracture risk assessment instruments in populations separate from their development cohorts. Findings are mixed, and many studies had methodological limitations making susceptibility to bias a possibility, raising concerns about use of these tools outside of the original derivation cohorts. Further studies are needed to assess the calibration of instruments in different populations prior to widespread use.
| S-EPMC3962543 | biostudies-literature
Project description:BackgroundSuicide is a leading cause of death among youth and a prominent concern for school mental health providers. Indeed, schools play a key role in suicide prevention, including participating in risk assessments with students expressing suicidal ideation. In the context of the COVID-19 pandemic, many schools now need to offer mental health services, including suicide risk assessment, via eHealth platforms. Post pandemic, the use of eHealth risk assessments will support more accessible services for youth living in rural and remote areas. However, as the remote environment is a new context for many schools, guidance is needed on best practices for eHealth suicide risk assessment among youth.ObjectiveThis study aims to conduct a rapid, systematic scoping review to explore promising practices for conducting school-based suicide risk assessment among youth via eHealth (ie, information technologies that allow for remote communication).MethodsThis review included peer-reviewed articles and gray literature published in English between 2000 and 2020. Although we did not find studies that specifically explored promising practices for school-based suicide risk assessment among youth via eHealth platforms, we found 12 peer-reviewed articles and 23 gray literature documents that contained relevant information addressing our broader study purpose; thus, these 35 sources were included in this review.ResultsWe identified five key recommendation themes for school-based suicide risk assessment among youth via eHealth platforms in the 12 peer-reviewed studies. These included accessibility, consent procedures, session logistics, safety planning, and internet privacy. Specific recommendation themes from the 23 gray literature documents substantially overlapped with and enhanced three of the themes identified in the peer-reviewed literature-consent procedures, session logistics, and safety planning. In addition, based on findings from the gray literature, we expanded the accessibility theme to a broader theme termed youth engagement, which included information on accessibility and building rapport, establishing a therapeutic space, and helping youth prepare for remote sessions. Finally, a new theme was identified in the gray literature findings, specifically concerning school mental health professional boundaries. A second key difference between the gray and peer-reviewed literature was the former's focus on issues of equity and access and how technology can reinforce existing inequalities.ConclusionsFor school mental health providers in need of guidance, we believe that these six recommendation themes (ie, youth engagement, school mental health professional boundaries, consent procedures, session logistics, safety planning, and internet privacy) represent the most promising directions for school-based suicide risk assessment among youth using eHealth tools. However, suicide risk assessment among youth via eHealth platforms in school settings represents a critical research gap. On the basis of the findings of this review, we provide specific recommendations for future research, including the need to focus on the needs of diverse youth.
| S-EPMC8493464 | biostudies-literature
Project description:BackgroundAlthough structured tools have been widely used to predict violence risk in specialist mental health settings, there is uncertainty about the extent and quality of evidence of their predictive performance. We aimed to systematically review the predictive performance of tools used to assess violence risk in forensic mental health, where they are routinely administered.MethodsIn our systematic review and meta-analysis, we followed PRISMA guidelines and searched four databases (PsycINFO, Embase, Medline, and Global Health) from database inception to Nov 1, 2022, to identify studies examining the predictive performance of risk assessment tools in people discharged from forensic (secure) mental health hospitals. Systematic and narrative reviews were excluded from the review. Performance measures and descriptive statistics were extracted from published reports. A quality assessment was performed for each study using the Prediction Model Risk of Bias Assessment Tool. Meta-analysis was conducted on the performance of instruments that were independently externally validated with a sample size greater than 100. The study was registered with PROSPERO, CRD42022304716.FindingsWe conducted a systematic review of 50 eligible publications, assessing the predictive performance of 36 tools, providing data for 10 460 participants (88% men, 12% women; median age [from 47 studies] was 35 years, IQR 33-38) from 12 different countries. Post-discharge interpersonal violence and crime was most often measured by new criminal offences or recidivism (47 [94%] of 50 studies); only three studies used informant or self-report data on physical aggression or violent behaviour. Overall, the predictive performance of risk assessment tools was mixed. Most studies reported one discrimination metric, the area under the receiver operating characteristic curve (AUC); other key performance measures such as calibration, sensitivity, and specificity were not presented. Most studies had a high risk of bias (49 [98%] of 50), partly due to poor analytical approaches. A meta-analysis was conducted for violent recidivism on 29 independent external validations from 19 studies with at least 100 patients. Pooled AUCs for predicting violent outcomes ranged from 0·72 (0·65-0·79; I2=0%) for H10, to 0·69 for the Historical Clinical Risk Management-20 version 2 (95% CI 0·65-0·72; I2=0%) and Violence Risk Appraisal Guide (0·63-0·75; I2=0%), to 0·64 for the Static-99 (0·53-0·73; I2=45%).InterpretationCurrent violence risk assessment tools in forensic mental health have mixed evidence of predictive performance. Forensic mental health services should review their use of current risk assessment tools and consider implementing those with higher-quality evidence in support.FundingWellcome Trust.
| S-EPMC10914679 | biostudies-literature
Project description:BackgroundOverviews of systematic reviews (SRs) attempt to systematically retrieve and summarise the results of multiple systematic reviews. This is the second of two papers from a study aiming to develop a comprehensive evidence map of the methods used in overviews. Our objectives were to (a) develop a framework of methods for conducting, interpreting and reporting overviews (stage I)-the Methods for Overviews of Reviews (MOoR) framework-and (b) to create an evidence map by mapping studies that have evaluated overview methods to the framework (stage II). In the first paper, we reported findings for the four initial steps of an overview (specification of purpose, objectives and scope; eligibility criteria; search methods; data extraction). In this paper, we report the remaining steps: assessing risk of bias; synthesis, presentation and summary of the findings; and assessing certainty of the evidence arising from the overview.MethodsIn stage I, we identified cross-sectional studies, guidance documents and commentaries that described methods proposed for, or used in, overviews. Based on these studies, we developed a framework of possible methods for overviews, categorised by the steps in conducting an overview. Multiple iterations of the framework were discussed and refined by all authors. In stage II, we identified studies evaluating methods and mapped these evaluations to the framework.ResultsForty-two stage I studies described methods relevant to one or more of the latter steps of an overview. Six studies evaluating methods were included in stage II. These mapped to steps involving (i) the assessment of risk of bias (RoB) in SRs (two SRs and three primary studies, all reporting evaluation of RoB tools) and (ii) the synthesis, presentation and summary of the findings (one primary study evaluating methods for measuring overlap).ConclusionMany methods have been described for use in the latter steps in conducting an overview; however, evaluation and guidance for applying these methods is sparse. The exception is RoB assessment, for which a multitude of tools exist-several with sufficient evaluation and guidance to recommend their use. Evaluation of other methods is required to provide a comprehensive evidence map.
| S-EPMC6186052 | biostudies-literature
Project description:OBJECTIVE:This systematic review aimed to evaluate the ability of risk tools to predict the future episodes of suicide/self-harm in adolescents. DESIGN:Systematic review. DATA SOURCES:MEDLINE, EMBASE, CINAHL and PsycINFO were searched from inception to 3 March 2018. ELIGIBILITY CRITERIA FOR SELECTING STUDIES:Cohort studies, case-control studies and randomised controlled trials of adolescents aged 10-25 who had undergone risk assessment in a clinical setting following an episode of self-harm were included. DATA EXTRACTION AND SYNTHESIS:Two independent reviewers extracted data and assessed risk of bias. Data were grouped by tool and narrative synthesis undertaken, with studies appraised using a checklist combining the QUIPS (Quality In Prognosis Studies) and QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies) tools. RESULTS:Of the 17 137 articles initially identified, 11 studies evaluating 10 separate tools were included. The studies varied in setting, population and outcome measure. The majority of the studies were rated as having an unclear risk of bias, and meta-analysis was not possible due to high variability between studies.The ability of the tools to correctly identify those adolescents going on to make a self-harm/suicide attempt ranged from 27% (95% CI 10.7% to 50.2%) to 95.8% (95% CI 78.9% to 99.9%). A variety of metrics were provided for 1-10 points increases in various tools, for example, odds and HRs. CONCLUSIONS:This systematic review is the first to explore the use of assessment tools in adolescents. The predictive ability of these tools varies greatly. No single tool is suitable for predicting a higher risk of suicide or self-harm in adolescent populations. PROSPERO REGISTRATION NUMBER:CRD42017058686.
| S-EPMC6731844 | biostudies-other
Project description:Net reclassification indices have recently become popular statistics for measuring the prediction increment of new biomarkers. We review the various types of net reclassification indices and their correct interpretations. We evaluate the advantages and disadvantages of quantifying the prediction increment with these indices. For predefined risk categories, we relate net reclassification indices to existing measures of the prediction increment. We also consider statistical methodology for constructing confidence intervals for net reclassification indices and evaluate the merits of hypothesis testing based on such indices. We recommend that investigators using net reclassification indices should report them separately for events (cases) and nonevents (controls). When there are two risk categories, the components of net reclassification indices are the same as the changes in the true- and false-positive rates. We advocate the use of true- and false-positive rates and suggest it is more useful for investigators to retain the existing, descriptive terms. When there are three or more risk categories, we recommend against net reclassification indices because they do not adequately account for clinically important differences in shifts among risk categories. The category-free net reclassification index is a new descriptive device designed to avoid predefined risk categories. However, it experiences many of the same problems as other measures such as the area under the receiver operating characteristic curve. In addition, the category-free index can mislead investigators by overstating the incremental value of a biomarker, even in independent validation data. When investigators want to test a null hypothesis of no prediction increment, the well-established tests for coefficients in the regression model are superior to the net reclassification index. If investigators want to use net reclassification indices, confidence intervals should be calculated using bootstrap methods rather than published variance formulas. The preferred single-number summary of the prediction increment is the improvement in net benefit.
| S-EPMC3918180 | biostudies-literature
Project description:PurposeSuicide is a major cause of preventable death worldwide. Adequate training in risk assessment and intervention is key to suicide prevention. The use of simulation (role plays, simulated patients, virtual reality…) for practical training is a promising tool in mental health. The purpose of this study was to assess the effectiveness of simulation training in suicide risk assessment and intervention for healthcare professionals and gatekeepers.MethodsWe conducted a systematic review in Medline and PsycINFO up to 31 July 2021 of randomized controlled trials (RCTs), non-randomized controlled trials, and pre/post-test studies. RCTs were furthermore included in a meta-analysis. We assessed the methodological quality of all studies with the Medical Education Research Study Quality Instrument, and the Cochrane Risk of Bias tool 2.0 for RCTs. Primary outcomes were changes in Kirkpatrick criteria: attitudes, skills, knowledge, behaviors, and patient outcomes.ResultsWe included 96 articles representing 43,656 participants. Most pre/post-test (n = 65) and non-randomized controlled (n = 14) studies showed significant improvement in attitudes, skills, knowledge, and behaviors. The meta-analysis of 11 RCTs showed positive changes in attitudes immediately after training and at 2-4 months post-training; in self-perceived skills at 6 months post-training; but not in factual knowledge. Studies assessing benefits for patients are still limited.ConclusionsThe heterogeneity of methodological designs, interventions, and trained populations combined with a limited number of RCTs and studies on patients' outcomes limit the strength of the evidence. However, preliminary findings suggest that simulation is promising for practical training in suicidal crisis intervention and should be further studied.
| S-EPMC10120456 | biostudies-literature
Project description:Although religion is reported to be protective against suicide, the empirical evidence is inconsistent. Research is complicated by the fact that there are many dimensions to religion (affiliation, participation, doctrine) and suicide (ideation, attempt, completion). We systematically reviewed the literature on religion and suicide over the last 10 years (89 articles) with a goal of identifying what specific dimensions of religion are associated with specific aspects of suicide. We found that religious affiliation does not necessarily protect against suicidal ideation, but does protect against suicide attempts. Whether religious affiliation protects against suicide attempts may depend on the culture-specific implications of affiliating with a particular religion, since minority religious groups can feel socially isolated. After adjusting for social support measures, religious service attendance is not especially protective against suicidal ideation, but does protect against suicide attempts, and possibly protects against suicide. Future qualitative studies might further clarify these associations.
| S-EPMC7310534 | biostudies-literature
Project description:ImportanceMeasurement of delirium severity has been recognized as highly important for tracking prognosis, monitoring response to treatment, and estimating burden of care for patients both during and after hospitalization. Rather than simply rating delirium as present or absent, the ability to quantify its severity would enable development and monitoring of more effective treatment approaches for the condition.ObjectivesTo present a comprehensive review of delirium severity instruments, conduct a methodologic quality rating of the original validation study of the most commonly used instruments, and select a group of top-rated instruments.Evidence reviewThis systematic review was conducted using literature from Embase, PsycINFO, PubMed, Web of Science, and Cumulative Index to Nursing and Allied Health Literature, from January 1, 1974, through March 31, 2017, with the key words delirium, severity, tests, measures, and intensity. Inclusion criteria were original articles assessing delirium severity and using a delirium-specific severity instrument. Final listings of articles were supplemented with hand searches of reference listings to ensure completeness. At least 2 reviewers independently completed each step of the review process: article selection, data extraction, and methodologic quality assessment of relevant articles using a validated rating scale. All discrepancies between raters were resolved by consensus.FindingsOf 9409 articles identified, 228 underwent full text review, and we identified 42 different instruments of delirium severity. Eleven of the 42 tools were multidomain, delirium-specific instruments providing a quantitative rating of delirium severity; these instruments underwent a methodologic quality review. Applying prespecified criteria related to frequency of use, methodologic quality, construct or predictive validity, and broad domain coverage, an expert panel used an iterative modified Delphi process to select 6 final high-quality instruments meeting these criteria: the Confusion Assessment Method-Severity Score, Confusional State Examination, Delirium-O-Meter, Delirium Observation Scale, Delirium Rating Scale, and Memorial Delirium Assessment Scale.Conclusions and relevanceThe 6 instruments identified may enable accurate measurement of delirium severity to improve clinical care for patients with this condition. This work may stimulate increased usage and head-to-head comparison of these instruments.
| S-EPMC6382582 | biostudies-literature
Project description:Although many instruments are used to assess the families of people with diabetes, their measurement properties have not been systematically reviewed. We aimed to identify and evaluate the psychometric properties of the instruments used to assess family functioning in adults with diabetes.MethodsA systematic literature review, according to the JBI systematic reviews of measurement properties, was conducted using different databases, including gray literature. PROSPERO registration number: CRD42021239733. Two independent reviewers searched, screened, and assessed the risk of bias among the articles according to the COSMIN methodology. The quality of each included instrument was assessed using the updated criteria for good measurement properties.ResultsEighty-one studies were included, and thirty-one eligible instruments were identified. The psychometric properties frequently assessed were structural validity, internal consistency, and construct validity.ConclusionsAlthough 31 instruments were included, none of their psychometric properties were scored as "very good". From the instruments scored as adequate on development and content validity, five stood out for their quality appraisal.. The development of new instruments is not recommended. More studies should be conducted on the existing instruments to assess the less commonly evaluated psychometric properties. Using valid instruments to develop and evaluate interventions is essential to promote health literacy and the effectiveness of diabetes management.
| S-EPMC9859216 | biostudies-literature