Dataset Information

Development and Validation of a Dynamic Risk Prediction Model to Forecast Psychosis Onset in Patients at Clinical High Risk.

ABSTRACT: The prediction of outcomes in patients at Clinical High Risk for Psychosis (CHR-P) almost exclusively relies on static data obtained at a single snapshot in time (ie, baseline data). Although the CHR-P symptoms are intrinsically evolving over time, available prediction models cannot be dynamically updated to reflect these changes. Hence, the aim of this study was to develop and internally validate a dynamic risk prediction model (joint model) and to implement this model in a user-friendly online risk calculator. Furthermore, we aimed to explore the prognostic performance of extended dynamic risk prediction models and to compare static with dynamic prediction. One hundred ninety-six CHR-P patients were recruited as part of the "Basel Früherkennung von Psychosen" (FePsy) study. Psychopathology and transition to psychosis was assessed at regular intervals for up to 5 years using the Brief Psychiatric Rating Scale-Expanded (BPRS-E). Various specifications of joint models were compared with regard to their cross-validated prognostic performance. We developed and internally validated a joint model that predicts psychosis onset from BPRS-E disorganization and years of education at baseline and BPRS-E positive symptoms during the follow-up with good prognostic performance. The model was implemented as online risk calculator (http://www.fepsy.ch/DPRP/). The use of extended joint models slightly increased the prognostic accuracy compared to basic joint models, and dynamic models showed a higher prognostic accuracy than static models. Our results confirm that extended joint modeling could improve the prediction of psychosis in CHR-P patients. We implemented the first online risk calculator that can dynamically update psychosis risk prediction.

SUBMITTER: Studerus E

PROVIDER: S-EPMC7442327 | biostudies-literature | 2020 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and Validation of a Dynamic Risk Prediction Model to Forecast Psychosis Onset in Patients at Clinical High Risk.

Studerus Erich E Beck Katharina K Fusar-Poli Paolo P Riecher-Rössler Anita A

Schizophrenia bulletin 20200201 2

The prediction of outcomes in patients at Clinical High Risk for Psychosis (CHR-P) almost exclusively relies on static data obtained at a single snapshot in time (ie, baseline data). Although the CHR-P symptoms are intrinsically evolving over time, available prediction models cannot be dynamically updated to reflect these changes. Hence, the aim of this study was to develop and internally validate a dynamic risk prediction model (joint model) and to implement this model in a user-friendly online ...[more]

PMID: 31355885

Similar Datasets

Project description:Background: The Clinical High Risk state for Psychosis (CHR-P) has become the cornerstone of modern preventive psychiatry. The next stage of clinical advancements rests on the ability to formulate a more accurate prognostic estimate at the individual subject level. Individual Participant Data Meta-Analyses (IPD-MA) are robust evidence synthesis methods that can also offer powerful approaches to the development and validation of personalized prognostic models. The aim of the study was to develop and validate an individualized, clinically based prognostic model for forecasting transition to psychosis from a CHR-P stage. Methods: A literature search was performed between January 30, 2016, and February 6, 2016, consulting PubMed, Psychinfo, Picarta, Embase, and ISI Web of Science, using search terms ("ultra high risk" OR "clinical high risk" OR "at risk mental state") AND [(conver* OR transition* OR onset OR emerg* OR develop*) AND psychosis] for both longitudinal and intervention CHR-P studies. Clinical knowledge was used to a priori select predictors: age, gender, CHR-P subgroup, the severity of attenuated positive psychotic symptoms, the severity of attenuated negative psychotic symptoms, and level of functioning at baseline. The model, thus, developed was validated with an extended form of internal validation. Results: Fifteen of the 43 studies identified agreed to share IPD, for a total sample size of 1,676. There was a high level of heterogeneity between the CHR-P studies with regard to inclusion criteria, type of assessment instruments, transition criteria, preventive treatment offered. The internally validated prognostic performance of the model was higher than chance but only moderate [Harrell's C-statistic 0.655, 95% confidence interval (CIs), 0.627-0.682]. Conclusion: This is the first IPD-MA conducted in the largest samples of CHR-P ever collected to date. An individualized prognostic model based on clinical predictors available in clinical routine was developed and internally validated, reaching only moderate prognostic performance. Although personalized risk prediction is of great value in the clinical practice, future developments are essential, including the refinement of the prognostic model and its external validation. However, because of the current high diagnostic, prognostic, and therapeutic heterogeneity of CHR-P studies, IPD-MAs in this population may have an limited intrinsic power to deliver robust prognostic models.

Project description:BackgroundYoung people with psychosis are at high risk of developing cardiometabolic disorders; however, there is no suitable cardiometabolic risk prediction algorithm for this group. We aimed to develop and externally validate a cardiometabolic risk prediction algorithm for young people with psychosis.MethodsWe developed the Psychosis Metabolic Risk Calculator (PsyMetRiC) to predict up to 6-year risk of incident metabolic syndrome in young people (aged 16-35 years) with psychosis from commonly recorded information at baseline. We developed two PsyMetRiC versions using the forced entry method: a full model (including age, sex, ethnicity, body-mass index, smoking status, prescription of a metabolically active antipsychotic medication, HDL concentration, and triglyceride concentration) and a partial model excluding biochemical results. PsyMetRiC was developed using data from two UK psychosis early intervention services (Jan 1, 2013, to Nov 4, 2020) and externally validated in another UK early intervention service (Jan 1, 2012, to June 3, 2020). A sensitivity analysis was done in UK birth cohort participants (aged 18 years) who were at risk of developing psychosis. Algorithm performance was assessed primarily via discrimination (C statistic) and calibration (calibration plots). We did a decision curve analysis and produced an online data-visualisation app.Findings651 patients were included in the development samples, 510 in the validation sample, and 505 in the sensitivity analysis sample. PsyMetRiC performed well at internal (full model: C 0·80, 95% CI 0·74-0·86; partial model: 0·79, 0·73-0·84) and external validation (full model: 0·75, 0·69-0·80; and partial model: 0·74, 0·67-0·79). Calibration of the full model was good, but there was evidence of slight miscalibration of the partial model. At a cutoff score of 0·18, in the full model PsyMetRiC improved net benefit by 7·95% (sensitivity 75%, 95% CI 66-82; specificity 74%, 71-78), equivalent to detecting an additional 47% of metabolic syndrome cases.InterpretationWe have developed an age-appropriate algorithm to predict the risk of incident metabolic syndrome, a precursor of cardiometabolic morbidity and mortality, in young people with psychosis. PsyMetRiC has the potential to become a valuable resource for early intervention service clinicians and could enable personalised, informed health-care decisions regarding choice of antipsychotic medication and lifestyle interventions.FundingNational Institute for Health Research and Wellcome Trust.

Project description:ImportanceThe overall effect of At Risk Mental State (ARMS) services for the detection of individuals who will develop psychosis in secondary mental health care is undetermined.ObjectiveTo measure the proportion of individuals with a first episode of psychosis detected by ARMS services in secondary mental health services, and to develop and externally validate a practical web-based individualized risk calculator tool for the transdiagnostic prediction of psychosis in secondary mental health care.Design, setting, and participantsClinical register-based cohort study. Patients were drawn from electronic, real-world, real-time clinical records relating to 2008 to 2015 routine secondary mental health care in the South London and the Maudsley National Health Service Foundation Trust. The study included all patients receiving a first index diagnosis of nonorganic and nonpsychotic mental disorder within the South London and the Maudsley National Health Service Foundation Trust in the period between January 1, 2008, and December 31, 2015. Data analysis began on September 1, 2016.Main outcomes and measuresRisk of development of nonorganic International Statistical Classification of Diseases and Related Health Problems, Tenth Revision psychotic disorders.ResultsA total of 91 199 patients receiving a first index diagnosis of nonorganic and nonpsychotic mental disorder within South London and the Maudsley National Health Service Foundation Trust were included in the derivation (n = 33 820) or external validation (n = 54 716) data sets. The mean age was 32.97 years, 50.88% were men, and 61.05% were white race/ethnicity. The mean follow-up was 1588 days. The overall 6-year risk of psychosis in secondary mental health care was 3.02 (95% CI, 2.88-3.15), which is higher than the 6-year risk in the local general population (0.62). Compared with the ARMS designation, all of the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision diagnoses showed a lower risk of psychosis, with the exception of bipolar mood disorders (similar risk) and brief psychotic episodes (higher risk). The ARMS designation accounted only for a small proportion of transitions to psychosis (n = 52 of 1001; 5.19% in the derivation data set), indicating the need for transdiagnostic prediction of psychosis in secondary mental health care. A prognostic risk stratification model based on preselected variables, including index diagnosis, age, sex, age by sex, and race/ethnicity, was developed and externally validated, showing good performance and potential clinical usefulness.Conclusions and relevanceThis online individualized risk calculator can be of clinical usefulness for the transdiagnostic prediction of psychosis in secondary mental health care. The risk calculator can help to identify those patients at risk of developing psychosis who require an ARMS assessment and specialized care. The use of this calculator may eventually facilitate the implementation of an individualized provision of preventive focused interventions and improve outcomes of first episode psychosis.

Project description:Because existing risk prediction models for lung cancer were developed in white populations, they may not be appropriate for predicting risk among African-Americans. Therefore, a need exists to construct and validate a risk prediction model for lung cancer that is specific to African-Americans. We analyzed data from 491 African-Americans with lung cancer and 497 matched African-American controls to identify specific risks and incorporate them into a multivariable risk model for lung cancer and estimate the 5-year absolute risk of lung cancer. We performed internal and external validations of the risk model using data on additional cases and controls from the same ongoing multiracial/ethnic lung cancer case-control study from which the model-building data were obtained as well as data from two different lung cancer studies in metropolitan Detroit, respectively. We also compared our African-American model with our previously developed risk prediction model for whites. The final risk model included smoking-related variables [smoking status, pack-years smoked, age at smoking cessation (former smokers), and number of years since smoking cessation (former smokers)], self-reported physician diagnoses of chronic obstructive pulmonary disease or hay fever, and exposures to asbestos or wood dusts. Our risk prediction model for African-Americans exhibited good discrimination [75% (95% confidence interval, 0.67-0.82)] for our internal data and moderate discrimination [63% (95% confidence interval, 0.57-0.69)] for the external data group, which is an improvement over the Spitz model for white subjects. Existing lung cancer prediction models may not be appropriate for predicting risk for African-Americans because (a) they were developed using white populations, (b) level of risk is different for risk factors that African-American share with whites, and (c) unique group-specific risk factors exist for African-Americans. This study developed and validated a risk prediction model for lung cancer that is specific to African-Americans and thus more precise in predicting their risks. These findings highlight the importance of conducting further ethnic-specific analyses of disease risk.

Project description:BackgroundIntensive care unit (ICU) outcome prediction models, such as Acute Physiology And Chronic Health Evaluation (APACHE), were designed in general critical care populations and their use in obstetric populations is contentious. The aim of the CIPHER (Collaborative Integrated Pregnancy High-dependency Estimate of Risk) study was to develop and internally validate a multivariable prognostic model calibrated specifically for pregnant or recently delivered women admitted for critical care.MethodsA retrospective observational cohort was created for this study from 13 tertiary facilities across five high-income and six low- or middle-income countries. Women admitted to an ICU for more than 24 h during pregnancy or less than 6 weeks post-partum from 2000 to 2012 were included in the cohort. A composite primary outcome was defined as maternal death or need for organ support for more than 7 days or acute life-saving intervention. Model development involved selection of candidate predictor variables based on prior evidence of effect, availability across study sites, and use of LASSO (Least Absolute Shrinkage and Selection Operator) model building after multiple imputation using chained equations to address missing data for variable selection. The final model was estimated using multivariable logistic regression. Internal validation was completed using bootstrapping to correct for optimism in model performance measures of discrimination and calibration.ResultsOverall, 127 out of 769 (16.5%) women experienced an adverse outcome. Predictors included in the final CIPHER model were maternal age, surgery in the preceding 24 h, systolic blood pressure, Glasgow Coma Scale score, serum sodium, serum potassium, activated partial thromboplastin time, arterial blood gas (ABG) pH, serum creatinine, and serum bilirubin. After internal validation, the model maintained excellent discrimination (area under the curve of the receiver operating characteristic (AUROC) 0.82, 95% confidence interval (CI) 0.81 to 0.84) and good calibration (slope of 0.92, 95% CI 0.91 to 0.92 and intercept of -0.11, 95% CI -0.13 to -0.08).ConclusionsThe CIPHER model has the potential to be a pragmatic risk prediction tool. CIPHER can identify critically ill pregnant women at highest risk for adverse outcomes, inform counseling of patients about risk, and facilitate bench-marking of outcomes between centers by adjusting for baseline risk.

Dataset Information

Development and Validation of a Dynamic Risk Prediction Model to Forecast Psychosis Onset in Patients at Clinical High Risk.

Publications

Development and Validation of a Dynamic Risk Prediction Model to Forecast Psychosis Onset in Patients at Clinical High Risk.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets