Dataset Information

Investigating data-driven biological subtypes of sychiatric disorders using specification-curve analysis.

ABSTRACT:

Background

Cluster analyses have become popular tools for data-driven classification in biological psychiatric research. However, these analyses are known to be sensitive to the chosen methods and/or modelling options, which may hamper generalizability and replicability of findings. To gain more insight into this problem, we used Specification-Curve Analysis (SCA) to investigate the influence of methodological variation on biomarker-based cluster-analysis results.

Methods

Proteomics data (31 biomarkers) were used from patients (n = 688) and healthy controls (n = 426) in the Netherlands Study of Depression and Anxiety. In SCAs, consistency of results was evaluated across 1200 k-means and hierarchical clustering analyses, each with a unique combination of the clustering algorithm, fit-index, and distance metric. Next, SCAs were run in simulated datasets with varying cluster numbers and noise/outlier levels to evaluate the effect of data properties on SCA outcomes.

Results

The real data SCA showed no robust patterns of biological clustering in either the MDD or a combined MDD/healthy dataset. The simulation results showed that the correct number of clusters could be identified quite consistently across the 1200 model specifications, but that correct cluster identification became harder when the number of clusters and noise levels increased.

Conclusion

SCA can provide useful insights into the presence of clusters in biomarker data. However, SCA is likely to show inconsistent results in real-world biomarker datasets that are complex and contain considerable levels of noise. Here, the number and nature of the observed clusters may depend strongly on the chosen model-specification, precluding conclusions about the existence of biological clusters among psychiatric patients.

SUBMITTER: Beijers L

PROVIDER: S-EPMC9069352 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Investigating data-driven biological subtypes of psychiatric disorders using specification-curve analysis.

Beijers Lian L van Loo Hanna M HM Romeijn Jan-Willem JW Lamers Femke F Schoevers Robert A RA Wardenaar Klaas J KJ

Psychological medicine 20200811 6

<h4>Background</h4>Cluster analyses have become popular tools for data-driven classification in biological psychiatric research. However, these analyses are known to be sensitive to the chosen methods and/or modelling options, which may hamper generalizability and replicability of findings. To gain more insight into this problem, we used Specification-Curve Analysis (SCA) to investigate the influence of methodological variation on biomarker-based cluster-analysis results.<h4>Methods</h4>Proteomi ...[more]

PMID: 32779563

Similar Datasets

Project description:BackgroundImpairment of executive function (EF), the goal-directed regulation of thoughts, actions, and emotions, drives negative outcomes and is common across neurodevelopmental disorders including attention deficit hyperactivity disorder (ADHD) and autism spectrum disorder (ASD). A primary challenge to its amelioration is heterogeneity in symptom expression within and across disorders. Parsing this heterogeneity is necessary to attain diagnostic precision, a goal of the NIMH Research Domain Criteria Initiative. We aimed to identify transdiagnostic subtypes of EF that span the normal to impaired spectrum and establish their predictive and neurobiological validity.MethodsCommunity detection was applied to clinical parent-report measures in 8-14-year-old children with and without ADHD and ASD from two independent cohorts (discovery N = 320; replication N = 692) to identify subgroups with distinct behavioral profiles. Support vector machine (SVM) classification was used to predict subgroup membership of unseen cases. Preliminary neurobiological validation was obtained with existing functional magnetic resonance imaging (fMRI) data on a subsample (N = 84) by testing hypotheses about sensitivity of EF subgroups versus DSM categories.ResultsWe observed three transdiagnostic EF subtypes characterized by behavioral profiles that were defined by relative weakness in: (a) flexibility and emotion regulation; (b) inhibition; and (c) working memory, organization, and planning. The same tripartite structure was also present in the typically developing children. SVM trained on the discovery sample and tested on the replication sample classified subgroup membership with 77.0% accuracy. Split-half SVM classification on the combined sample (N = 1,012) yielded 88.9% accuracy (this SVM is available for public use). As hypothesized, frontal-parietal engagement was better distinguished by EF subtype than DSM diagnosis and the subgroup characterized with inflexibility failed to modulate right IPL activation in response to increased executive demands.ConclusionsThe observed transdiagnostic subtypes refine current diagnostic nosology and augment clinical decision-making for personalizing treatment of executive dysfunction in children.