Dataset Information

Reinforcement Learning Disruptions in Individuals With Depression and Sensitivity to Symptom Change Following Cognitive Behavioral Therapy.

ABSTRACT:

Importance

Major depressive disorder is prevalent and impairing. Parsing neurocomputational substrates of reinforcement learning in individuals with depression may facilitate a mechanistic understanding of the disorder and suggest new cognitive therapeutic targets.

Objective

To determine associations among computational model-derived reinforcement learning parameters, depression symptoms, and symptom changes after treatment.

Design, setting, and participants

In this mixed cross-sectional-cohort study, individuals performed reward and loss variants of a probabilistic learning task during functional magnetic resonance imaging at baseline and follow-up. A volunteer sample with and without a depression diagnosis was recruited from the community. Participants were assessed from July 2011 to February 2017, and data were analyzed from May 2017 to May 2021.

Main outcomes and measures

Computational model-based analyses of participants' choices assessed a priori hypotheses about associations between components of reward-based and loss-based learning with depression symptoms. Changes in both learning parameters and symptoms were then assessed in a subset of participants who received cognitive behavioral therapy (CBT).

Results

Of 101 included adults, 69 (68.3%) were female, and the mean (SD) age was 34.4 (11.2) years. A total of 69 participants with a depression diagnosis and 32 participants without a depression diagnosis were included at baseline; 48 participants (28 with depression who received CBT and 20 without depression) were included at follow-up (mean [SD] of 115.1 [15.6] days). Computational model-based analyses of behavioral choices and neural data identified associations of learning with symptoms during reward learning and loss learning, respectively. During reward learning only, anhedonia (and not negative affect or arousal) was associated with model-derived learning parameters (learning rate: posterior mean regression β = -0.14; 95% credible interval [CrI], -0.12 to -0.03; outcome sensitivity: posterior mean regression β = 0.18; 95% CrI, 0.02 to 0.37) and neural learning signals (moderation of association between striatal prediction error and expected value signals: t97 = -2.10; P = .04). During loss learning only, negative affect (and not anhedonia or arousal) was associated with learning parameters (outcome shift: posterior mean regression β = -0.11; 95% CrI, -0.20 to -0.01) and disrupted neural encoding of learning signals (association with subgenual anterior cingulate prediction error signals: r = -0.28; P = .005). Symptom improvement following CBT was associated with normalization of learning parameters that were disrupted at baseline (reward learning rate: posterior mean regression β = 0.15; 90% CrI, 0.001 to 0.41; loss outcome shift: posterior mean regression β = 0.42; 90% CrI, 0.09 to 0.77).

Conclusions and relevance

In this study, the mapping of reinforcement learning components to symptoms of major depression revealed mechanistic features associated with these symptoms and points to possible learning-based therapeutic processes and targets.

SUBMITTER: Brown VM

PROVIDER: S-EPMC8319827 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundDepressive and anxiety disorders are the most common mental disorders, and there is a critical need for effective, affordable, and accessible interventions. Cognitive Behavioral Immersion (CBI) is a novel group-based cognitive behavioral skills training program delivered by lay coaches in the metaverse that can be accessed through various modalities including virtual reality (VR) head-mounted displays or flat-screen devices. Combining its ability to offer empirically supported therapy skills in a digital setting that can still facilitate interpersonal variables (eg, working alliance and sense of social support) with the aid of lay coaches, CBI has the potential to help fill this critical need.ObjectiveThis study had 2 primary aims. First, we aimed to examine changes in depression and anxiety symptoms in a sample of individuals who participated in CBI. Second, we aimed to examine 2 interpersonal process variables (working alliance and web-based social support) as predictors of symptom changes. We predicted CBI participants would experience depression and anxiety symptom improvements and that such improvements would be associated with an increase in both interpersonal process variables.MethodsThe study sample consists of 127 participants who endorsed clinical levels of depression or anxiety symptoms during their first CBI session and attended at least 2 sessions. Participants were asked to complete self-report measures of depression symptoms, anxiety symptoms, alliance, and web-based social support throughout their participation in CBI.ResultsRepeated measures ANOVAs determined that depression and anxiety symptom scores differed significantly across sessions (Ps<.01). We also found participants' web-based social support predicted improvement in depression symptoms (P=.01), but neither the alliance nor web-based social support predicted change in anxiety symptoms (Ps>.05). We also observed a significant difference in anxiety symptoms between participants who used a VR head-mounted display to access CBI and those who did not, such that participants who used VR head-mounted displays endorsed lower anxiety symptoms than those who did not at nearly every session (P=.04).ConclusionsParticipation in CBI is associated with both depression and anxiety symptom improvement. Web-based social support may play an important role in fostering changes in depression symptoms. Future studies are encouraged to continue examining the process of change in CBI with special attention paid to methods that can elucidate causal mechanisms of change.

Project description:ObjectiveWe tested nomothetic and idiographic convergence and change in 3 symptom measures during acute-phase cognitive therapy (CT) for depression and compared outcomes among patients showing different change patterns.MethodOutpatients (N = 362; 69% women; 85% White; age M = 43 years) with recurrent major depressive disorder according to criteria in the Diagnostic and Statistical Manual of Mental Disorders (4th ed., text rev.; American Psychiatric Association, 2000) completed the Hamilton Rating Scale for Depression (Hamilton, 1960), Beck Depression Inventory (Beck, Ward, Mendelson, Mock, & Erbaugh, 1961), and Inventory for Depressive Symptomatology-Self-Report (Rush, Gullion, Basco, Jarrett, & Trivedi, 1996) on 14 occasions as well as pre/post-CT measures of social-interpersonal functioning and negative cognitive content.ResultsThe 3 symptom measures marked the same severity and change constructs, and we offer improved formulas for intermeasure score conversions via their common factor. Pre/post-CT symptom reductions were large (ds = 1.71-1.92), and nomothetic symptom curves were log-linear (larger improvements earlier and smaller improvements later in CT). Nonetheless, only 30% of individual patients showed clear log-linear changes, whereas other patients showed linear (e.g., steady decreases; 20%), 1-step (e.g., a quick drop; 16%), and unclassified (34%) patterns. Log-linear, linear, and 1-step patients were generally similar to one another and superior to unclassified patients post-CT in symptom levels, response and stable remission rates, social-interpersonal functioning, and cognitive content (median d = 0.69).ConclusionsReaching a low-symptom "destination" at the end of CT via any coherent "path" is more important in the short term than which path patients take. We discuss implications for theories of change, clinical monitoring of individuals' progress in CT, and the need to investigate long-term outcomes of patients with differing patterns of symptom change.

Project description:BACKGROUND:Aberrant activity of the subcallosal cingulate (SCC) is a common theme across pharmacologic treatment efficacy prediction studies. The functioning of the SCC in psychotherapeutic interventions is relatively understudied, as are functional differences among SCC subdivisions. We conducted functional connectivity analyses (rsFC) on resting-state functional magnetic resonance imaging (fMRI) data, collected before and after a course of cognitive behavioral therapy (CBT) in patients with major depressive disorder (MDD), using seeds from three SCC subdivisions. METHODS:Resting-state data were collected from unmedicated patients with current MDD (Hamilton Depression Rating Scale-17 > 16) before and after 14-sessions of CBT monotherapy. Treatment outcome was assessed using the Beck Depression Inventory (BDI). Rostral anterior cingulate (rACC), anterior subcallosal cingulate (aSCC), and Brodmann's area 25 (BA25) masks were used as seeds in connectivity analyses that assessed baseline rsFC and symptom severity, changes in connectivity related to symptom improvement after CBT, and prediction of treatment outcomes using whole-brain baseline connectivity. RESULTS:Pretreatment BDI negatively correlated with pretreatment rACC ~ dorsolateral prefrontal cortex and aSCC ~ lateral prefrontal cortex rsFC. In a region-of-interest longitudinal analysis, rsFC between these regions increased post-treatment (p < 0.05FDR). In whole-brain analyses, BA25 ~ paracentral lobule and rACC ~ paracentral lobule connectivities decreased post-treatment. Whole-brain baseline rsFC with SCC did not predict clinical improvement. CONCLUSIONS:rsFC features of rACC and aSCC, but not BA25, correlated inversely with baseline depression severity, and increased following CBT. Subdivisions of SCC involved in top-down emotion regulation may be more involved in cognitive interventions, while BA25 may be more informative for interventions targeting bottom-up processing. Results emphasize the importance of subdividing the SCC in connectivity analyses.

Project description:ObjectiveConsistent evidence suggests residual depressive symptomology are the strongest predictors of depression relapse following cognitive-behavioral therapy (CBT) and antidepressant medications (ADM's). Psychometric network models help detecting and understanding central symptoms that remain post-treatment, along with their complex co-occurrences. However, individual psychometric network studies show inconsistent findings. This systematic review and IPD network analysis aimed to estimate and compare the symptom network structures of residual depressive symptoms following CBT, ADM's, and their combination.MethodsPsycINFO, PsycArticles, and PubMed were systematically searched through October 2020 for studies that have assessed individuals with major depression at post-treatment receiving either CBT and/or ADM's (venlafaxine, escitalopram, mirtazapine). IPD was requested from eligible samples to estimate and compare residual symptom psychometric network models post-CBT and post-ADM's.ResultsIn total, 25 from 663 eligible samples, including 1,389 patients qualified for the IPD. Depressed mood and anhedonia were consistently central residual symptoms post-CBT and post-ADM's. For CBT, fatigue-related and anxiety symptoms were also central post-treatment. A significant difference in network structure across treatments (CBT vs. ADM) was observed for samples measuring depression severity using the MADRS. Specifically, stronger symptom occurrences were present amongst lassitude-suicide post-CBT (vs. ADM's) and amongst lassitude-inability to feel post-ADM's (vs. CBT). No significant difference in global strength was observed across treatments.ConclusionsCore major depression symptoms remain central across treatments, strategies to target these symptoms should be considered. Anxiety and fatigue related complaints also remain central post-CBT. Efforts must be made amongst researchers, institutions, and journals to permit sharing of IPD.Systematic Review Registration: A protocol was prospectively registered on PROSPERO (CRD42020141663; https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=141663).