Dataset Information

Reporting of Positive Results in Randomized Controlled Trials of Mindfulness-Based Mental Health Interventions.

ABSTRACT:

Background

A large proportion of mindfulness-based therapy trials report statistically significant results, even in the context of very low statistical power. The objective of the present study was to characterize the reporting of "positive" results in randomized controlled trials of mindfulness-based therapy. We also assessed mindfulness-based therapy trial registrations for indications of possible reporting bias and reviewed recent systematic reviews and meta-analyses to determine whether reporting biases were identified.

Methods

CINAHL, Cochrane CENTRAL, EMBASE, ISI, MEDLINE, PsycInfo, and SCOPUS databases were searched for randomized controlled trials of mindfulness-based therapy. The number of positive trials was described and compared to the number that might be expected if mindfulness-based therapy were similarly effective compared to individual therapy for depression. Trial registries were searched for mindfulness-based therapy registrations. CINAHL, Cochrane CENTRAL, EMBASE, ISI, MEDLINE, PsycInfo, and SCOPUS were also searched for mindfulness-based therapy systematic reviews and meta-analyses.

Results

108 (87%) of 124 published trials reported ≥1 positive outcome in the abstract, and 109 (88%) concluded that mindfulness-based therapy was effective, 1.6 times greater than the expected number of positive trials based on effect size d = 0.55 (expected number positive trials = 65.7). Of 21 trial registrations, 13 (62%) remained unpublished 30 months post-trial completion. No trial registrations adequately specified a single primary outcome measure with time of assessment. None of 36 systematic reviews and meta-analyses concluded that effect estimates were overestimated due to reporting biases.

Conclusions

The proportion of mindfulness-based therapy trials with statistically significant results may overstate what would occur in practice.

SUBMITTER: Coronado-Montoya S

PROVIDER: S-EPMC4825994 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:This study aims to intensively evaluate the effectiveness of mindfulness-based intervention (MBI) on mental illness risks (including psychological distress, prolonged fatigue, and perceived stress) and job strain (job control and job demands) for employees with poor mental health.A longitudinal research design was adopted. In total, 144 participants were randomized to the intervention group or the control group. The intervention group participated in MBI for eight weeks. Measurements were collected for both groups at five time points: at pre-intervention (T1), at mid-intervention (T2), at the completion of intervention (T3), four weeks after intervention (T4), and eight weeks after intervention (T5). Data were analyzed according to the intention-to-treat principle. A linear mixed model with two levels was employed to analyze the repeated measurement data.Compared with the control group, the intercepts (means at T3) for the intervention group were significantly lower on psychological distress, prolonged fatigue, and perceived stress when MBI was completed. Even with the demographic variables controlled, the positive effects remained. For growth rates of prolonged fatigue and perceived stress, participants in the intervention group showed a steeper decrease than did the participants in the control group. Regarding job strain, although the intercept (mean at T3) of job demands showed a significant decline when BMI was completed, the significance disappeared when the demographic variables were controlled. Moreover, the other results for job control and job demands did not show promising findings.As a workplace health promotion program, the MBI seems to have potential in improving mental illness risks for employees with poor mental health. However, there was insufficient evidence to support its effect on mitigating job strain. Further research on maintaining the positive effects on mental health for the long term and on developing innovative MBI to suit job strain are recommended.ClinicalTrials.gov NCT02241070.

Project description:BackgroundThe COVID-19 pandemic has had adverse impacts on mental health and substance use worldwide. Systematic reviews suggest eHealth interventions can be effective at addressing these problems. However, strong positive eHealth outcomes are often tied to the intensity of web-based therapist guidance, which has time and cost implications that can make the population scale-up of more effective interventions difficult. A way to offset cost while maintaining the intensity of therapist guidance is to offer eHealth programs to groups rather than more standard one-on-one formats.ObjectiveThis systematic review aims to assess experimental evidence for the effectiveness of live health professional-led group eHealth interventions on mental health, substance use, or bereavement among community-dwelling adults. Within the articles selected for our primary aim, we also seek to examine the impact of interventions that encourage physical activity compared with those that do not.MethodsOverall, 4 databases (MEDLINE, CINAHL, PsycINFO, and the Cochrane Library) were searched in July 2020. Eligible studies were randomized controlled trials (RCTs) of eHealth interventions led by health professionals and delivered entirely to adult groups by videoconference, teleconference, or webchat. Eligible studies reported mental health, substance use, or bereavement as primary outcomes. The results were examined by outcome, eHealth platform, and intervention length. Postintervention data were used to calculate effect size by study. The findings were summarized using the Synthesis Without Meta-Analysis guidelines. Risk of bias was assessed using the Cochrane Collaboration Tool.ResultsOf the 4099 identified studies, 21 (0.51%) RCTs representing 20 interventions met the inclusion criteria. These studies examined mental health outcomes among 2438 participants (sample size range: 47-361 participants per study) across 7 countries. When effect sizes were pooled, live health professional-led group eHealth interventions had a medium effect on reducing anxiety compared with inactive (Cohen d=0.57) or active control (Cohen d=0.48), a medium to small effect on reducing depression compared with inactive (Cohen d=0.61) or active control (Cohen d=0.21), and mixed effects on mental distress and coping. Interventions led by videoconference, and those that provided 8-12 hours of live health professional-led group contact had more robust effects on adult mental health. Risk of bias was high in 91% (19/21) of the studies. Heterogeneity across interventions was significant, resulting in low to very low quality of evidence. No eligible RCT was found that examined substance use, bereavement, or physical activity.ConclusionsLive eHealth group interventions led by health professionals can foster moderate improvements in anxiety and moderate to small improvements in depression among community-based adults, particularly those delivered by videoconference and those providing 8-12 hours of synchronous engagement.Trial registrationPROSPERO CRD42020187551; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=187551.International registered report identifier (irrid)RR2-10.1186/s13643-020-01479-3.