Dataset Information

Effectiveness and Safety of Using Chatbots to Improve Mental Health: Systematic Review and Meta-Analysis.

ABSTRACT: BACKGROUND:The global shortage of mental health workers has prompted the utilization of technological advancements, such as chatbots, to meet the needs of people with mental health conditions. Chatbots are systems that are able to converse and interact with human users using spoken, written, and visual language. While numerous studies have assessed the effectiveness and safety of using chatbots in mental health, no reviews have pooled the results of those studies. OBJECTIVE:This study aimed to assess the effectiveness and safety of using chatbots to improve mental health through summarizing and pooling the results of previous studies. METHODS:A systematic review was carried out to achieve this objective. The search sources were 7 bibliographic databases (eg, MEDLINE, EMBASE, PsycINFO), the search engine "Google Scholar," and backward and forward reference list checking of the included studies and relevant reviews. Two reviewers independently selected the studies, extracted data from the included studies, and assessed the risk of bias. Data extracted from studies were synthesized using narrative and statistical methods, as appropriate. RESULTS:Of 1048 citations retrieved, we identified 12 studies examining the effect of using chatbots on 8 outcomes. Weak evidence demonstrated that chatbots were effective in improving depression, distress, stress, and acrophobia. In contrast, according to similar evidence, there was no statistically significant effect of using chatbots on subjective psychological wellbeing. Results were conflicting regarding the effect of chatbots on the severity of anxiety and positive and negative affect. Only two studies assessed the safety of chatbots and concluded that they are safe in mental health, as no adverse events or harms were reported. CONCLUSIONS:Chatbots have the potential to improve mental health. However, the evidence in this review was not sufficient to definitely conclude this due to lack of evidence that their effect is clinically important, a lack of studies assessing each outcome, high risk of bias in those studies, and conflicting results for some outcomes. Further studies are required to draw solid conclusions about the effectiveness and safety of chatbots. TRIAL REGISTRATION:PROSPERO International Prospective Register of Systematic Reviews CRD42019141219; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42019141219.

SUBMITTER: Abd-Alrazaq AA

PROVIDER: S-EPMC7385637 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effectiveness and Safety of Using Chatbots to Improve Mental Health: Systematic Review and Meta-Analysis.

Abd-Alrazaq Alaa Ali AA Rababeh Asma A Alajlani Mohannad M Bewick Bridgette M BM Househ Mowafa M

Journal of medical Internet research 20200713 7

<h4>Background</h4>The global shortage of mental health workers has prompted the utilization of technological advancements, such as chatbots, to meet the needs of people with mental health conditions. Chatbots are systems that are able to converse and interact with human users using spoken, written, and visual language. While numerous studies have assessed the effectiveness and safety of using chatbots in mental health, no reviews have pooled the results of those studies.<h4>Objective</h4>This s ...[more]

PMID: 32673216

Similar Datasets

Project description:Introduction: There is an emerging interest in modulating the gut microbiota to target the gut-brain axis and improve maternal mental health in the perinatal period. This systematic review evaluated the effectiveness of prebiotics, probiotics, and synbiotics supplementation during pregnancy to reduce the risk of maternal mental health problems in the perinatal period. Methods: Electronic biomedical databases and clinical trial registries were searched from database inception through August 2020 to identify randomized controlled clinical trials (RCTs) evaluating the effect of probiotic, prebiotic, or synbiotic supplements administered to women during pregnancy on measures of perinatal depression, anxiety, and other mental health outcomes. Study selection, risk of bias appraisal, and data extraction were independently performed by two reviewers. Pooled mean differences (MD) and odds ratios (pOR) with 95% confidence intervals (CI) were calculated in random-effects meta-analyses for the outcomes of interest in the review. Results: From 3,868 studies identified through the search strategy, three RCTs of low risk of bias involving 713 participants were included, all three testing probiotics. There were no differences between probiotics and control groups in the mean depression scores (MD -0.46; 95% CI -2.16, 1.25) at end of follow-up. Although statistical significance was not achieved, probiotics showed an advantage in the proportion of participants scoring below an established cut-off for depression (pOR 0.68; 95% CI 0.43, 1.07). Compared to placebo, probiotics in pregnancy reduced anxiety symptoms (MD -0.99; 95% CI -1.80, -0.18); however, this advantage was not translated in a reduction in the proportion of participants scoring above an established cut-off for anxiety (pOR 0.65; 95% CI 0.23, 1.85). There were no differences between probiotics and control groups in global mental health scores at end of follow-up (MD 1.09; 95% CI -2.04, 4.22). Conclusion: There is limited but promising evidence about the effectiveness of probiotics during pregnancy to reduce anxiety symptoms and reduce the proportion of women scoring ABOVE a cut-off depression score. There is a lack of RCT evidence supporting prebiotics and synbiotics supplementation for similar purposes in the perinatal period. More research is needed before prebiotics, probiotics, and synbiotics are recommended to support maternal mental health and well-being in the perinatal period. Systematic Review Registration: PROSPERO, CRD42019137158.

Project description:BackgroundPrevious research showed that computerized cognitive behavioral therapy can effectively reduce depressive symptoms. Some mental health apps incorporate gamification into their app design, yet it is unclear whether features differ in their effectiveness to reduce depressive symptoms over and above mental health apps without gamification.ObjectiveThe aim of this study was to determine whether mental health apps with gamification elements differ in their effectiveness to reduce depressive symptoms when compared to those that lack these elements.MethodsA meta-analysis of studies that examined the effect of app-based therapy, including cognitive behavioral therapy, acceptance and commitment therapy, and mindfulness, on depressive symptoms was performed. A total of 5597 articles were identified via five databases. After screening, 38 studies (n=8110 participants) remained for data extraction. From these studies, 50 total comparisons between postintervention mental health app intervention groups and control groups were included in the meta-analysis.ResultsA random effects model was performed to examine the effect of mental health apps on depressive symptoms compared to controls. The number of gamification elements within the apps was included as a moderator. Results indicated a small to moderate effect size across all mental health apps in which the mental health app intervention effectively reduced depressive symptoms compared to controls (Hedges g=-0.27, 95% CI -0.36 to -0.17; P<.001). The gamification moderator was not a significant predictor of depressive symptoms (β=-0.03, SE=0.03; P=.38), demonstrating no significant difference in effectiveness between mental health apps with and without gamification features. A separate meta-regression also did not show an effect of gamification elements on intervention adherence (β=-1.93, SE=2.28; P=.40).ConclusionsThe results show that both mental health apps with and without gamification elements were effective in reducing depressive symptoms. There was no significant difference in the effectiveness of mental health apps with gamification elements on depressive symptoms or adherence. This research has important clinical implications for understanding how gamification elements influence the effectiveness of mental health apps on depressive symptoms.

Project description:BackgroundArtificial intelligence (AI)-based chatbots can offer personalized, engaging, and on-demand health promotion interventions.ObjectiveThe aim of this systematic review was to evaluate the feasibility, efficacy, and intervention characteristics of AI chatbots for promoting health behavior change.MethodsA comprehensive search was conducted in 7 bibliographic databases (PubMed, IEEE Xplore, ACM Digital Library, PsycINFO, Web of Science, Embase, and JMIR publications) for empirical articles published from 1980 to 2022 that evaluated the feasibility or efficacy of AI chatbots for behavior change. The screening, extraction, and analysis of the identified articles were performed by following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.ResultsOf the 15 included studies, several demonstrated the high efficacy of AI chatbots in promoting healthy lifestyles (n=6, 40%), smoking cessation (n=4, 27%), treatment or medication adherence (n=2, 13%), and reduction in substance misuse (n=1, 7%). However, there were mixed results regarding feasibility, acceptability, and usability. Selected behavior change theories and expert consultation were used to develop the behavior change strategies of AI chatbots, including goal setting, monitoring, real-time reinforcement or feedback, and on-demand support. Real-time user-chatbot interaction data, such as user preferences and behavioral performance, were collected on the chatbot platform to identify ways of providing personalized services. The AI chatbots demonstrated potential for scalability by deployment through accessible devices and platforms (eg, smartphones and Facebook Messenger). The participants also reported that AI chatbots offered a nonjudgmental space for communicating sensitive information. However, the reported results need to be interpreted with caution because of the moderate to high risk of internal validity, insufficient description of AI techniques, and limitation for generalizability.ConclusionsAI chatbots have demonstrated the efficacy of health behavior change interventions among large and diverse populations; however, future studies need to adopt robust randomized control trials to establish definitive conclusions.

Project description:BackgroundMobile health interventions could have beneficial effects on health care delivery processes. We aimed to conduct a systematic review of controlled trials of mobile technology interventions to improve health care delivery processes.Methods and findingsWe searched for all controlled trials of mobile technology based health interventions using MEDLINE, EMBASE, PsycINFO, Global Health, Web of Science, Cochrane Library, UK NHS HTA (Jan 1990-Sept 2010). Two authors independently extracted data on allocation concealment, allocation sequence, blinding, completeness of follow-up, and measures of effect. We calculated effect estimates and we used random effects meta-analysis to give pooled estimates. We identified 42 trials. None of the trials had low risk of bias. Seven trials of health care provider support reported 25 outcomes regarding appropriate disease management, of which 11 showed statistically significant benefits. One trial reported a statistically significant improvement in nurse/surgeon communication using mobile phones. Two trials reported statistically significant reductions in correct diagnoses using mobile technology photos compared to gold standard. The pooled effect on appointment attendance using text message (short message service or SMS) reminders versus no reminder was increased, with a relative risk (RR) of 1.06 (95% CI 1.05-1.07, I(2) = 6%). The pooled effects on the number of cancelled appointments was not significantly increased RR 1.08 (95% CI 0.89-1.30). There was no difference in attendance using SMS reminders versus other reminders (RR 0.98, 95% CI 0.94-1.02, respectively). To address the limitation of the older search, we also reviewed more recent literature.ConclusionsThe results for health care provider support interventions on diagnosis and management outcomes are generally consistent with modest benefits. Trials using mobile technology-based photos reported reductions in correct diagnoses when compared to the gold standard. SMS appointment reminders have modest benefits and may be appropriate for implementation. High quality trials measuring clinical outcomes are needed. Please see later in the article for the Editors' Summary.

Project description:Many organisations promote eHealth applications as a feasible, low-cost method of addressing mental ill-health and stress amongst their employees. However, there are good reasons why the efficacy identified in clinical or other samples may not generalize to employees, and many Apps are being developed specifically for this group. The aim of this paper is to conduct the first comprehensive systematic review and meta-analysis evaluating the evidence for the effectiveness and examine the relative efficacy of different types of eHealth interventions for employees.Systematic searches were conducted for relevant articles published from 1975 until November 17, 2016, of trials of eHealth mental health interventions (App or web-based) focused on the mental health of employees. The quality and bias of all identified studies was assessed. We extracted means and standard deviations from published reports, comparing the difference in effect sizes (Hedge's g) in standardized mental health outcomes. We meta-analysed these using a random effects model, stratified by length of follow up, intervention type, and whether the intervention was universal (unselected) or targeted to selected groups e.g. "stressed".23 controlled trials of eHealth interventions were identified which overall suggested a small positive effect at both post intervention (g = 0.24, 95% CI 0.13 to 0.35) and follow up (g = 0.23, 95% CI 0.03 to 0.42). There were differential short term effects seen between the intervention types whereby Mindfulness based interventions (g = 0.60, 95% CI 0.34 to 0.85, n = 6) showed larger effects than the Cognitive Behaviour Therapy (CBT) based (g = 0.15, 95% CI 0.02 to 0.29, n = 11) and Stress Management based (g = 0.17, 95%CI -0.01 to 0.34, n = 6) interventions. The Stress Management interventions however differed by whether delivered to universal or targeted groups with a moderately large effect size at both post-intervention (g = 0.64, 95% CI 0.54 to 0.85) and follow-up (g = 0.69, 95% CI 0.06 to 1.33) in targeted groups, but no effect in unselected groups.There is reasonable evidence that eHealth interventions delivered to employees may reduce mental health and stress symptoms post intervention and still have a benefit, although reduced at follow-up. Despite the enthusiasm in the corporate world for such approaches, employers and other organisations should be aware not all such interventions are equal, many lack evidence, and achieving the best outcomes depends upon providing the right type of intervention to the correct population.

Dataset Information

Effectiveness and Safety of Using Chatbots to Improve Mental Health: Systematic Review and Meta-Analysis.

Publications

Effectiveness and Safety of Using Chatbots to Improve Mental Health: Systematic Review and Meta-Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets