Dataset Information

Self-guided Cognitive Behavioral Therapy Apps for Depression: Systematic Assessment of Features, Functionality, and Congruence With Evidence.

ABSTRACT:

Background

Mental health disorders affect 1 in 10 people globally, of whom approximately 300 million are affected by depression. At least half of the people affected by depression remain untreated. Although cognitive behavioral therapy (CBT) is an effective treatment, access to mental health specialists, habitually challenging, has worsened because of the COVID-19 pandemic. Internet-based CBT is an effective and feasible strategy to increase access to treatment for people with depression. Mental health apps may further assist in facilitating self-management for people affected by depression; however, accessing the correct app may be cumbersome given the large number and wide variety of apps offered by public app marketplaces.

Objective

This study aims to systematically assess the features, functionality, data security, and congruence with evidence of self-guided CBT-based apps targeting users affected by depression that are available in major app stores.

Methods

We conducted a systematic assessment of self-guided CBT-based apps available in Google Play and the Apple App Store. Apps launched or updated since August 2018 were identified through a systematic search in the 42matters database using CBT-related terms. Apps meeting the inclusion criteria were downloaded and assessed using a Samsung Galaxy J7 Pro (Android 9) and iPhone 7 (iOS 13.3.1). Apps were appraised using a 182-question checklist developed by the research team, assessing their general characteristics, technical aspects and quality assurance, and CBT-related features, including 6 evidence-based CBT techniques (ie, psychoeducation, behavioral activation, cognitive restructuring, problem solving, relaxation, and exposure for comorbid anxiety) as informed by a CBT manual, CBT competence framework, and a literature review of internet-based CBT clinical trial protocols. The results were reported as a narrative review using descriptive statistics.

Results

The initial search yielded 3006 apps, of which 98 met the inclusion criteria and were systematically assessed. There were 20 well-being apps; 65 mental health apps, targeting two or more common mental health disorders, including depression; and 13 depression apps. A total of 28 apps offered at least four evidence-based CBT techniques, particularly depression apps. Cognitive restructuring was the most common technique, offered by 79% (77/98) of the apps. Only one-third of the apps offered suicide risk management resources, whereas 17% (17/98) of the apps offered COVID-19-related information. Although most apps included a privacy policy, only a third of the apps presented it before account creation. In total, 82% (74/90) of privacy policies stated sharing data with third-party service providers. Half of the app development teams included academic institutions or health care providers.

Conclusions

Only a few self-guided CBT-based apps offer comprehensive CBT programs or suicide risk management resources. Sharing of users' data is widespread, highlighting shortcomings in health app market governance. To fulfill their potential, self-guided CBT-based apps should follow evidence-based clinical guidelines, be patient centered, and enhance users' data security.

SUBMITTER: Martinengo L

PROVIDER: S-EPMC8367167 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundHundreds of mental health apps are available to the general public. With increasing pressures on health care systems, they offer a potential way for people to support their mental health and well-being. However, although many are highly rated by users, few are evidence-based. Equally, our understanding of what makes apps engaging and valuable to users is limited.ObjectiveThe aim of this paper was to analyze functionality and user opinions of mobile apps purporting to support cognitive behavioral therapy for depression and to explore key factors that have an impact on user experience and support engagement.MethodsWe systematically identified apps described as being based on cognitive behavioral therapy for depression. We then conducted 2 studies. In the first, we analyzed the therapeutic functionality of apps. This corroborated existing work on apps' fidelity to cognitive behavioral therapy theory, but we also extended prior work by examining features designed to support user engagement. Engagement features found in cognitive behavioral therapy apps for depression were compared with those found in a larger group of apps that support mental well-being in a more general sense. Our second study involved a more detailed examination of user experience, through a thematic analysis of publicly available user reviews of cognitive behavioral therapy apps for depression.ResultsWe identified 31 apps that purport to be based on cognitive behavioral therapy for depression. Functionality analysis (study 1) showed that they offered an eclectic mix of features, including many not based on cognitive behavioral therapy practice. Cognitive behavioral therapy apps used less varied engagement features compared with 253 other mental well-being apps. The analysis of 1287 user reviews of cognitive behavioral therapy apps for depression (study 2) showed that apps are used in a wide range of contexts, both replacing and augmenting therapy, and allowing users to play an active role in supporting their mental health and well-being. Users, including health professionals, valued and used apps that incorporated both core cognitive behavioral therapy and non-cognitive behavioral therapy elements, but concerns were also expressed regarding the unsupervised use of apps. Positivity was seen as important to engagement, for example, in the context of automatic thoughts, users expressed a preference to capture not just negative but also positive ones. Privacy, security, and trust were crucial to the user experience.ConclusionsCognitive behavioral therapy apps for depression need to improve with respect to incorporating evidence-based cognitive behavioral therapy elements. Equally, a positive user experience is dependent on other design factors, including consideration of varying contexts of use. App designers should be able to clearly identify the therapeutic basis of their apps, but they should also draw on evidence-based strategies to support a positive and engaging user experience. The most effective apps are likely to strike a balance between evidence-based cognitive behavioral therapy strategies and evidence-based design strategies, including the possibility of eclectic therapeutic techniques.

Project description:BACKGROUND:The emergence and advancement of mobile technologies offer a promising opportunity for people with diabetes to improve their self-management. Despite the proliferation of mobile apps, few studies have evaluated the apps that are available to the millions of people with diabetes in China. OBJECTIVE:This study aimed to conduct a systematic search of Chinese mobile apps for diabetes self-management and to evaluate their quality, functionality, and features by using validated rating scales. METHODS:A systematic search was conducted to identify Chinese apps for diabetes self-management in the four most popular Chinese language mobile app stores. Apps were included if they were designed for diabetes self-management and contained at least one of the following components: blood glucose management, dietary and physical activity management, medication taking, and prevention of diabetes-related comorbidities. Apps were excluded if they were unrelated to health, not in Chinese, or the targeted users are health care professionals. Apps meeting the identified inclusion criteria were downloaded and evaluated by a team of 5 raters. The quality, functionalities, and features of these apps were assessed by using the Mobile App Rating Scale (MARS), the IMS Institute for Healthcare Informatics Functionality score, and a checklist of self-management activities developed based on the Chinese diabetes self-management guideline, respectively. RESULTS:Among 2072 apps searched, 199 were eligible based on the inclusion criteria, and 67 apps were successfully downloaded for rating. These 67 apps had an average MARS score of 3.42 out of 5, and 76% (51/67) of the apps achieved an acceptable quality (MARS score >3.0). The scores for the four subdomains of MARS were 3.97 for functionality, 3.45 for aesthetics, 3.21 for information, and 3.07 for engagement. On average, reviewed apps applied five out of the 19 examined behavior change techniques, whereas the average score on the subjective quality for the potential impact on behavior change is 3 out of 5. In addition, the average score on IMS functionality was 6 out of 11. Functionalities in collecting, recording, and displaying data were mostly presented in the reviewed apps. Most of the apps were multifeatured with monitoring blood glucose and tracking lifestyle behaviors as common features, but some key self-management activities recommended by clinical guidelines, such as stress and emotional management, were rarely presented in these apps. CONCLUSIONS:The general quality of the reviewed apps for diabetes self-management is suboptimal, although the potential for improvement is significant. More attention needs to be paid to the engagement and information quality of these apps through co-design with researchers, public health practitioners, and consumers. There is also a need to promote the awareness of the public on the benefit and potential risks of utilizing health apps for self-management.

Project description:BackgroundMajor depressive disorder is a chronic condition; its prevalence is expected to grow with the aging trend of high-income countries. Internet-based cognitive-behavioral therapy has proven efficacy in treating major depressive disorder.ObjectiveThe objective of this study was to assess the cost-effectiveness of implementing a community internet-based cognitive behavioral therapy intervention (Super@, the Spanish program for the MasterMind project) for treating major depressive disorder.MethodsThe cost-effectiveness of the Super@ program was assessed with the Monitoring and Assessment Framework for the European Innovation Partnership on Active and Healthy Ageing tool, using a 3-state Markov model. Data from the cost and effectiveness of the intervention were prospectively collected from the implementation of the program by a health care provider in Badalona, Spain; the corresponding data for usual care were gathered from the literature. The health states, transition probabilities, and utilities were computed using Patient Health Questionnaire-9 scores.ResultsThe analysis was performed using data from 229 participants using the Super@ program. Results showed that the intervention was more costly than usual care; the discounted (3%) and nondiscounted incremental cost-effectiveness ratios were €29,367 and €26,484 per quality-adjusted life-year, respectively (approximately US $35,299 and $31,833, respectively). The intervention was cost-effective based on the €30,000 willingness-to-pay threshold typically applied in Spain (equivalent to approximately $36,060). According to the deterministic sensitivity analyses, the potential reduction of costs associated with intervention scale-up would reduce the incremental cost-effectiveness ratio of the intervention, although it remained more costly than usual care. A discount in the incremental effects up to 5% exceeded the willingness-to-pay threshold of €30,000.ConclusionsThe Super@ program, an internet-based cognitive behavioral therapy intervention for treating major depressive disorder, cost more than treatment as usual. Nevertheless, its implementation in Spain would be cost-effective from health care and societal perspectives, given the willingness-to-pay threshold of €30,000 compared with treatment as usual.

Project description:BACKGROUND:In the last decade, there has been a proliferation of mobile apps claiming to support the needs of people living with depression. However, it is unclear what functionality is actually provided by apps for depression, or for whom they are intended. OBJECTIVE:This paper aimed to explore the key features of top-rated apps for depression, including descriptive characteristics, functionality, and ethical concerns, to better inform the design of apps for depression. METHODS:We reviewed top-rated iPhone OS (iOS) and Android mobile apps for depression retrieved from app marketplaces in spring 2019. We applied a systematic analysis to review the selected apps, for which data were gathered from the 2 marketplaces and through direct use of the apps. We report an in-depth analysis of app functionality, namely, screening, tracking, and provision of interventions. Of the initially identified 482 apps, 29 apps met the criteria for inclusion in this review. Apps were included if they remained accessible at the moment of evaluation, were offered in mental health-relevant categories, received a review score greater than 4.0 out of 5.0 by more than 100 reviewers, and had depression as a primary target. RESULTS:The analysis revealed that a majority of apps specify the evidence base for their intervention (18/29, 62%), whereas a smaller proportion describes receiving clinical input into their design (12/29, 41%). All the selected apps are rated as suitable for children and adolescents on the marketplace, but 83% (24/29) do not provide a privacy policy consistent with their rating. The findings also show that most apps provide multiple functions. The most commonly implemented functions include provision of interventions (24/29, 83%) either as a digitalized therapeutic intervention or as support for mood expression; tracking (19/29, 66%) of moods, thoughts, or behaviors for supporting the intervention; and screening (9/29, 31%) to inform the decision to use the app and its intervention. Some apps include overtly negative content. CONCLUSIONS:Currently available top-ranked apps for depression on the major marketplaces provide diverse functionality to benefit users across a range of age groups; however, guidelines and frameworks are still needed to ensure users' privacy and safety while using them. Suggestions include clearly defining the age of the target population and explicit disclosure of the sharing of users' sensitive data with third parties. In addition, we found an opportunity for apps to better leverage digital affordances for mitigating harm, for personalizing interventions, and for tracking multimodal content. The study further demonstrated the need to consider potential risks while using depression apps, including the use of nonvalidated screening tools, tracking negative moods or thinking patterns, and exposing users to negative emotional expression content.

Project description:BackgroundInternet-based programs can help provide accessible and inexpensive behavioral health care to those in need; however, the evaluation of these interventions has been mostly limited to controlled trials. Data regarding patterns of use and effectiveness of self-referred, open-access online interventions are lacking. We evaluated an online-based treatment designed to address stress, depression, and conflict management, the Dartmouth PATH Program, in a freely available and self-guided format during the COVID-19 pandemic.ObjectiveThe primary aim is to determine users' levels of stress and depression, and the nature of problems and triggers they reported during the COVID-19 pandemic. A secondary objective is to assess the acceptability and usability of the PATH content and determine whether such a program would be useful as a stand-alone open-access resource. The final objective is understanding the high dropout rates associated with online behavioral programs by contrasting the use pattern and program efficacy of individuals who completed session one and did not return to the program with those who came back to complete more sessions.MethodsCumulative anonymous data from 562 individuals were analyzed. Stress triggers, stress responses, and reported problems were analyzed using qualitative analysis techniques. Scores on usability and acceptability questionnaires were evaluated using the sign test and Wilcoxon signed rank test. Mixed-effects linear modeling was used to evaluate changes in stress and depression over time.ResultsA total of 2484 users registered from April through October 2020, most of whom created an account without initiating a module. A total of 562 individuals started the program and were considered in the data analysis. The most common stress triggers individuals reported involved either conflicts with family or spouses and work or workload. The most common problems addressed in the mood module were worry, anxiousness, or stress and difficulty concentrating or procrastination. The attrition rate was high with 13% (21/156) completing the conflict module, 17% (50/289) completing session one of the mood module, and 14% (16/117) completing session one of the stress module. Usability and acceptability scores for the mood and stress modules were significantly better than average. In those who returned to complete sessions, symptoms of stress showed a significant improvement over time (P=.03), and there was a significant decrease in depressive symptoms over all time points (P=.01). Depression severity decreased on average by 20% (SD 35.2%; P=.60) between sessions one and two.ConclusionsConflicts with others, worry, and difficulty concentrating were some of the most common problems people used the programs to address. Individuals who completed the modules indicated improvements in self-reported stress and depression symptoms. Users also found the modules to be effective and rated the program highly for usability and acceptability. Nevertheless, the attrition rate was very high, as has been found with other freely available online-based interventions.Trial registrationClinicalTrials.gov NCT02726061; https://clinicaltrials.gov/ct2/show/NCT02726061.

Project description:BackgroundDespite substantial improvements in technology and the increased demand for technology-enabled behavioral health tools among consumers, little progress has been made in easing the burden of mental illness. This may be because of the inherent challenges of conducting traditional clinical trials in a rapidly evolving technology landscape.ObjectiveThis study sought to validate the effectiveness of Pacifica, a popular commercially available app for the self-management of mild-to-moderate stress, anxiety, and depression.MethodsA total of 500 adults with mild-to-moderate anxiety or depression were recruited from in-app onboarding to participate in a randomized waitlist controlled trial of Pacifica. We conducted an all-virtual study, recruiting, screening, and randomizing participants through a Web-based participant portal. Study participants used the app for 1 month, with no level of use required, closely mimicking real-world app usage. Participants in the waitlist group were given access to the app after 1 month. Measurements included self-reported symptoms of stress, anxiety, depression, and self-efficacy. We performed an intent-to-treat analysis to examine the interactive effects of time and condition.ResultsWe found significant interactions between time and group. Participants in the active condition demonstrated significantly greater decreases in depression, anxiety, and stress and increases in self-efficacy. Although we did not find a relationship between overall engagement with the app and symptom improvement, participants who completed relatively more thought record exercises sustained improvements in their symptoms through the 2-month follow-up to a greater degree than those who completed fewer. In addition, we found that participants who reported concomitantly taking psychiatric medications during the trial benefitted less from the app, as measured by the symptoms of anxiety and stress.ConclusionsThis study provides evidence that Pacifica, a popular commercially available self-help app, is effective in reducing self-reported symptoms of depression, anxiety, and stress, particularly among individuals who utilize thought records and are not taking psychiatric medication.Trial registrationClinicalTrials.gov NCT03333707; https://clinicaltrials.gov/ct2/show/NCT03333707 (Archived by WebCite at http://www.webcitation.org/78YE07ADB).

Project description:BackgroundInternet-based cognitive behavioral therapy (iCBT) is a promising new treatment method for depression and anxiety. However, it is important to determine whether its results can be replicated in routine care before its implementation on a large scale. Although many studies have demonstrated the efficacy of iCBT under controlled conditions, only a few studies have investigated its effectiveness in routine care. Furthermore, several effects of iCBT such as treatment effects in routine care are unclear.ObjectiveThis study aimed to evaluate the clinical effectiveness of iCBT for depression and anxiety in routine secondary care.Methodsn a retrospective cohort study, we analysed patients treated for depression or anxiety in a dedicated iCBT clinic in secondary care in Denmark. Patients were examined before treatment and weekly thereafter by using the Patient Health Questionnaire-9 and the Generalized Anxiety Disorder-7 scales for the diagnoses of depression and anxiety, respectively. Primary analyses were conducted using a linear mixed-effects model with random slope and intercept. Secondary analyses were conducted using baseline characteristics as predictors (gender, age, highest level of education, occupational status, marital status, psychotropic medication use, consumption of alcohol, and leisure drugs). Additionally, logistic regression analyses were used to predict noncompletion of treatment.ResultsA total of 203 (depression, N=60; anxiety, N=143) patients were included. Participants were mainly female (78.3% with depression and 65.7% with anxiety), with a mean age of 36.03 (SD 10.97) years (range, 19-67 years) for patients with depression and 36.80 (SD 13.55) years (range, 19-69 years) for patients with anxiety. The completion rates were 62% (37) and 40% (57) for depression and anxiety treatments, respectively. The primary analyses revealed large and significant reductions in the symptom levels of depression (beta=-6.27, SE 0.83, P<.001, d=1.0) and anxiety (beta=-3.78, SE 0.43, P<.001, d=1.1). High baseline severity of the primary disorder was associated with high treatment gains (r=-0.31 for depression; r=-0.41 for anxiety). In patients with anxiety, high baseline severity also predicted a high risk of noncompletion (odds ratio=1.08, CI=1.01-1.16, P=.03). An increase in the baseline severity of the comorbid disorder slightly increased the risk of noncompletion for both disorders (depression: odds ratio=1.03, CI=1.01-1.06, P=.02; anxiety: odds ratio=1.08, CI=1.01-1.16, P=.03).ConclusionsiCBT can be clinically effective in routine care. Since depression and anxiety are costly and debilitating disorders that are vastly undertreated, this finding is important. Additionally, iCBT may help bridge the gap between the need for treatment and its provision. Our results are comparable to the within-group results of efficacy and effectiveness studies. Our noncompletion rates are similar to those observed in psychotherapy but are higher than those reported in similar clinics. Multiple factors predicted outcome and noncompletion. However, all predictor effects were statistically weak.