Dataset Information

Acceptability, Engagement, and Effects of a Mobile Digital Intervention to Support Mental Health for Young Adults Transitioning to College: Pilot Randomized Controlled Trial.

ABSTRACT:

Background

The transition from high school to college can exacerbate mental health problems in young adults yet barriers prevent seamless mental health care. Existing digital support tools show promise but are not yet designed to optimize engagement or implementation.

Objective

The goal of the research was to test acceptability and effects of an automated digital Mobile Support Tool for Mental Health (MoST-MH) for young adults transitioning to college.

Methods

Youths aged 18 years and older with a current mental health diagnosis preparing to transition to college (n=52; 85% female [45/52], 91% White [48/52]) were recruited from a primary care (n=31) and a mental health clinic (n=21). Participants were randomized 2:1 to either receive MoST-MH (n=34) or enhanced Usual Care (eUC; n=18). MoST-MH included periodic text message and web-based check-ins of emotional health, stressors, negative impacts, and self-efficacy that informed tailored self-care support messages. Both eUC and MoST-MH participants received links to a library of psychoeducational videos and were asked to complete web-based versions of the Mental Health Self-Efficacy Scale (MHSES), College Counseling Center Assessment of Psychological Symptoms (CCAPS), and Client Service Receipt Inventory for Mental Health (C-SRI) monthly for 3 months and the Post-Study System Usability Scale (PSSUQ) at 3-months.

Results

MoST-MH participants were sent a median of 5 (range 3 to 10) text message check-in prompts over the 3-month study period and 100% were completed; participants were sent a median of 2 (range 1 to 8) web-based check-in prompts among which 78% (43/55) were completed. PSSUQ scores indicate high usability (mean score 2.0). Results from the completer analysis demonstrated reductions in mental health symptoms over time and significant between-group effects of MoST-MH compared to eUC on depressive symptom severity (d=0.36, 95% CI 0.08 to 0.64). No significant differences in mental health self-efficacy or mental health health care use were observed.

Conclusions

In this pilot trial, we found preliminary evidence that MoST-MH was engaged with at high rates and found to be highly usable and reduced depression symptoms relative to eUC among youth with mental health disorders transitioning to college. Findings were measured during the COVID-19 pandemic, and the study was not powered to detect differences in outcomes between groups; therefore, further testing is needed.

Trial registration

ClinicalTrials.gov NCT04560075; https://clinicaltrials.gov/ct2/show/NCT04560075.

SUBMITTER: Suffoletto B

PROVIDER: S-EPMC8554670 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Youth experiencing housing instability have higher rates of mental health problems than their housed peers. Few studies have evaluated technological resources for homeless youth to determine how to effectively engage and reach them. OBJECTIVE:The primary aims of this pilot study were to establish the feasibility (as measured by phone retention rates) and acceptability (ie, participant ratings of resources) of delivering automated mental health resources via smartphone technology. METHODS:Youth aged 16 to 25 years (N=100) were recruited through homeless shelter agencies in the Chicago metropolitan area. Eligible participants completed a baseline assessment and received a smartphone with a 3-month data plan. The phone was preloaded with several apps designed to promote mental health wellness and provide real-time resources. One app specifically designed for this study, Pocket Helper 2.0, sent participants daily surveys and tips via push notification. The tips focused on coping and motivation, and the surveys assessed mood. This app also included an automated self-help system with brief cognitive behavioral interventions (5-10 min) and access to several interactive mobile tools, including a crisis text line, a telephone hotline, a crowd-based emotional support tool, and an app providing up-to-date information on social service and mental health resources for homeless youth in Chicago. Participants completed assessments at 3 and 6 months. RESULTS:Some individuals (23%, 23/100) experienced problems with the phones (eg, theft, loss, and technological issues) throughout the study. Participant retention at the midpoint was moderate, with 48% (48/100) of youth responding to the 3-month surveys. At 6 months, only 19% (19/100) of the total sample responded to the end point survey. Overall, 63% (30/48) to 68% (13/19) of respondents at both time points reported benefiting from the intervention; however, participant usage and satisfaction varied with the different features. At both time points, participants reported receiving the most benefit from the daily tips and daily surveys. Daily tips that were most preferred by participants involved motivational tips related to overcoming struggles and making progress in life. Aside from the tips and surveys, the most used features were the app providing up-to-date resources and the automated self-help system. Interactive features, including the telephone hotline and crowd-based emotional support tool, were the least used features and were rated as the least beneficial. CONCLUSIONS:Automated mental health interventions seem to be an acceptable way to engage homeless youth in mental health support. The participants preferred fully automated features and brief interventions over features requiring interaction with others or more engagement. Future research should explore ways to retain homeless youth in interventions and evaluate the clinical impact of automated technology-based interventions for improving mental health. TRIAL REGISTRATION:ClinicalTrials.gov NCT03776422; https://clinicaltrials.gov/ct2/show/NCT03776422.

Project description:BackgroundYouth homelessness is a substantial issue, and many youths experiencing homelessness have mental health issues as both a cause and consequence of homelessness. These youths face many barriers to receiving traditional mental health services, and as a result, only a few youths experiencing homelessness receive any form of mental health care.ObjectiveThis project aimed to develop and determine the feasibility and acceptability of engaging young adults (ie, individuals aged 18-24 years) experiencing homelessness in a remotely delivered mental health intervention. This intervention provided brief emotional support and coping skills, drawing from cognitive behavioral principles as an introduction into psychosocial support. The intervention was piloted in a homeless shelter network.MethodsA total of 35 young adults experiencing homelessness participated in a single-arm feasibility pilot trial. Participants received a mobile phone, a service and data plan, and 1 month of support from a coach consisting of up to 3 brief phone sessions, text messaging, and mobile mental health apps. We evaluated feasibility by looking at completion of sessions as well as the overall program and acceptability with satisfaction ratings. We also collected clinical symptoms at baseline and the end of the 1-month support period. We used validity items to identify participants who might be responding inappropriately and thus only report satisfaction ratings and clinical outcomes from valid responses.ResultsMost participants (20/35, 57%) completed all 3 of their phone sessions, with an average of 2.09 sessions (SD 1.22) completed by each participant. Participants sent an average of 15.06 text messages (SD 12.62) and received an average of 19.34 messages (SD 12.70). We found higher rates of satisfaction among the participants with valid responses, with 100% (23/23) of such participants indicating that they would recommend participation to someone else and 52% (12/23) reporting that they were very or extremely satisfied with their participation. We found very little change from pre- to posttreatment on measures of depression (d=0.27), post-traumatic stress disorder (d=0.17), and emotion regulation (d=0.10).ConclusionsThis study demonstrated that it was feasible to engage homeless young adults in mental health services in this technology-based intervention with high rates of satisfaction. We did not find changes in clinical outcomes; however, we had a small sample size and a brief intervention. Technology might be an important avenue to reach young adults experiencing homelessness, but additional work could explore proper interventions to deliver with such a platform.Trial registrationClinicalTrials.gov NCT03620682; https://clinicaltrials.gov/ct2/show/NCT03620682.

Project description:Background:Young adults have elevated rates of mental health disorders, yet they often do not receive consistent care. The challenge of continuing to engage young adults has been pervasive worldwide. Few engagement interventions have been designed for young adults with serious mental illness. Just Do You is a theoretically guided engagement intervention. It uses innovative modalities (i.e., technology, expressive arts activities, narrative expression, mentoring) to engage participants in conversations about services and how they work, while simultaneously orienting them to treatment. Methods/design:This pilot and feasibility study utilizes a hybrid research design, examining feasibility, acceptability, and preliminary impact, alongside implementation. The study combines qualitative methods, a small pilot randomized trial, and a small cost-benefit analysis. Respondents are clinic staff and young adults who have made initial contact with the Personalized Recovery Oriented Services (PROS) program. Quantitative survey data are collected at baseline, 2?weeks (post-intervention), 1?month, and 3?months. The assessments focus on measuring feasibility, acceptability, engagement, and mental health outcomes. Medical record extraction will be used to triangulate self-report data. We will conduct single degree of freedom contrasts to examine whether Just Do You leads to improved outcomes relative to Treatment-As-Usual using robust regression for each outcome measure. We will examine whether changes in the proposed mediating variables occur across groups using a similar contrast strategy. In addition, we will use structural equation modeling to examine the contribution of mediators to ultimate outcomes. Finally, we will use constant comparison coding techniques for qualitative analyses. Discussion:The aim of this study is to examine the feasibility of a young adult engagement meta-intervention through an intensive preliminary pilot trial, learning through collaboration with stakeholders. Just Do You has the potential to fill a gap in the service system for young adults with serious mental illnesses, improving the seemingly intractable problem of disengagement. The program uses culturally responsive strategies, is recovery-oriented, and builds upon the best evidence to date. Our efforts align with local and national health care reform efforts embedding people with lived experience. Trial registration:This trial was registered with ClinicalTrials.gov (Identifier: NCT03423212) on April 18, 2018, as Protocol Record R34 MH111861-01, New York University, as the Just Do You Program for Young Adults with Serious Mental Illness.

Project description:Background: Young adults with serious mental illness (SMI) are over twice as likely to smoke cigarettes than those in the general population, but little research has evaluated the efficacy of interventions for this group. While smartphone apps are a promising tool to address this need, their usability should be evaluated among young adults with psychotic disorders, whose symptoms and cognitive impairments may be a barrier to app use. Methods: We compared usability and acceptability of National Cancer Institute apps (QuitGuide and quitSTART) between young adult smokers with SMI psychotic disorders and other SMI diagnoses. We evaluated objective app usability at the initial study visit and following 2 weeks of independent use via a video-recorded task-completion protocol. Perceptions of usability and acceptability were assessed with semi-structured interviews. Engagement was assessed with backend app use data. Results: Participants had a mean age of 29 years old (SD = 4). Of the participants without psychotic disorders (n = 10), all were diagnosed with SMI post-traumatic stress disorder (SMI-PTSD). QuitGuide objective task completion rates were high and similar between diagnosis groups, whereas quitSTART task completion was initially lower among users with psychotic disorder compared to users with SMI-PTSD at Visit 1, and improved by Visit 2. Mean app interactions, mean days of use, and median completed notifications were dramatically higher among quitSTART users compared to QuitGuide users. Compared to quitSTART users with SMI-PTSD, quitSTART users with psychotic disorders had similar daily app interactions over the first week of use (mean 3.8 ± 2.4 interactions), and numerically lower mean daily app interactions during the second week (1.9 ± 1.5 vs. 3.4 ± 2.5), whereas completed notifications remained stable among quitSTART users in both diagnosis groups over time. Qualitative comments indicated general acceptability of both apps among both diagnosis groups. Conclusions: Both QuitGuide and quitSTART were usable and appealing among young adult smokers with psychotic disorders and SMI-PTSD, although quitSTART engendered a dramatically greater level of engagement compared to QuitGuide. Initial coaching to support initiation and app notifications to promote prolonged engagement may be important for young adult smokers with psychotic disorders. Replication and efficacy testing for quitSTART is warranted.

Project description:BackgroundWhile many digital mental health interventions (DMHIs) have been found to be efficacious, patient engagement with DMHIs has increasingly emerged as a concern for implementation in real-world clinical settings. To address engagement, we must first understand what standard engagement levels are in the context of randomized controlled trials (RCTs) and how these compare with other treatments.ObjectiveThis scoping review aims to examine the state of reporting on intervention engagement in RCTs of mobile app-based interventions intended to treat symptoms of depression. We sought to identify what engagement metrics are and are not routinely reported as well as what the metrics that are reported reflect about standard engagement levels.MethodsWe conducted a systematic search of 7 databases to identify studies meeting our eligibility criteria, namely, RCTs that evaluated use of a mobile app-based intervention in adults, for which depressive symptoms were a primary outcome of interest. We then extracted 2 kinds of information from each article: intervention details and indices of DMHI engagement. A 5-element framework of minimum necessary DMHI engagement reporting was derived by our team and guided our data extraction. This framework included (1) recommended app use as communicated to participants at enrollment and, when reported, app adherence criteria; (2) rate of intervention uptake among those assigned to the intervention; (3) level of app use metrics reported, specifically number of uses and time spent using the app; (4) duration of app use metrics (ie, weekly use patterns); and (5) number of intervention completers.ResultsDatabase searching yielded 2083 unique records. Of these, 22 studies were eligible for inclusion. Only 64% (14/22) of studies included in this review specified rate of intervention uptake. Level of use metrics was only reported in 59% (13/22) of the studies reviewed. Approximately one-quarter of the studies (5/22, 23%) reported duration of use metrics. Only half (11/22, 50%) of the studies reported the number of participants who completed the app-based components of the intervention as intended or other metrics related to completion. Findings in those studies reporting metrics related to intervention completion indicated that between 14.4% and 93.0% of participants randomized to a DMHI condition completed the intervention as intended or according to a specified adherence criteria.ConclusionsFindings suggest that engagement was underreported and widely varied. It was not uncommon to see completion rates at or below 50% (11/22) of those participants randomized to a treatment condition or to simply see completion rates not reported at all. This variability in reporting suggests a failure to establish sufficient reporting standards and limits the conclusions that can be drawn about level of engagement with DMHIs. Based on these findings, the 5-element framework applied in this review may be useful as a minimum necessary standard for DMHI engagement reporting.

Project description:BackgroundAs mental illness continues to affect 1 in 5 individuals, and the need for support has increased during the COVID-19 pandemic, the promise of digital mental health tools remains largely unrealized due to a lack of uptake by patients and providers. Currently, most efforts on supporting the uptake of digital mental health tools remain fragmented across organizations and geography. There is a critical need to synthesize these efforts in order to provide a coordinated strategy of supporting the adoption of digital mental health tools.ObjectiveThe specific aim of this project is to develop a web-based resource document to support the engagement of mental health providers and patients in the use of digital mental health tools.MethodsThe web-based resource was developed using a multimethod approach. A grey literature review was conducted in 2019 to identify relevant toolkits that are available in the public domain. This was supplemented with an environmental scan where individuals with expertise in the development, acquisition, implementation, and evaluation of digital mental health tools were invited to contribute additional tools or documents not identified in the grey literature search. An engagement workshop was held with stakeholders to explore how the resource document should be developed and delivered. These findings were collectively used to develop the final iteration of the resource document.ResultsBased on a gray literature review and environmental scan with 27 experts, 25 resources were identified and included in the resource guide. These resources were developed for patients and providers by organizations from 5 countries. An engagement workshop was held with 14 stakeholders, and barriers related to cultural sensitivity, sustainability, and accessibility of the toolkit were identified. The final iteration of the resource document was developed by the research team using findings from the gray literature review, environmental scan, and engagement workshop. The contents of the 45-page resource guide are directed at mental health care providers, administrators, and patients (inclusive of families and caregivers).ConclusionsThe use of a multimethod approach led to the development of a resource guide that builds on existing evidence on digital mental health tools and was co-designed with stakeholders and end-users. The resource guide is now publicly available online for free and is being promoted through digital health and mental health websites. Future work should explore how this document can be integrated into clinical care delivery and pathways.

Project description:BackgroundIt is estimated that the number of individuals living with dementia worldwide will increase from 50 million in 2017 to 152 million by 2050. Assistive technology has been recognized as a promising tool to improve the lives of persons living with memory loss and their caregivers. The use of assistive technology in dementia care is expanding, although it is most often intended to manage care and promote safety. There is a lack of assistive technology designed to aid persons with memory loss in participating in meaningful activities. The Social Support Aid (SSA) is a mobile phone-based app that employs facial recognition software. It was designed to assist persons with memory loss remember the names and relationships of the people they interact with to promote social engagement.ObjectiveThis study uses a pilot randomized controlled trial (RCT) design to evaluate the SSA. The objectives were to ascertain (1) the feasibility and utility of the SSA, (2) whether the outcomes of SSA use suggest potential benefits for persons living with memory loss and their care partners, and (3) how study design components could inform subsequent RCTs.MethodsPersons with memory loss were randomized to the SSA (n=20) or the usual care control group (n=28). Quantitative data were collected at three timepoints (baseline, 3 months, and 6 months). Participants in the intervention group participated in qualitative interviews following completion of their 6-month survey.ResultsParticipant eligibility, willingness to be randomized, and retention were not barriers to conducting a full-scale RCT; however, recruitment strategies should be addressed before doing so. Feasibility and utility scores indicated that participants felt neutral about the technology. Use of the SSA was not significantly associated with changes in quality of social interactions or quality of life measures over the 6 months of follow-up (P>.05). The qualitative analysis revealed three themes that described how and why the SSA worked or not: (1) outcomes, (2) reasons why it was or was not useful, and (3) recommendations.ConclusionsThere is a need to develop effective assistive technology that improves the quality of life of persons with memory loss. Assistive technology that allows persons living with memory loss to maintain some level of autonomy should be a priority for future research. This study suggests reasons why the SSA facial recognition software did not appear to improve the quality of social interaction and quality of life of people with memory loss. Results also provide recommendations for future assistive technology development and evaluation.Trial registrationClinicalTrials.gov NCT03645694; https://clinicaltrials.gov/ct2/show/NCT03645694 (Archived by WebCite at http://www.webcitation.org/78dcVZIqq).

Project description:BackgroundApproximately 70,000 adolescents and young adults (AYA) are diagnosed with cancer each year in the United States. Sarcomas carry a particularly high symptom burden and are some of the most common cancers among AYA. Recent work has documented significant levels of unmet needs among AYA with cancer, particularly the need for psychosocial support. Mobile technology may be a cost-effective and efficient way to deliver a psychosocial intervention to AYA with cancer and cancer survivors.ObjectiveThe two aims of this study were to (1) develop a pilot version of a mobile-based mindfulness and social support program and (2) evaluate program usage and acceptability. An exploratory aim was to examine change in psychosocial outcomes.MethodsThirty-seven AYA with sarcoma or sarcoma survivors, parents, and health care providers participated in the study. Semistructured interviews were conducted with 10 AYA, parents of five of the adolescents, and six health care providers. Themes from the interviews helped to inform the development of a mobile-based mindfulness pilot program and a companion Facebook-based social support group. Twenty AYA consented to participate in a single-arm pre-post evaluation of the program; 17 downloaded the app and joined the Facebook group. Seven of these participants had participated in the semistructured interviews. Six additional health care providers consented to participate in the evaluation stage.ResultsOn average, participants completed 16.9 of the 28 unique sessions and used the mindfulness app for a mean 10.2 (SD 8.2) days during the 28-day evaluation period. The majority of participants (16/17) engaged in the social group and posted at least one reply to the moderator's prompts. The mean number of responses per person to the moderator of the social group was 15.2 of 31 (49%, range 0%-97%). Both AYA and health care providers responded positively to the Mindfulness for Resilience in Illness program and offered useful recommendations for improvements. Exploratory psychosocial analyses indicated there were no significant differences from pretest to posttest on measures of perceived social support, mindfulness, body image, or psychological functioning.ConclusionsThis study offers preliminary support for the feasibility and acceptability of a mobile-based mindfulness and Facebook-based social support program for AYA with sarcoma. The feedback from AYA and health care providers will assist in creating a fully developed intervention.Trial registrationClinicalTrials.gov NCT03130751; https://clinicaltrials.gov/ct2/show/NCT03130751.

Project description:Background:The transition of young adults with type 1 diabetes (T1D) from pediatric to adult care is challenging and frequently accompanied by worsening of diabetes-related health. To date, there are no reports which prospectively assess the effects of theory-based psycho-behavioral interventions during the transition period neither on glycemic control nor on psychosocial factors that contribute to poor glycemic control. Therefore, the overall aim of this study was to develop and pilot test an integrative group intervention based on the underlying principles of self-determination theory (SDT), in young adults with T1D. Methods:Fifty-one young adults with T1D participated in an education and case management-based transition program, of which 9 took part in the Diabetes Empowerment Council (DEC), a 12-week holistic, multimodality facilitated group intervention consisting of "council" process based on indigenous community practices, stress-reduction guided imagery, narrative medicine modalities, simple ritual, and other integrative modalities. Feasibility, acceptability, potential mechanism of effects, and bio-behavioral outcomes were determined using mixed qualitative and quantitative methods. Results:The intervention was highly acceptable to participants, though presented significant feasibility challenges. Participants in DEC showed significant reductions in perceived stress and depression, and increases in general well-being relative to other control participants. Reduction in perceived stress, independent of intervention group, was associated with reductions in hemoglobin A1C. A theoretical model explaining the effects of the intervention included the promotion of relatedness and autonomy support, 2 important aspects of SDT. Conclusions:The DEC is a promising group intervention for young adults with T1D going through transition to adult care. Future investigations will be necessary to resolve feasibility issues, optimize the multimodality intervention, determine full intervention effects, and fully test the role of the underlying theoretical model of action.ClinicalTrials.gov Registration Number NCT02807155; Registration date: June 15, 2016 (retrospectively registered).