Dataset Information

Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in SMART Recovery Mutual Support Groups: Stage 1 Mixed Methods Pilot Study.

ABSTRACT:

Background

Mutual support groups are an important source of long-term help for people impacted by addictive behaviors. Routine outcome monitoring (ROM) and feedback are yet to be implemented in these settings. SMART Recovery mutual support groups focus on self-empowerment and use evidence-based techniques (eg, motivational and behavioral strategies). Trained facilitators lead all SMART Recovery groups, providing an opportunity to implement ROM.

Objective

The aim of this stage 1 pilot study is to explore the feasibility, acceptability, and preliminary outcomes of a novel, purpose-built mobile health ROM and feedback app (SMART Track) in mutual support groups coordinated by SMART Recovery Australia (SRAU) over 8 weeks.

Methods

SMART Track was developed during phase 1 of this study using participatory design methods and an iterative development process. During phase 2, 72 SRAU group participants were recruited to a nonrandomized, prospective, single-arm trial of the SMART Track app. Four modes of data collection were used: ROM data directly entered by participants into the app; app data analytics captured by Amplitude Analytics (number of visits, number of unique users, visit duration, time of visit, and user retention); baseline, 2-, and 8-week follow-up assessments conducted through telephone; and qualitative telephone interviews with a convenience sample of study participants (20/72, 28%) and facilitators (n=8).

Results

Of the 72 study participants, 68 (94%) created a SMART Track account, 64 (88%) used SMART Track at least once, and 42 (58%) used the app for more than 5 weeks. During week 1, 83% (60/72) of participants entered ROM data for one or more outcomes, decreasing to 31% (22/72) by the end of 8 weeks. The two main screens designed to provide personal feedback data (Urges screen and Overall Progress screen) were the most frequently visited sections of the app. Qualitative feedback from participants and facilitators supported the acceptability of SMART Track and the need for improved integration into the SRAU groups. Participants reported significant reductions between the baseline and 8- week scores on the Severity of Dependence Scale (mean difference 1.93, SD 3.02; 95% CI 1.12-2.73) and the Kessler Psychological Distress Scale-10 (mean difference 3.96, SD 8.31; 95% CI 1.75-6.17), but no change on the Substance Use Recovery Evaluator (mean difference 0.11, SD 7.97; 95% CI -2.02 to 2.24) was reported.

Conclusions

Findings support the feasibility, acceptability, and utility of SMART Track. Given that sustained engagement with mobile health apps is notoriously difficult to achieve, our findings are promising. SMART Track offers a potential solution for ROM and personal feedback, particularly for people with substance use disorders who attend mutual support groups.

Trial registration

Australian New Zealand Clinical Trials Registry ACTRN12619000686101; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336.

International registered report identifier (irrid)

RR2-10.2196/15113.

SUBMITTER: Kelly PJ

PROVIDER: S-EPMC8529481 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Despite the importance and popularity of mutual support groups, there have been no systematic attempts to implement and evaluate routine outcome monitoring (ROM) in these settings. Unlike other mutual support groups for addiction, trained facilitators lead all Self-Management and Recovery Training (SMART Recovery) groups, thereby providing an opportunity to implement ROM as a routine component of SMART Recovery groups. OBJECTIVE:This study protocol aims to describe a stage 1 pilot study designed to explore the feasibility and acceptability of a novel, purpose-built mobile health (mHealth) ROM and feedback app (Smart Track) in SMART Recovery groups coordinated by SMART Recovery Australia (SRAU) The secondary objectives are to describe Smart Track usage patterns, explore psychometric properties of the ROM items (ie, internal reliability and convergent and divergent validity), and provide preliminary evidence for participant reported outcomes (such as alcohol and other drug use, self-reported recovery, and mental health). METHODS:Participants (n=100) from the SMART Recovery groups across New South Wales, Australia, will be recruited to a nonrandomized, prospective, single-arm trial of the Smart Track app. There are 4 modes of data collection: (1) ROM data collected from group participants via the Smart Track app, (2) data analytics summarizing user interactions with Smart Track, (3) quantitative interview and survey data of group participants (baseline, 2-week follow-up, and 2-month follow-up), and (4) qualitative interviews with group participants (n=20) and facilitators (n=10). Feasibility and acceptability (primary objectives) will be analyzed using descriptive statistics, a cost analysis, and a qualitative evaluation. RESULTS:At the time of submission, 13 sites (25 groups per week) had agreed to be involved. Funding was awarded on August 14, 2017, and ethics approval was granted on April 26, 2018 (HREC/18/WGONG/34; 2018/099). Enrollment is due to commence in July 2019. Data collection is due to be finalized in October 2019. CONCLUSIONS:To the best of our knowledge, this study is the first to use ROM and tailored feedback within a mutual support group setting for addictive behaviors. Our study design will provide an opportunity to identify the acceptability of a novel mHealth ROM and feedback app within this setting and provide detailed information on what factors promote or hinder ROM usage within this context. This project aims to offer a new tool, should Smart Track prove feasible and acceptable, that service providers, policy makers, and researchers could use in the future to understand the impact of SMART Recovery groups. TRIAL REGISTRATION:Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12619000686101; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID):PRR1-10.2196/15113.

Project description:BACKGROUND:Improving the quality of patient care through the use of mobile devices is one of the hot topics in the health care field. In unwanted situations like an accident, ambulances and rescuers often require a certain amount of time to arrive at the scene. Providing immediate cardiopulmonary resuscitation (CPR) to patients might improve survival. OBJECTIVE:The primary objective of this study was to evaluate the feasibility of an emergency and mutual-aid app model in Taiwan and to provide a reference for government policy. METHODS:A structured questionnaire was developed as a research tool. All questionnaires were designed according to the technology acceptance model, and a Likert scale was used to measure the degree of agreement or disagreement. Moreover, in-depth interviews were conducted with six experts from medical, legal, and mobile app departments. Each expert was interviewed once to discuss feasible countermeasures and suggestions. Statistical Package for the Social Sciences (SPSS version 19; IBM Corp, Armonk, New York) was used to perform all statistical analyses, including descriptive statistics, independent sample t-tests, variance analysis, and Pearson correlation analysis. RESULTS:We conducted this study between October 20, 2017, and November 10, 2017, at the Taipei Medical University Hospital. Questionnaires were distributed to medical personnel, visiting guests, family members, and volunteers. A total of 113 valid questionnaires were finally obtained after the exclusion of incomplete questionnaires. Cronbach ? values for self-efficacy (perceived ease of use), use attitude (perceived usefulness), and use willingness and frequency were above .85, meeting the criterion of greater than .70. We observed that the reliability of each subquestion was acceptable and the values for use attitude (perceive usefulness) and use willingness and frequency were more than .90. CONCLUSIONS:The findings suggest that perceived ease of use and perceived usefulness of the app model affect use willingness. However, perceived usefulness had an intermediary influence on use willingness. Experts in law, medical, and technology fields consider that an emergency and mutual-aid model can be implemented in Taiwan. Along with the development of an emergency and mutual-aid app model, we recommend an increase in the number of automated external defibrillators per region and promotion of correct knowledge about CPR in order to decrease morbidity and mortality.

Project description:Background: Routine outcome monitoring (ROM) has been implemented across a range of addiction treatment services, settings and organisations. Mutual support groups are a notable exception. Innovative solutions are needed. SMART Track is a purpose built smartphone app designed to capture ROM data and provide tailored feedback to adults attending Australian SMART Recovery groups for addictive behaviour(s). Objective: Details regarding the formative stage of app development is essential, but often neglected. Improved consideration of the end-user is vital for curtailing app attrition and enhancing engagement. This paper provides a pragmatic example of how principles embedded in published frameworks can be operationalised to address these priorities during the design and development of the SMART Track app. Methods: Three published frameworks for creating digital health technologies ("Person-Based Approach," "BIT" Model and IDEAS framework) were integrated and applied across two stages of research to inform the development, design and content of SMART Track. These frameworks were chosen to ensure that SMART Track was informed by the needs and preferences of the end-user ("Person-Based"); best practise recommendations for mHealth development ("BIT" Model) and a collaborative, iterative development process between the multi-disciplinary research team, app developers and end-users (IDEAS framework). Results: Stage one of the research process generated in-depth knowledge to inform app development, including a comprehensive set of aims (clinical, research/organisation, and usage); clear articulation of the target behaviour (self-monitoring of recovery related behaviours and experiences); relevant theory (self-determination and social control); appropriate behavioural strategies (e.g., behaviour change taxonomy and process motivators) and key factors that may influence engagement (e.g., transparency, relevance and trust). These findings were synthesised into guiding principles that were applied during stage two in an iterative approach to app design, content and development. Conclusions: This paper contributes new knowledge on important person-centred and theoretical considerations that underpin a novel ROM and feedback app for people with addictive behaviour(s). Although person-centred design and best-practise recommendations were employed, further research is needed to determine whether this leads to improved usage outcomes. Clinical Trial Registration: Pilot Trial: http://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336.

Project description:BACKGROUND:Advances in mobile health (mHealth) technology have made it possible for patients and health care providers to monitor and track behavioral health symptoms in real time. Ideally, mHealth apps include both passive and interactive monitoring and demonstrate high levels of patient engagement. Digital phenotyping, the measurement of individual technology usage, provides insight into individual behaviors associated with mental health. OBJECTIVE:Researchers at a Veterans Affairs Medical Center and Cogito Corporation sought to explore the feasibility and acceptability of an mHealth app, the Cogito Companion. METHODS:A mixed methodological approach was used to investigate the feasibility and acceptability of the app. Veterans completed clinical interviews and self-report measures, at baseline and at a 3-month follow-up. During the data collection period, participants were provided access to the Cogito Companion smartphone app. The mobile app gathered passive and active behavioral health indicators. Data collected (eg, vocal features and digital phenotyping of everyday social signals) are analyzed in real time. Passive data collected include location via global positioning system (GPS), phone calls, and SMS text message metadata. Four primary model scores were identified as being predictive of the presence or absence of depression or posttraumatic stress disorder (PTSD). Veterans Affairs clinicians monitored a provider dashboard and conducted clinical outreach when indicated. RESULTS:Findings suggest that use of the Cogito Companion app was feasible and acceptable. Veterans (n=83) were interested in and used the app; however, active use declined over time. Nonetheless, data were passively collected, and outreach occurred throughout the study period. On the Client Satisfaction Questionnaire-8, 79% (53/67) of the sample reported scores demonstrating acceptability of the app (mean 26.2, SD 4.3). Many veterans reported liking specific app features (day-to-day monitoring) and the sense of connection they felt with the study clinicians who conducted outreach. Only a small percentage (4/67, 6%) reported concerns regarding personal privacy. CONCLUSIONS:Feasibility and acceptability of the Cogito Corporation platform to monitor mental health symptoms, behaviors, and facilitate follow-up in a sample of veterans were supported. Clinically, platforms such as the Cogito Companion system may serve as useful methods to promote monitoring, thereby facilitating early identification of risk and mitigating negative psychiatric outcomes, such as suicide.

Project description:BackgroundDigital mental health interventions may help middle-aged and older adults with depression overcome barriers to accessing traditional care, but few studies have investigated their use in this population.ObjectiveThis pilot study examines the feasibility, acceptability, and potential efficacy of the Meru Health Program, an 8-week mobile app-delivered intervention.MethodsA total of 20 community-dwelling middle-aged and older adults (age: mean 61.7 years, SD 11.3) with elevated depressive symptoms participated in a single-arm pilot study investigating the Meru Health Program, an app-delivered intervention supported by remote therapists. The program primarily uses mindfulness and cognitive behavioral skills to target depressive symptoms. A semistructured interview was completed at the baseline to establish current psychiatric diagnoses. Depressive symptoms were measured using the Patient Health Questionnaire and Patient-Reported Outcomes Measurement Information System (PROMIS) depression measures. Anxiety symptoms were measured using the Generalized Anxiety Disorder Scale and the PROMIS Anxiety measure. User experience and acceptability were examined through surveys and qualitative interviews.ResultsIn total, 90% (18/20) of the participants completed the program, with 75% (15/20) completing at least 7 of the 8 introductory weekly lessons. On average, participants completed 60 minutes of practice and exchanged 5 messages with their therapists every week. The app was rated as helpful by 89% (17/19) participants. Significant decreases in depressive (P=.03) and anxiety symptom measures (P=.01) were found; 45% (9/20) of participants showed clinically significant improvement in either depressive symptoms or anxiety symptoms.ConclusionsThe findings suggest that the commercially available Meru Health Program may be feasible, acceptable, and potentially beneficial to middle-aged and older adults. Although larger controlled trials are needed to demonstrate efficacy, these findings suggest that digital health interventions may benefit adults of all ages.

Project description:BackgroundUndergraduate studies are challenging, and mental health issues can frequently occur in undergraduate students, straining campus resources that are already in demand for somatic problems. Cost-effective measures with ubiquitous devices, such as smartphones, offer the potential to deliver targeted interventions to monitor and affect lifestyle, which may result in improvements to student mental health. However, the avenues by which this can be done are not particularly well understood, especially in the Canadian context.ObjectiveThe aim of this study is to deploy an initial version of the Smart Healthy Campus app at Western University, Canada, and to analyze corresponding data for associations between psychosocial factors (measured by a questionnaire) and behaviors associated with lifestyle (measured by smartphone sensors).MethodsThis preliminary study was conducted as an observational app-based ecological momentary assessment. Undergraduate students were recruited over email, and sampling using a custom 7-item questionnaire occurred on a weekly basis.ResultsFirst, the 7-item Smart Healthy Campus questionnaire, derived from fully validated questionnaires-such as the Brief Resilience Scale; General Anxiety Disorder-7; and Depression, Anxiety, and Stress Scale-21-was shown to significantly correlate with the mental health domains of these validated questionnaires, illustrating that it is a viable tool for a momentary assessment of an overview of undergraduate mental health. Second, data collected through the app were analyzed. There were 312 weekly responses and 813 sensor samples from 139 participants from March 2019 to March 2020; data collection concluded when COVID-19 was declared a pandemic. Demographic information was not collected in this preliminary study because of technical limitations. Approximately 69.8% (97/139) of participants only completed one survey, possibly because of the absence of any incentive. Given the limited amount of data, analysis was not conducted with respect to time, so all data were analyzed as a single collection. On the basis of mean rank, students showing more positive mental health through higher questionnaire scores tended to spend more time completing questionnaires, showed more signs of physical activity based on pedometers, and had their devices running less and plugged in charging less when sampled. In addition, based on mean rank, students on campus tended to report more positive mental health through higher questionnaire scores compared with those who were sampled off campus. Some data from students found in or near residences were also briefly examined.ConclusionsGiven these limited data, participants tended to report a more positive overview of mental health when on campus and when showing signs of higher levels of physical activity. These early findings suggest that device sensors related to physical activity and location are useful for monitoring undergraduate students and designing interventions. However, much more sensor data are needed going forward, especially given the sweeping changes in undergraduate studies due to COVID-19.

Project description:BackgroundPhysical and mental health benefits can be attained from persistent, long-term performance of mindfulness meditation with a mobile meditation app, but in general, few mobile health app users persistently engage at a level necessary to attain the corresponding health benefits. Anchoring or pairing meditation with a mobile app to an existing daily routine can establish an unconsciously initiated meditation routine that may improve meditation persistence.ObjectiveThe purpose of this study was to test the use of either personalized anchors or fixed anchors for establishing a persistent meditation app routine with the mobile app, Calm.MethodsWe conducted a randomized controlled trial and randomly assigned participants to one of 3 study groups: (1) a personalized anchor (PA) group, (2) fixed anchor (FA) group, or (3) control group that did not use the anchoring strategy. All participants received app-delivered reminder messages to meditate for at least 10 minutes a day using the Calm app for an 8-week intervention period, and app usage data continued to be collected for an additional 8-week follow-up period to measure meditation persistence. Baseline, week 8, and week 16 surveys were administered to assess demographics, socioeconomic status, and changes in self-reported habit strength.ResultsA total of 101 participants across the 3 study groups were included in the final analysis: (1) PA (n=56), (2) FA (n=49), and (3) control group (n=62). Participants were predominantly White (83/101, 82.2%), female (77/101, 76.2%), and college educated (ie, bachelor's or graduate degree; 82/101, 81.2%). The FA group had a significantly higher average odds of daily meditation during the intervention (1.14 odds ratio [OR]; 95% CI 1.02-1.33; P=.04), and all participants experienced a linear decline in their odds of daily meditation during the 8-week intervention (0.96 OR; 95% CI 0.95-0.96; P<.001). Importantly, the FA group showed a significantly smaller decline in the linear trend of their odds of daily meditation during the 8-week follow-up (their daily trend increased by 1.04 OR from their trend during the intervention; 95% CI 1.01-1.06; P=.03). Additionally, those who more frequently adhered to their anchoring strategy during the intervention typically used anchors that occurred in the morning and showed a significantly smaller decline in their odds of daily meditation during the 8-week follow-up period (1.13 OR; 95% CI 1.02-1.35; P=.007).ConclusionsThe FA group had more persistent meditation with the app, but participants in the FA or PA groups who more frequently adhered to their anchoring strategy during the intervention had the most persistent meditation routines, and almost all of these high anchorers used morning anchors. These findings suggest that the anchoring strategy can create persistent meditation routines with a mobile app. However, future studies should combine anchoring with additional intervention tools (eg, incentives) to help more participants successfully establish an anchored meditation routine.Trial registrationClinicalTrials.gov NCT04378530; https://clinicaltrials.gov/ct2/show/NCT04378530.