Dataset Information

Characterizing User Experiences With an SMS Text Messaging-Based mHealth Intervention: Mixed Methods Study.

ABSTRACT:

Background

Limited access to mental health care services due to provider shortages, geographic limitations, and cost has driven the area of mobile health (mHealth) care to address these access gaps. Reports from the Cohen Veterans Network and National Council for Behavioral Health show that in states where mental health care is more accessible, 38% of people still do not receive the care they need. mHealth strategies help to provide care to individuals experiencing these barriers at lower cost and greater convenience, making mHealth a great resource to bridge the gaps.

Objective

We present a mixed methods study to evaluate user experiences with the mental mHealth service, Cope Notes. Specifically, we aimed to investigate the following research questions: How do users perceive the service in relation to stigma, impact of the intervention, and perceived usefulness? How do users rate the Cope Notes service and SMS text messaging along various dimensions of acceptability? What is the relationship between Cope Notes SMS text message ratings, user personality, and coping strategies? What are user perspectives of leveraging ubiquitous sensing technologies to improve delivery and provide tailored content?

Methods

We performed qualitative interviews with Cope Notes users (N=14) who have used the service for at least 30 days to evaluate their experiences and usefulness of the service. These interviews were coded by 2 raters (SLK and JL), and the interrater reliability was calculated with SPSS (IBM Corp) at 61.8%. In addition, participants completed quantitative measures, including a user experiences survey, personality inventory (Big Five Inventory-10), and coping assessment (Brief Coping Orientation to Problems Experienced).

Results

We derived 7 themes from our qualitative interviews: Likes or Perceived Benefits, Dislikes or Limitations, Suggested Changes, Stigma or Help Seeking, Perceptions of Ubiquitous Sensing, Cultural Sensitivity, and Alternative mHealth Resources. Exploratory analyses between acceptability ratings of Cope Notes and personality factors showed statistically significant positive relationships between seeing oneself as someone who is generally trusting and acceptability items, the most significant being item 7 (I fully understood the sentiment behind Cope Notes Messages) with (r_s(10)=0.82, P=.001). We also found statistically significant relationships between acceptability and Brief Coping Orientation to Problems Experienced items, with the strongest positive correlation between participants strongly endorsing coping by accepting the reality that an event has happened and acceptability item 7 (r_s(8)=0.86, P=.001).

Conclusions

Our study found that Cope Notes subscribers appreciate the service for reframing their mental wellness with statistically significant correlations between personality and acceptability of the service. We found that some users prefer a more personalized experience with neutral to positive reactions to a potential companion app that continuously monitors user behavior via smartphone sensors to provide just-in-time interventions when users need it most.

SUBMITTER: King SL

PROVIDER: S-EPMC9115655 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMobile health strategies for smoking cessation (eg, SMS text messaging-based interventions) have been shown to be effective in helping smokers quit. However, further research is needed to better understand user experiences with these platforms.ObjectiveThis qualitative study aims to explore the experiences of real-world users of a publicly available smoking cessation program (SmokefreeTXT).MethodsSemistructured phone interviews were conducted with 36 SmokefreeTXT users between March and July 2014. Of these 36 participants, 50% (18/36) of participants completed the SmokefreeTXT program (ie, did not opt out of the program before the 6- to 8-week completion period), and 50% (18/36) did not complete the program (ie, requested to opt out of the program before the completion period). Interview questions focused on smoking behaviors, quitting history, opinions on the program's content and structure, answering assessment questions, using keywords, reasons for opting out, and perceived usefulness of the program for quitting smoking. A thematic content analysis was conducted, with a focus on themes to increase program engagement and optimization.ResultsThe findings highlighted features of the program that participants found beneficial, as well as some elements that showed opportunities for improvement to boost program retention and successful cessation. Specifically, most participants found the SmokefreeTXT program to be convenient and supportive of cessation; however, some found the messages to be repetitive and reported a desire for more flexibility based on their readiness to quit and cessation progress. We also found that program completion did not necessarily indicate successful smoking cessation and that program opt out, which might be interpreted as a less positive outcome, may occur because of successful cessation. Finally, several participants reported using SmokefreeTXT together with other evidence-based cessation methods or non-evidence-based strategies.ConclusionsQualitative interviews with real-world SmokefreeTXT users showed high program acceptability, engagement with program features, and perceived utility for smoking cessation. Our findings directly informed several program updates, such as adding an adaptive quit date feature and offering supplemental information on live support services for users who prefer human interaction during the cessation process. The study has implications for other digital tobacco cessation interventions and highlights important topics that warrant future research, such as the relationship between program engagement (eg, opt out and retention) and successful cessation.

Project description:BackgroundWeb-based services are an economical and easily scalable means of support that uses existing technology. Text4Support is a supportive, complementary text messaging service that supports people with different mental health conditions after they are discharged from inpatient psychiatric care.ObjectiveIn this study, we aim to assess user satisfaction with the Text4Support service to gain a better understanding of subscribers' experiences.MethodsThis was a mixed methods study using secondary data from a pilot observational controlled trial. The trial included 181 patients discharged from acute psychiatric care and distributed into 4 randomized groups. Out of the 4 study groups in the initial study, 2 groups who received supportive text messages (89/181, 49.2% of patients), either alone or alongside a peer support worker, were included. Thematic and descriptive analyses were also performed. Differences in feedback based on sex at birth and primary diagnosis were determined using univariate analysis. The study was registered with ClinicalTrials.gov (trial registration number: NCT03404882).ResultsOut of 89 participants, 36 (40%) completed the follow-up survey. The principal findings were that Text4Support was well perceived with a high satisfaction rate either regarding the feedback of the messages or their perceived impact. Meanwhile, there was no statistically significant difference between satisfactory items based on the subscriber's sex at birth or primary diagnosis. The patients' initial expectations were either neutral or positive in relation to the expected nature or the impact of the text messages received on their mental well-being. In addition, the subscribers were satisfied with the frequency of the messages, which were received once daily for 6 consecutive months. The participants recommended more personalized messages or mutual interaction with health care personnel.ConclusionsText4Support was generally well perceived by patients after hospital discharge, regardless of their sex at birth or mental health diagnosis. Further personalization and interactive platforms were recommended by participants that may need to be considered when designing similar future services.

Project description:Interventions to support people with hypertension in attending clinics and taking their medication have potential to improve outcomes, but delivery on a wide scale and at low cost is challenging. Some trials evaluating clinical interventions using short message service (SMS) text-messaging systems have shown important outcomes, although evidence is limited. We have developed a novel SMS system integrated with clinical care for use by people with hypertension in a low-resource setting. We aim to test the efficacy of the system in improving blood pressure control and treatment adherence compared to usual care.The SMS Text-message Adherence suppoRt trial (StAR) is a pragmatic individually randomised three-arm parallel group trial in adults treated for hypertension at a single primary care centre in Cape Town, South Africa. The intervention is a structured programme of clinic appointment, medication pick-up reminders, medication adherence support and hypertension-related education delivered remotely using an automated system with either informational or interactive SMS text-messages. Usual care is supplemented by infrequent non-hypertension related SMS text-messages. Participants are 1:1:1 individually randomised, to usual care or to one of the two active interventions using minimisation to dynamically adjust for gender, age, baseline systolic blood pressure, years with hypertension, and previous clinic attendance. The primary outcome is the change in mean systolic blood pressure at 12-month follow-up from baseline measured with research staff blinded to trial allocation. Secondary outcomes include the proportion of patients with 80% or more of days medication available, proportion of participants achieving a systolic blood pressure less than 140 mmHg and a diastolic blood pressure less than 90 mmHg, hospital admissions, health status, retention in clinical care, satisfaction with treatment and care, and patient related quality of life. Anonymised demographic data are collected on non-participants.The StAR trial uses a novel, low cost system based on widely available mobile phone technology to deliver the SMS-based intervention, manage communication with patients, and measure clinically relevant outcomes. The results will inform implementation and wider use of mobile phone based interventions for health care delivery in a low-resource setting.NCT02019823.

Project description:IntroductionTraditional methods for obtaining outcomes for patients after acute stroke are resource-intensive. This study aimed to examine the feasibility, reliability, cost, and acceptability of collecting outcomes after acute stroke with a short message service (SMS)-text messaging program.MethodsPatients were enrolled in an SMS-text messaging program at acute stroke hospitalization discharge. Participants were prompted to complete assessments including the modified Rankin scale (mRS) and Patient-Reported Outcomes Measurement (PROM) Information System Global-10 at 30, 60, and 90 days postdischarge via SMS-text. Agreement and cost of SMS-text data collection were compared to those obtained from traditional follow-up methods (via phone or in the clinic). Participant satisfaction was surveyed upon program conclusion.ResultsOf the 350 patients who agreed to receive SMS texts, 40.5% responded to one or more assessments. Assessment responders were more likely to have English listed as their preferred language (p = 0.009), have a shorter length of hospital stay (p = 0.01), lower NIH stroke scale upon admission (p < 0.001), and be discharged home (p < 0.001) as compared to nonresponders. Weighted Cohen's kappa revealed that the agreement between SMS texting and traditional methods was almost perfect for dichotomized (good vs. poor) (κ = 0.8) and ordinal levels of the mRS score (κ = 0.8). Polychoric correlations revealed a significant association for PROM scores ( ρ = 0.4, p < 0.01 and ρ = 0.4, p < 0.01). A cost equation showed that gathering outcomes via SMS texting would be less costly than phone follow-up for cohorts with more than 181 patients. Nearly all participants (91%) found the program acceptable and not burdensome (94%), and most (53%) felt it was helpful. Poststroke outcome data collection via SMS texting is feasible, reliable, low-cost, and acceptable. Reliability was higher for functional outcomes as compared to PROMs.ConclusionsWhile further validation is required, our findings suggest that SMS texting is a feasible method for gathering outcomes after stroke at scale to evaluate the efficacy of acute stroke treatments.

Project description:BackgroundMobile health technologies can be useful for providing disease self-management information and support to people with inflammatory bowel disease (IBD).ObjectiveThe aim of this study was to test a self-management SMS text messaging intervention for people with IBD. Our goal was to examine intervention feasibility, acceptability, and engagement and to preliminarily evaluate improvements in certain self-reported health outcomes among participants.MethodsWe developed an SMS text messaging program called Text4IBD. The program sent daily support messages and resources about disease self-management over the course of a 2-week, single-group, pretest-posttest intervention to participants (N=114) diagnosed with IBD. We examined intervention feasibility, acceptability, and engagement through Text4IBD message topic recall and use of resources (ie, visiting supplemental websites recommended by the Text4IBD program). We also assessed pretest-posttest measures of IBD-related distress, self-efficacy, perceived support, use of coping strategies, and medication adherence. Analyses examined participants' evaluations of the intervention and compared pretest-posttest changes in secondary outcomes using paired-samples statistics.ResultsApproximately all participants who completed the intervention (n=105) were receptive to Text4IBD and viewed the program as feasible and acceptable. In addition, most participants (103/105, 98.1%) recalled at least one of the message topics sent by the program, and 79% (83/105) of them self-reported engaging with at least one of the external self-management resources recommended by the Text4IBD program. Pretest-posttest results showed reduced IBD-related distress (mean 3.33, SD 0.68 vs mean 2.86, SD 0.73; P<.001) and improvements in most other secondary outcomes.ConclusionsFindings from this study highlight the value of SMS text messaging as a useful digital medium for providing support to people with IBD, particularly to those who may struggle with disease-related distress. Text4IBD was highly feasible and acceptable and may help people self-manage their IBD. Future studies should aim to evaluate this program in a randomized controlled trial in clinical settings.

Project description:BackgroundYoung adults have high rates of mental health conditions, but most do not want or cannot access treatment. By leveraging a medium that young adults routinely use, text messaging programs have potential to keep young adults engaged with content supporting self-management of mental health issues and can be delivered inexpensively at scale. We designed an intervention that imparts strategies for self-managing mental health symptoms through interactive text messaging dialogues and engages users through novelty and variety in strategies (from cognitive behavioral therapy, acceptance and commitment therapy, and positive psychology) and styles of interaction (e.g., prompts, peer stories, writing tasks).MethodsThe aim of this mixed-methods study was to pilot 1- and 2-week versions of an interactive text messaging intervention among young adults (ages 18-25), and to obtain feedback to guide intervention refinements. Young adults were recruited via a mental health advocacy website and snowball sampling at a North American University. We used Wizard-of-Oz methods in which study staff sent messages based on a detailed script. Transcripts of interviews were subject to qualitative analysis to identify aspects of the program that need improvements, and to gather participant perspectives on possible solutions.ResultsForty-eight individuals ages 18-25 participated in the study (mean age: 22.0). 85 % responded to the program at least once. Among those who ever responded, they replied to messages on 85 % of days, and with engagement sustained over the study period. Participants endorsed the convenience of text messaging, the types of interactive dialogues, and the variety of content. They also identified needed improvements to message volume, scheduling, and content.ConclusionsYoung adults showed high levels of engagement and satisfaction with a texting program supporting mental health self-management. The program may be improved through refining personalization, timing, and message volume, and extending content to support use over a longer timeframe. If shown to be effective in randomized trials, this program has potential to help address a substantial treatment gap in young adults' mental health.

Project description:BackgroundSwallowing difficulties (ie, dysphagia) are common among older adults, with a 13% to 54% prevalence. Adequate interventions to improve the swallowing function of older adults would reduce morbidity and enhance health-related quality of life outcomes. Mobile health (mHealth) apps may help alleviate dysphagia symptoms by providing programs that maximize the intensity and frequency of training without requiring high costs or regular clinic visits.ObjectiveThe aim of this pilot study was to assess the usability of swallowing training apps by quantitatively and qualitatively evaluating older adults' self-reported data, taking into consideration their educational levels and exposure to mobile technology. We conducted surveys and brief interviews while the participants used a swallowing intervention app we developed. We subsequently identified and resolved individual-specific usability issues to improve future implementation of the app protocol for older persons with swallowing difficulties.MethodsA total of 11 participants (10 women, 91%; mean age 75.7 years, SD 3.93) from two district-run senior welfare centers took part in this study. The participants were divided into a high-potential group and a low-potential group based on their total number of years of education and smart device usage. To investigate the usability of the app twice (ie, in the second week of the intervention and the postintervention stage), we used mixed methods consisting of both quantitative approaches, namely the System Usability Scale (SUS) and modified Computer Self-Efficacy Scale (mCSES) surveys, and qualitative approaches (ie, interviews).ResultsThe quantitative results of the SUS and mCSES surveys revealed that the high-potential group was more inclined to adopt and learn new technology than the low-potential group. Specifically, within the high-potential group, a Wilcoxon signed-rank test indicated that the postintervention mCSES scores (median 65.50) were significantly higher than those in the second week of intervention (median 54.00; z=-2.023, P=.04). Additionally, the usability scores in the low-potential group were within the "marginal acceptability" range even after completion of an 8-week intervention program. Qualitative analyses via semi-structured interviews yielded promising outcomes regarding app acceptability, training program utilization, emotional responses, and learning experience.ConclusionsTo the best of the authors' knowledge, this usability and feasibility study is the first report of a swallowing training app designed to improve the swallowing function of older adults. Future research should consider several issues, such as user characteristics, pretraining education, and the intensity and innate characteristics of the intervention program.