Dataset Information

Mobile Health for Smoking Cessation Among Disadvantaged Young Women During and After Pregnancy: User-Centered Design and Usability Study.

ABSTRACT:

Background

Smoking prevalence during and after pregnancy remains high among socioeconomically disadvantaged women. Mobile health (mHealth) apps with game and social support elements seem promising to support smoking cessation.

Objective

This study aims to describe the user-centered design and usability evaluation of Kindle, an mHealth app with game and social support elements, to support disadvantaged young women during and after pregnancy through the first stages of smoking cessation.

Methods

Disadvantaged women (n=9), members of their social networks (n=4), and nurses supporting these women (n=51) were informants throughout the iterative prototype development of Kindle according to the International Organization for Standardization 9241-11:2018. Specific phases included understanding the context of use through secondary analysis of qualitative interview data (phase 1), establishing the user and organizational requirements (phase 2), production of design solutions (phase 3), and usability inspection of the prototype through a heuristic evaluation (3 experts) along with user testing by a think aloud method (5 disadvantaged women and 5 nurses; phase 4). Usability problems were categorized according to the principles of the Healthcare Information and Management Systems Society.

Results

Phase 1 resulted in an understanding of the VoorZorg program and the needs of VoorZorg nurses and clients (eg, focus on early stages of change and building new supportive networks to aid clients in smoking cessation). In phase 2, we established requirements (n=22; eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring at early stages of change in smoking cessation). Phase 3 resulted in a prototype of Kindle, combining the interface for nurses and clients, including the following functionalities: personal goal setting with earning points; secured chat function between nurses and other clients; and tips, diary, and profile creation. The heuristic evaluation and thinking aloud method in phase 4 revealed 78 usability problems in the interfaces. Most usability problems concerned simplicity (eg, unclear clickable button) and naturalness (eg, unclear icon).

Conclusions

The user-centered design and usability testing of the mHealth app Kindle yielded useful insights. The involvement of end users, specifically socioeconomically disadvantaged women during and after their pregnancy, resulted in a prototype that met their needs and requirements (eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring to the early stages of change in smoking cessation) to achieve readiness for smoking cessation. Moreover, the usability evaluation by end users and experts revealed unique usability problems for this population. These insights allow for further optimization of Kindle and encourage future studies to engage disadvantaged populations in all phases of mHealth intervention design and usability testing.

SUBMITTER: Derksen ME

PROVIDER: S-EPMC8374659 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Smoking rates in the United States have been reduced in the past decades to 15% of the general population. However, up to 88% of people with psychiatric symptoms still smoke, leading to high rates of disease and mortality. Therefore, there is a great need to develop smoking cessation interventions that have adequate levels of usability and can reach this population. OBJECTIVE:The objective of this study was to report the rationale, ideation, design, user research, and final specifications of a novel smoking cessation app for people with serious mental illness (SMI) that will be tested in a feasibility trial. METHODS:We used a variety of user-centered design methods and materials to develop the tailored smoking cessation app. This included expert panel guidance, a set of design principles and theory-based smoking cessation content, development of personas and paper prototyping, usability testing of the app prototype, establishment of app's core vision and design specification, and collaboration with a software development company. RESULTS:We developed Learn to Quit, a smoking cessation app designed and tailored to individuals with SMI that incorporates the following: (1) evidence-based smoking cessation content from Acceptance and Commitment Therapy and US Clinical Practice Guidelines for smoking cessation aimed at providing skills for quitting while addressing mental health symptoms, (2) a set of behavioral principles to increase retention and comprehension of smoking cessation content, (3) a gamification component to encourage and sustain app engagement during a 14-day period, (4) an app structure and layout designed to minimize usability errors in people with SMI, and (5) a set of stories and visuals that communicate smoking cessation concepts and skills in simple terms. CONCLUSIONS:Despite its increasing importance, the design and development of mHealth technology is typically underreported, hampering scientific innovation. This report describes the systematic development of the first smoking cessation app tailored to people with SMI, a population with very high rates of nicotine addiction, and offers new design strategies to engage this population. mHealth developers in smoking cessation and related fields could benefit from a design strategy that capitalizes on the role visual engagement, storytelling, and the systematic application of behavior analytic principles to deliver evidence-based content.

Project description:BackgroundConversational chatbots are an emerging digital intervention for smoking cessation. No studies have reported on the entire development process of a cessation chatbot.ObjectiveWe aim to report results of the user-centered design development process and randomized controlled trial for a novel and comprehensive quit smoking conversational chatbot called QuitBot.MethodsThe 4 years of formative research for developing QuitBot followed an 11-step process: (1) specifying a conceptual model; (2) conducting content analysis of existing interventions (63 hours of intervention transcripts); (3) assessing user needs; (4) developing the chat's persona ("personality"); (5) prototyping content and persona; (6) developing full functionality; (7) programming the QuitBot; (8) conducting a diary study; (9) conducting a pilot randomized controlled trial (RCT); (10) reviewing results of the RCT; and (11) adding a free-form question and answer (QnA) function, based on user feedback from pilot RCT results. The process of adding a QnA function itself involved a three-step process: (1) generating QnA pairs, (2) fine-tuning large language models (LLMs) on QnA pairs, and (3) evaluating the LLM outputs.ResultsWe developed a quit smoking program spanning 42 days of 2- to 3-minute conversations covering topics ranging from motivations to quit, setting a quit date, choosing Food and Drug Administration-approved cessation medications, coping with triggers, and recovering from lapses and relapses. In a pilot RCT with 96% three-month outcome data retention, QuitBot demonstrated high user engagement and promising cessation rates compared to the National Cancer Institute's SmokefreeTXT text messaging program, particularly among those who viewed all 42 days of program content: 30-day, complete-case, point prevalence abstinence rates at 3-month follow-up were 63% (39/62) for QuitBot versus 38.5% (45/117) for SmokefreeTXT (odds ratio 2.58, 95% CI 1.34-4.99; P=.005). However, Facebook Messenger intermittently blocked participants' access to QuitBot, so we transitioned from Facebook Messenger to a stand-alone smartphone app as the communication channel. Participants' frustration with QuitBot's inability to answer their open-ended questions led to us develop a core conversational feature, enabling users to ask open-ended questions about quitting cigarette smoking and for the QuitBot to respond with accurate and professional answers. To support this functionality, we developed a library of 11,000 QnA pairs on topics associated with quitting cigarette smoking. Model testing results showed that Microsoft's Azure-based QnA maker effectively handled questions that matched our library of 11,000 QnA pairs. A fine-tuned, contextualized GPT-3.5 (OpenAI) responds to questions that are not within our library of QnA pairs.ConclusionsThe development process yielded the first LLM-based quit smoking program delivered as a conversational chatbot. Iterative testing led to significant enhancements, including improvements to the delivery channel. A pivotal addition was the inclusion of a core LLM-supported conversational feature allowing users to ask open-ended questions.Trial registrationClinicalTrials.gov NCT03585231; https://clinicaltrials.gov/study/NCT03585231.

Project description:Background: Young adults with serious mental illness (SMI) are over twice as likely to smoke cigarettes than those in the general population, but little research has evaluated the efficacy of interventions for this group. While smartphone apps are a promising tool to address this need, their usability should be evaluated among young adults with psychotic disorders, whose symptoms and cognitive impairments may be a barrier to app use. Methods: We compared usability and acceptability of National Cancer Institute apps (QuitGuide and quitSTART) between young adult smokers with SMI psychotic disorders and other SMI diagnoses. We evaluated objective app usability at the initial study visit and following 2 weeks of independent use via a video-recorded task-completion protocol. Perceptions of usability and acceptability were assessed with semi-structured interviews. Engagement was assessed with backend app use data. Results: Participants had a mean age of 29 years old (SD = 4). Of the participants without psychotic disorders (n = 10), all were diagnosed with SMI post-traumatic stress disorder (SMI-PTSD). QuitGuide objective task completion rates were high and similar between diagnosis groups, whereas quitSTART task completion was initially lower among users with psychotic disorder compared to users with SMI-PTSD at Visit 1, and improved by Visit 2. Mean app interactions, mean days of use, and median completed notifications were dramatically higher among quitSTART users compared to QuitGuide users. Compared to quitSTART users with SMI-PTSD, quitSTART users with psychotic disorders had similar daily app interactions over the first week of use (mean 3.8 ± 2.4 interactions), and numerically lower mean daily app interactions during the second week (1.9 ± 1.5 vs. 3.4 ± 2.5), whereas completed notifications remained stable among quitSTART users in both diagnosis groups over time. Qualitative comments indicated general acceptability of both apps among both diagnosis groups. Conclusions: Both QuitGuide and quitSTART were usable and appealing among young adult smokers with psychotic disorders and SMI-PTSD, although quitSTART engendered a dramatically greater level of engagement compared to QuitGuide. Initial coaching to support initiation and app notifications to promote prolonged engagement may be important for young adult smokers with psychotic disorders. Replication and efficacy testing for quitSTART is warranted.

Project description:BACKGROUND:Socioeconomic disadvantage is associated with a reduced likelihood of smoking cessation. Smartphone ownership is increasing rapidly, including among low-income adults, and smartphone interventions for smoking cessation may increase access to smoking cessation treatment among socioeconomically disadvantaged adults. OBJECTIVE:This study aimed to evaluate the feasibility of an automated smartphone-based approach to delivering financial incentives for smoking cessation. METHODS:Socioeconomically disadvantaged adults initiating tobacco cessation treatment were followed from 1 week before a scheduled quit attempt through 26 weeks after the quit date. Participants received telephone counseling and nicotine replacement therapy. Smoking cessation was verified 5 times per week via smartphone prompts to self-report smoking status and submit a breath sample via a portable carbon monoxide (CO) monitor that was connected with participants' smartphones. Identity was verified during smoking status assessments using smartphone-based facial recognition software. When smoking abstinence and identity were verified, an automated credit card payment was triggered. Participants were incentivized for abstinence on the quit date and up to five days per week during the first 4 weeks after the scheduled quit date, with additional incentives offered during postquit weeks 8 and 12. In total, participants had the opportunity to earn up to US $250 in abstinence-contingent incentives over the first 12 weeks of the quit attempt. RESULTS:Participants (N=16) were predominantly female (12/16, 75%) and non-Hispanic white (11/16, 69%), black (4/16, 25%), or Hispanic of any race (1/16, 6%). Most participants (9/16, 56%) reported an annual household income of <US $11,000. During the first 4 weeks after the scheduled quit date, participants completed a median of 16 (out of 21; range 1-21) mobile smoking status assessments, and they earned a median of US $28 in abstinence-contingent incentives (out of a possible US $150; range US $0-US $135). Median earnings did not change during the 8- and 12-week incentivized follow-up periods (total median earnings over 12 weeks=US $28; range US $0-US $167). During the first 4 weeks after the scheduled quit date, participants abstained from smoking on a median of 5 (out of 21) assessment days (range 0-20). At the in-person follow-up visits, the expired CO-confirmed 7-day point prevalence abstinence rates were 19% (3/16) and 13% (2/16) at 12 and 26 weeks postquit, respectively. Overall, most participants reported that the system was easy to use and that they would recommend this treatment to their friends and family. CONCLUSIONS:Preliminary data suggest that this smartphone-based approach to verifying identity and smoking status and automating the delivery of abstinence-contingent incentives to a credit card is feasible for use among socioeconomically disadvantaged adults. However, continued refinement is warranted.

Project description:BackgroundMobile device-based tools to help adolescents practice skills outside of cognitive behavioral therapy (CBT) sessions for treating an anxiety disorder may lead to greater treatment gains.ObjectiveThis study aimed to develop, design, and test the acceptability, learnability, heuristics, and usability of MindClimb, a smartphone-based app for adolescents with anxiety to use between CBT sessions to plan and complete exposure activities using skills (cognitive, relaxation, exposure practice, and reward) learned in treatment.MethodsThis 3-phase study took place from August 2015 to December 2018. In phase 1, the app was designed and developed in consultation with young people and CBT therapists to identify desired functions and content. Feedback was subjected to thematic analysis using a general inductive approach. In phase 2, we conducted 2 high-fidelity testing sessions using the think-aloud approach (acceptability, learnability, usability) and 10-item System Usability Scale with 10 adolescents receiving CBT. The high-fidelity MindClimb app was evaluated by 5 app developers based on Nielsen's usability heuristics and 5-point severity ranking scale. In phase 3, a total of 8 adolescents and 3 therapists assessed the usability of MindClimb during CBT sessions by recording the frequency of skills practice, use of MindClimb features, satisfaction with the app, and barriers and facilitators to app use during treatment.ResultsFeedback from phase 1 consultations indicated that the app should (1) be responsive to user needs and preferences, (2) be easy to use and navigate, (3) have relevant content to the practice of CBT for anxiety, and (4) be aesthetically appealing. Using this feedback as a guide, a fully functional app prototype for usability testing and heuristic evaluation was developed. In phase 2, think-aloud and usability data resulted in minor revisions to the app, including refinement of exposure activities. The average system usability score was 77 in both testing cycles, indicating acceptable usability. The heuristic evaluation by app developers identified only minor errors (eg, loading speed of app content, with a score of 1 on the severity ranking scale). In phase 3, adolescents considered app features for completing exposure (6.2/10) and relaxation (6.4/10) modestly helpful. Both adolescents (average score 11.3/15, SD 1.6) and therapists (average score 10.0/12, 2.6 SD) reported being satisfied with the app.ConclusionsThe user-centered approach to developing and testing MindClimb resulted in a mobile health app that can be used by adolescents during CBT for anxiety. Evaluation of the use of this app in a clinical practice setting demonstrated that adolescents and therapists generally felt it was helpful for CBT practice outside of therapy sessions. Implementation studies with larger youth samples are necessary to evaluate how to optimize the use of technology in clinical care and examine the impact of the app plus CBT on clinical care processes and patient outcomes.

Project description:IntroductionOver 25% of Dutch young people are psychologically unhealthy. Individual and societal consequences that follow from having mental health complaints at this age are substantial. Young people need care which is often unavailable. ENgage YOung people earlY (ENYOY) is a moderated digital social therapy-platform that aims to help youngsters with emerging mental health complaints. Comprehensive research is being conducted into the effects and to optimize and implement the ENYOY-platform throughout the Netherlands. The aim of this study is to explore the usability and user experience of the ENYOY-platform.MethodsA user-centered mixed-method design was chosen. 26 young people aged 16-25 with emerging mental health complaints participated. Semi-structured interviews were conducted to explore usability, user-friendliness, impact, accessibility, inclusivity, and connection (Phase 1). Phase 2 assessed usability problems using the concurrent and retrospective Think Aloud-method. User experience and perceived helpfulness were assessed using a 10-point rating scale and semi-structured interviews (Phase 3). The Health Information Technology Usability Evaluation Scale (Health-ITUES; Phase 1) and System Usability Scale (SUS; Phase 2 and 3) were administered. Qualitative data was analyzed using thematic analysis. Task completion rate and time were tracked and usability problems were categorized using the Nielsen's rating scale (Phase 2).ResultsAdequate to high usability was found (Phase 1 Health-ITUES 4.0(0.34); Phase 2 SUS 69,5(13,70); Phase 3 SUS 71,6(5,63)). Findings from Phase 1 (N = 10) indicated that users viewed ENYOY as a user-friendly, safe, accessible, and inclusive initiative which helped them reduce their mental health complaints and improve quality of life. Phase 2 (N = 10) uncovered 18 usability problems of which 5 of major severity (e.g. troubles accessing the platform). Findings from Phase 3 (N = 6) suggested that users perceived the coaching calls the most helpful [9(0.71)] followed by the therapy content [6.25(1.41)]. Users liked the social networking aspect but rated it least helpful [6(2.1)] due to inactivity.ConclusionThe ENYOY-platform has been found to have adequate to high usability and positive user experiences were reported. All findings will be transferred to the developmental team to improve the platform. Other evaluation methods and paring these with quantitative outcomes could provide additional insight in future research.