Dataset Information

The effect of user interface on treatment engagement in a self-guided digital problem-solving intervention: A randomized controlled trial.

ABSTRACT:

Background

Resources are spent worldwide on the development of digital platforms and their user interfaces (UIs) for digital mental health services (DMHS). However, studies investigating the potential benefits of different UIs for DMHS are currently lacking. To fill this knowledge gap, the aim of this study was to investigate differences in treatment engagement between two different UIs for DMHS.

Methods

A total of 397 participants from the Swedish general public were randomized (1:1) to use a self-guided digital problem-solving intervention during one week, either with an optimized UI (N = 198), based on user experience (UX) design principles and with automated features, or a basic UI (N = 199), analogous with a UI used in Swedish regular health care comprising elementary UI features and less automation. Primary outcome measures were self-rated usability, on the System Usability Scale, and treatment credibility, on the Credibility/Expectancy Questionnaire. Secondary outcome measures included behavioral engagement with the intervention.

Findings

There were no significant differences between the UIs in ratings of usability or treatment credibility. However, participants who used the optimized UI were significantly more engaged with the intervention as measured by usage of the intervention at least once (odds ratio 2.54, 95% CI [1.67, 3.85]), total number of generated solutions (mean difference 1.41, 95% CI [0.72, 2.11]), and mean number of generated solutions per initiated problem-solving attempt (mean difference 1.45, 95% CI [1.06, 1.85]). Other findings included participants using the optimized UI rating the intervention as easier to understand, while feeling more overwhelmed, than those using the basic UI.

Interpretation

Our findings indicate that an optimized UI based on UX design principles, in comparison to a basic UI comprising elementary UI features, do not affect overall self-rated usability or treatment credibility but increases some measures of behavioral engagement with a digital intervention.

Funding

Funded by the Government of Sweden, Ministry of Health and Social Affairs.

SUBMITTER: Hentati A

PROVIDER: S-EPMC8387893 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundPsychosocial interventions delivered by nonspecialists can be effective at reducing common adolescent mental health problems in low-resource settings. However, there is a lack of evidence on resource-efficient methods for building capacity to deliver these interventions.ObjectiveThe objective of this study is to evaluate the effects of a digital training (DT) course, delivered in a self-guided format or with coaching, on nonspecialists' competency to deliver a problem-solving intervention intended for adolescents with common mental health problems in India.MethodsWe will conduct a pre-post study with a nested parallel, 2-arm, individually randomized controlled trial. The study aims to recruit 262 participants, randomized 1:1 to receive either a self-guided DT course or a DT course with weekly individualized coaching provided remotely by telephone. In both arms, the DT will be accessed over 4 to 6 weeks. Participants will be nonspecialists (ie, without prior practice-based training in psychological therapies) recruited from among university students and affiliates of nongovernmental organizations in Delhi and Mumbai, India.ResultsOutcomes will be assessed at baseline and 6 weeks post randomization using a knowledge-based competency measure that incorporates a multiple-choice quiz format. The primary hypothesis is that self-guided DT will lead to increased competency scores among novices with no prior experience of delivering psychotherapies. The secondary hypothesis is that digital training with coaching will have an incremental effect on competency scores compared with DT alone. The first participant was enrolled on April 4, 2022.ConclusionsThe study will address an evidence gap on the effectiveness of training methods for nonspecialist providers of adolescent mental health interventions in low-resource settings. The findings from this study will be used to support wider efforts to scale up evidence-based mental health interventions for young people.Trial registrationClinicalTrials.gov NCT05290142; https://clinicaltrials.gov/ct2/show/NCT05290142.International registered report identifier (irrid)DERR1-10.2196/41981.

Project description:BackgroundWith the proliferation of digital mental health interventions (DMHIs) guided by relational agents, little is known about the behavioral, cognitive, and affective engagement components associated with symptom improvement over time. Obtaining a better understanding could lend clues about recommended use for particular subgroups of the population, the potency of different intervention components, and the mechanisms underlying the intervention's success.ObjectiveThis exploratory study applied clustering techniques to a range of engagement indicators, which were mapped to the intervention's active components and the connect, attend, participate, and enact (CAPE) model, to examine the prevalence and characterization of each identified cluster among users of a relational agent-guided DMHI.MethodsWe invited adults aged 18 years or older who were interested in using digital support to help with mood management or stress reduction through social media to participate in an 8-week DMHI guided by a natural language processing-supported relational agent, Woebot. Users completed assessments of affective and cognitive engagement, working alliance as measured by goal and task working alliance subscale scores, and enactment (ie, application of therapeutic recommendations in real-world settings). The app passively collected data on behavioral engagement (ie, utilization). We applied agglomerative hierarchical clustering analysis to the engagement indicators to identify the number of clusters that provided the best fit to the data collected, characterized the clusters, and then examined associations with baseline demographic and clinical characteristics as well as mental health outcomes at week 8.ResultsExploratory analyses (n=202) supported 3 clusters: (1) "typical utilizers" (n=81, 40%), who had intermediate levels of behavioral engagement; (2) "early utilizers" (n=58, 29%), who had the nominally highest levels of behavioral engagement in week 1; and (3) "efficient engagers" (n=63, 31%), who had significantly higher levels of affective and cognitive engagement but the lowest level of behavioral engagement. With respect to mental health baseline and outcome measures, efficient engagers had significantly higher levels of baseline resilience (P<.001) and greater declines in depressive symptoms (P=.01) and stress (P=.01) from baseline to week 8 compared to typical utilizers. Significant differences across clusters were found by age, gender identity, race and ethnicity, sexual orientation, education, and insurance coverage. The main analytic findings remained robust in sensitivity analyses.ConclusionsThere were 3 distinct engagement clusters found, each with distinct baseline demographic and clinical traits and mental health outcomes. Additional research is needed to inform fine-grained recommendations regarding optimal engagement and to determine the best sequence of particular intervention components with known potency. The findings represent an important first step in disentangling the complex interplay between different affective, cognitive, and behavioral engagement indicators and outcomes associated with use of a DMHI incorporating a natural language processing-supported relational agent.Trial registrationClinicalTrials.gov NCT05672745; https://classic.clinicaltrials.gov/ct2/show/NCT05672745.

Project description:BackgroundSickle cell disease (SCD) is characterized by severe acute pain episodes as well as risk for chronic pain. Digital delivery of SCD pain self-management support may enhance pain self-management skills and accessibility for youth. However, little is known about how youth with SCD and their caregivers engage with digital health programs. iCanCope with pain is a digital pain self-management platform adapted for youth with SCD and caregivers through a user-centered design approach. The program was delivered via a website (separate versions for youth and caregiver) and mobile app (youth only).ObjectiveWe aimed to characterize patterns of user engagement with the iCanCope with SCD program among youth with SCD and their caregivers.MethodsA randomized controlled trial was completed across multiple North American SCD clinics. Eligible youth were aged 12-18 years, diagnosed with SCD, English-speaking, and experiencing moderate-to-severe pain interference. Eligible caregivers were English-speaking with a child enrolled in the study. Dyads were randomized to receive the iCanCope intervention or attention-control education for 8-12 weeks. This report focused on engagement among dyads who received the intervention. User-level analytics were captured. Individual interviews were conducted with 20% of dyads. Descriptive statistics characterized quantitative engagement. Content analysis summarized qualitative interview data. Exploratory analysis tested the hypothesis that caregiver engagement would be positively associated with child engagement.ResultsThe cohort included primarily female (60% [34/57] of youth; 91% [49/56] of caregivers) and Black (>90% of youth [53/57] and caregivers [50/56]) participants. Among 56 dyads given program access, differential usage patterns were observed: both the youth and caregiver engaged (16/56, 29%), only the youth engaged (24/56, 43%), only the caregiver engaged (1/56, 2%), and neither individual engaged (16/56, 29%). While most youth engaged with the program (40/57, 70%), most caregivers did not (39/56, 70%). Youth were more likely to engage with the app than the website (85% [34/57] versus 68% [23/57]), and the most popular content categories were goal setting, program introduction, and symptom history. Among caregivers, program introduction, behavioral plans, and goal setting were the most popular content areas. As hypothesized, there was a moderate positive association between caregiver and child engagement (χ21=6.6; P=.01; ϕ=0.34). Interviews revealed that most dyads would continue to use the program (11/12, 92%) and recommend it to others (10/12, 83%). The reasons for app versus website preference among youth were ease of use, acceptable time commitment, and interactivity. Barriers to caregiver engagement included high time burden and limited perceived relevance of content.ConclusionsThis is one of the first studies to apply digital health analytics to characterize patterns of engagement with SCD self-management among youth and caregivers. The findings will be used to optimize the iCanCope with SCD program prior to release.Trial registrationClinicalTrials.gov NCT03201874; https://clinicaltrials.gov/ct2/show/NCT03201874.

Project description:IntroductionTechnology-mediated self-guided interventions (TMSGIs) for addictive disorders represent promising adjuncts and alternatives to traditional treatment approaches (eg, face-to-face psychotherapy). However, meaningful evaluation of such interventions remains elusive given the lack of consistent terminology and application. Preliminary findings suggest that TMSGIs are useful but engagement remains modest for various reasons reported by users, including lack of personalisation. The aim of this review is to explore how TMSGIs have been defined and applied in addictions populations with an emphasis on technical and logistical features associated with greater user engagement.Methods and analysisThis scoping review protocol was developed in accordance with the Arksey and O'Malley framework. Articles from electronic databases (ie, PsycINFO, Embase, MEDLINE and CINAHL) will be included if they targeted adolescents or adults with one or more substance or behavioural addictions, excessive behaviours or aspects thereof (eg, cravings) using a privately accessible technology-mediated intervention. Two independent reviewers will screen titles and abstracts for relevance before commencing full-text reviews. Extracted data will be presented in descriptive, tabular and graphical summaries as appropriate.Ethics and disseminationEthics committee approval is not required for this study. Review findings will be used to guide the development of preliminary recommendations for real-time addiction intervention development and provision. Emphasis will be placed on practical considerations of user engagement, accessibility, usability and cost. Knowledge users, including clinicians, researchers and people with lived experience, will be engaged for development of one such intervention following publication of review findings.RegistrationThis scoping review was registered with the Open Science Framework on 15 April 2022 and can be located at http://www.osf.io/3utp9/.

Project description:BackgroundThis article reports an evaluation of the Immunization Training Challenge Hackathons (ITCH), invented by The Geneva Learning Foundation (TGLF) for national and sub-national immunization staff who strive to develop the knowledge and capacity of others to improve immunization program performance. ITCH, a fully-digital program focused on networked collaborative problem-solving between peers, provided an "opt-in" activity for learners in the Teach to Reach (T2R) Accelerator Program designed to improve training effectiveness in the immunization sphere.MethodsConducted by a team from the University of Georgia, this mixed method evaluation consisted of thematic analysis of recorded sessions and open-ended comments; and statistical analyses of application and follow-up survey data. The evaluation focused on what was learned and how ITCH participants implemented what they learned. Key stakeholder interviews provided supplemental data about program intent and results. ITCH consisted of 17 30-min sessions held in 2020, in English and French, with 581 participating at least once out of 1,454 enrolled in the overall program. Challenge owners and respondents came from 15 African and Asian countries and spanned different roles with differing scope.ResultsOver 85% [n = 154] of survey respondents [n = 181, a 31% response rate] indicated they were able to implement what they learned from the ITCH sessions. A majority [n = 139, 76.7%] reported finding the sessions useful. Issues with poor connectivity and the timing of the live meetings impeded some in their ability to participate, a problem compounded by consequences of the pandemic. The ITCH process constituted of learning or coming to consciousness simultaneously of four types of learning - participants realizing how much they could learn from each other (peer learning), experiencing the power of defying distance to solve problems together (remote learning), and feeling a growing sense of belonging to a community (social learning), emergent across country borders and health system levels (networked learning).ConclusionsBased on evaluation findings, it was concluded that ITCH demonstrated an effective scalable, informal, non-didactic, experience-led, fast-paced, peer learning design. A focus on community engagement and developing brokering skills was recommended.