Dataset Information

Postsecondary Student Engagement With a Mental Health App and Online Platform (Thought Spot): Qualitative Study of User Experience.

ABSTRACT:

Background

There is growing interest in using mobile apps and online tools to support postsecondary student mental health, but most of these solutions have suboptimal user engagement in real-world settings. Poor engagement can limit long-term effectiveness and usefulness of these tools. Previous literature has proposed several theories that link factors such as low usability and poor user-centered design to app disengagement. However, few studies provide direct evidence showing what factors contribute to suboptimal user engagement in the context of mobile mental health apps for postsecondary students.

Objective

This study focuses on understanding postsecondary students' attitudes and behaviors when using Thought Spot, a co-designed mental health app and online platform, to understand factors related to engagement and user experience.

Methods

Students who were given access to Thought Spot for 6 months during a randomized trial of the intervention were invited to participate in one-on-one semistructured interviews. The interviews explored participants' overall experiences and perceptions of the app, along with factors that affected their usage of various features. All interviews were recorded, and template analysis was used to analyze transcripts.

Results

User satisfaction was mixed among users of Thought Spot. The degree of engagement with the app appeared to be affected by factors that can be grouped into 5 themes: (1) Students valued detailed, inclusive, and relevant content; (2) Technical glitches and a lack of integration with other apps affected the overall user experience and satisfaction with the app; (3) Using the app to support peers or family can increase engagement; (4) Crowdsourced information from peers about mental health resources drove user engagement, but was difficult to obtain; and (5) Users often turned to the app when they had an immediate need for mental health information, rather than using it to track mental health information over time.

Conclusions

Content, user experience, user-centeredness, and peer support are important determinants of user engagement with mobile mental health apps among postsecondary students. In this study, participants disengaged when the app did not meet their expectations on these determinants. Future studies on user engagement should further explore the effectiveness of different features and the relative importance of various criteria for high-quality apps. Further focus on these issues may inform the creation of interventions that increase student engagement and align with their mental health needs.

Trial registration

ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461.

International registered report identifier (irrid)

RR2-10.2196/resprot.6446.

SUBMITTER: Wong HW

PROVIDER: S-EPMC8052598 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo evaluate the perceived usability of and user engagement with a digital platform (Thought Spot) designed to enhance mental health and wellness help-seeking among transition-aged youth (TAY; 17-29-years old).Materials and methodsSurvey responses and usage patterns were collected as part of a randomized controlled trial evaluating the efficacy of Thought Spot. Participants given Thought Spot completed an adapted Usefulness, Satisfaction, and Ease of Use (USE) Questionnaire to measure perceived usability of the platform. User engagement patterns on Thought Spot were examined using analytics data collected throughout the study (March 2018-June 2019).ResultsA total of 131 transition-aged participants completed the USE questionnaire and logged on to Thought Spot at least once. Ease of learning scored higher than ease of use, usefulness and satisfaction. Participants identified numerous strengths and challenges related to usability, visual appeal, functionality and usefulness of the content. In terms of user engagement, most participants stopped using the platform after 3 weeks. Participants searched and were interested in a variety of resources, including mental health, counselling and social services.DiscussionParticipants reported mixed experiences while using Thought Spot and exhibited low levels of long-term user engagement. User satisfaction, the willingness to recommend Thought Spot to others, and the willingness for future use appeared to be influenced by content relevance, ease of learning, available features, and other contextual factors. Analysis of the types of resources viewed and searches conducted by TAY end-users provided insight into their behaviour and needs.ConclusionUsers had mixed perceptions about the usability of Thought Spot, which may have contributed to the high attrition rate. User satisfaction and engagement appears to be influenced by content relevance, ease of learning, and the types of features available. Further investigation to understand the contextual factors that affect TAYs' adoption and engagement with digital mental health tools is required.

Project description:BACKGROUND:Youth demonstrate a low propensity to seek help for mental health issues and exhibit low use of health services despite the high prevalence of mental health challenges in this population. Research has found that delivering interventions via the internet and mobile devices is an effective way to reach youth. Thought Spot, a Web- and mobile-based map, was developed to help transition-aged youth in postsecondary settings overcome barriers to help-seeking, thereby reducing the economic burden associated with untreated mental health issues. OBJECTIVE:This paper presents the protocol for an economic evaluation that will be conducted in conjunction with a randomized controlled trial (RCT) to evaluate the effectiveness and cost of Thought Spot compared with usual care in terms of self-efficacy for mental health help-seeking among postsecondary students. METHODS:A partially blinded RCT will be conducted to assess the impact of Thought Spot on the self-efficacy of students for mental health help-seeking. Students from 3 postsecondary institutions in Ontario, Canada will be randomly allocated to 1 of 2 intervention groups (resource pamphlet or Thought Spot) for 6 months. The economic evaluation will focus on the perspective of postsecondary institutions or other organizations interested in using Thought Spot. Costs and resources for operating and maintaining the platform will be reported and compared with the costs and resource needs associated with usual care. The primary outcome will be change in help-seeking intentions, measured using the General Help-Seeking Questionnaire. The cost-effectiveness of the intervention will be determined by calculating the incremental cost-effectiveness ratio, which will then be compared with willingness to pay. RESULTS:The RCT is scheduled to begin in February 2018 and will run for 6 months, after which the economic evaluation will be completed. CONCLUSIONS:We expect to demonstrate that Thought Spot is a cost-effective way to improve help-seeking intentions and encourage help-seeking behavior among postsecondary students. The findings of this study will help inform postsecondary institutions when they are allocating resources for mental health initiatives. TRIAL REGISTRATION:ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461 (Archived at WebCite at http://www.webcitation.org/6xy5lWpnZ).

Project description:BackgroundChildhood obesity is an ongoing problem in developed countries that needs targeted prevention in the youngest age groups. Children in socioeconomically disadvantaged families are most at risk. Mobile health (mHealth) interventions offer a potential route to target these families because of its relatively low cost and high reach. The Growing healthy program was developed to provide evidence-based information on infant feeding from birth to 9 months via app or website. Understanding user engagement with these media is vital to developing successful interventions. Engagement is a complex, multifactorial concept that needs to move beyond simple metrics.ObjectiveThe aim of our study was to describe the development of an engagement index (EI) to monitor participant interaction with the Growing healthy app. The index included a number of subindices and cut-points to categorize engagement.MethodsThe Growing program was a feasibility study in which 300 mother-infant dyads were provided with an app which included 3 push notifications that was sent each week. Growing healthy participants completed surveys at 3 time points: baseline (T1) (infant age ≤3 months), infant aged 6 months (T2), and infant aged 9 months (T3). In addition, app usage data were captured from the app. The EI was adapted from the Web Analytics Demystified visitor EI. Our EI included 5 subindices: (1) click depth, (2) loyalty, (3) interaction, (4) recency, and (5) feedback. The overall EI summarized the subindices from date of registration through to 39 weeks (9 months) from the infant's date of birth. Basic descriptive data analysis was performed on the metrics and components of the EI as well as the final EI score. Group comparisons used t tests, analysis of variance (ANOVA), Mann-Whitney, Kruskal-Wallis, and Spearman correlation tests as appropriate. Consideration of independent variables associated with the EI score were modeled using linear regression models.ResultsThe overall EI mean score was 30.0% (SD 11.5%) with a range of 1.8% - 57.6%. The cut-points used for high engagement were scores greater than 37.1% and for poor engagement were scores less than 21.1%. Significant explanatory variables of the EI score included: parity (P=.005), system type including "app only" users or "both" app and email users (P<.001), recruitment method (P=.02), and baby age at recruitment (P=.005).ConclusionsThe EI provided a comprehensive understanding of participant behavior with the app over the 9-month period of the Growing healthy program. The use of the EI in this study demonstrates that rich and useful data can be collected and used to inform assessments of the strengths and weaknesses of the app and in turn inform future interventions.