Dataset Information

Acceptability, Engagement, and Exploratory Outcomes of an Emotional Well-being App: Mixed Methods Preliminary Evaluation and Descriptive Analysis.

ABSTRACT:

Background

There is growing evidence suggesting that the emotional well-being of the public has been negatively affected in the past year. Consequently, demand for well-being support has increased. Although there is substantial empirical support for mental health apps that target diagnosed conditions, there is less research on emotional well-being apps. Among existing well-being apps, few studies have been conducted on apps that are based on lived experience and those that seek to enhance users' understanding of their emotional patterns. Thus, the acceptability of these novel apps requires further evaluation before upscaling.

Objective

This evaluation aims to describe the acceptability, engagement, and preliminary outcomes of using an app (Paradym) designed to promote emotional well-being and positive mental health.

Methods

This is a pre-post, mixed-methods, single-arm evaluation that is aggregated with digital analytics data. We anonymously collected real-world data on the demographics and well-being of the participants as well as the usability and acceptance of the app using validated questionnaires and open-ended questions. Participants tested the app for a minimum of 2 weeks before completing the follow-up measures. Google Analytics was used to record the level of app engagement. Chi-square and 2-tailed t tests were conducted to analyze quantitative data, and a thematic analysis approach was adopted for qualitative data.

Results

A total of 115 participants completed baseline questionnaires, of which 79.1% (91/115) users downloaded the app. The sample was diverse in terms of ethnicity, including 43.4% (50/115) people who self-identified as belonging to minority ethnic groups. Most of the participants were female (78/115, 67.8%) and between the ages of 18 and 25 years (39/115, 33.9%). A total of 34 app users who completed questionnaires at baseline and follow-up provided valuable feedback to inform the future directions of Paradym. Favorable themes emerged describing the app's content, functionality, and underlying principles. Although usability feedback varied across items, a considerable number of participants (22/34, 64%) found that the app was easy to use. Google Analytics revealed that at least 79% (27/34) of people used the app daily. On the basis of preliminary observations, app users experience increased mental well-being. Post hoc analyses indicated that the reduction in depression scores (t₃₃=-2.16) and the increase in the well-being measures (t₃₃=2.87) were statistically significant. No adverse events were reported during the follow-up period.

Conclusions

The findings of this evaluation are encouraging and document positive preliminary evidence for the Paradym app.

SUBMITTER: Eisenstadt A

PROVIDER: S-EPMC8593799 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe COVID-19 pandemic is likely to increase anxiety and distress in young people worldwide. It is important to prioritize mental health during crisis events to mitigate the negative and often long-term effects of the crises on young people, families, and society. Mental health and well-being apps represent a scalable approach for improving psychological outcomes in young people and have potential to improve the equity of service access.ObjectiveThe Whitu: 7 Ways in 7 Days well-being app was recently developed by our group to address the urgent need for innovative approaches to reach young New Zealanders who are struggling to cope with the COVID-19 pandemic. The aim of this study is twofold: to evaluate the acceptability of the prototype app and to examine the effectiveness of the refined app at improving mental and emotional well-being and reducing depression, anxiety, and stress in young people in New Zealand.MethodsA two-phase mixed methods study will be undertaken to achieve these aims. During the first phase, 20 young people aged 16-30 years (including those of Māori and Pacific ethnicity) will participate in a qualitative study to help refine the prototype app. During the second phase, 90 young people aged 16-30 years will participate in a randomized waitlist-controlled trial (RCT) to evaluate the efficacy of the refined Whitu app at 4 weeks and 3 months after baseline. Outcomes will be evaluated using validated web-based questionnaires at baseline, 4 weeks, and 3 months.ResultsThe study received ethics approval in May 2020, and recruitment for the focus groups commenced in June 2020. Recruitment for the RCT is expected to commence in October 2020. Participants for both study phases will be recruited via social media and web-based communities. Data collection for the RCT is expected to be completed by January 2021, and analyses are expected to be completed by March 2021. Linear mixed modelling will be used to determine between-group differences in psychological outcomes.ConclusionsThere is an urgent need to develop culturally appropriate, scalable mental health interventions to address the psychological consequences of the COVID-19 pandemic. In this study, we will develop and test an evidence-based well-being app that, if effective, can be made available to all young people in New Zealand and internationally.Trial registrationAustralian New Zealand Clinical Trials Registry (ACTRN12620000516987); https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=379597.International registered report identifier (irrid)PRR1-10.2196/23716.

Project description:BackgroundTo improve workers' health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available.ObjectiveThe objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts.MethodsEmployees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories.ResultsInterviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results.ConclusionsFindings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users' characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees' mental models; practicability; resources; and skills required of experts and users.

Project description:BackgroundShift is a novel smartphone app for providing a digital-first mental health resource to junior doctors. It contains psychoeducational material, cognitive behavioral modules, guided mediations, information on common work stressors, and a section on help-seeking options for psychological problems through workplace and private avenues.ObjectiveThis study aimed to conduct a preliminary investigation of the use and potential effectiveness of Shift on depressive and anxiety symptoms (primary outcomes) and work and social functioning, COVID-19 safety concerns, and help seeking (secondary outcomes). This study also sought feedback on whether Shift was seen as an acceptable tool.MethodsJunior doctors in New South Wales, Australia, were approached through promotional activities from the Ministry of Health, specialist medical colleges, and social media advertisements between June and August 2020. Consenting participants provided web-based baseline data, used the Shift app for 30 days, and were asked to complete a poststudy web-based questionnaire. Outcomes were analyzed under the intention-to-treat principle.ResultsA total of 222 female (n=156, 70.3%; mean age 29.2, SD 4.61 years) junior doctors provided full baseline data. Of these, 89.2% (198/222) downloaded the app, logged into the app approximately 6 times (mean 5.68, SD 7.51), completed 4 in-app activities (mean 3.77, SD 4.36), and spent a total of 1 hour on in-app activities (mean 52:23, SD 6:00:18) over 30 days. Postintervention and app use data were provided by 24.3% (54/222) of participants. Depressive and anxiety symptoms significantly decreased between the pre- and postassessment points as expected; however, physicians' COVID-19 safety concerns significantly increased. Work and social functioning, COVID-19 concerns for family and friends, and help seeking did not change significantly. There was no significant relationship between symptom changes and app use (number of log-ins, days between first and last log-in, and total activity time). Most poststudy completers (31/54, 57%) rated Shift highly or very highly.ConclusionsDespite high levels of nonresponse to the poststudy assessment and increases in COVID-19 safety concerns, junior doctors who used the app reported some improvements in depression and anxiety, which warrant further exploration in a robust manner.