Dataset Information

Evaluating an mHealth App for Health and Well-Being at Work: Mixed-Method Qualitative Study.

ABSTRACT:

Background

To improve workers' health and well-being, workplace interventions have been developed, but utilization and reach are unsatisfactory, and effects are small. In recent years, new approaches such as mobile health (mHealth) apps are being developed, but the evidence base is poor. Research is needed to examine its potential and to assess when, where, and for whom mHealth is efficacious in the occupational setting. To develop interventions for workers that actually will be adopted, insight into user satisfaction and technology acceptance is necessary. For this purpose, various qualitative evaluation methods are available.

Objective

The objectives of this study were to gain insight into (1) the opinions and experiences of employees and experts on drivers and barriers using an mHealth app in the working context and (2) the added value of three different qualitative methods that are available to evaluate mHealth apps in a working context: interviews with employees, focus groups with employees, and a focus group with experts.

Methods

Employees of a high-tech company and experts were asked to use an mHealth app for at least 3 weeks before participating in a qualitative evaluation. Twenty-two employees participated in interviews, 15 employees participated in three focus groups, and 6 experts participated in one focus group. Two researchers independently coded, categorized, and analyzed all quotes yielded from these evaluation methods with a codebook using constructs from user satisfaction and technology acceptance theories.

Results

Interviewing employees yielded 785 quotes, focus groups with employees yielded 266 quotes, and the focus group with experts yielded 132 quotes. Overall, participants muted enthusiasm about the app. Combined results from the three evaluation methods showed drivers and barriers for technology, user characteristics, context, privacy, and autonomy. A comparison between the three qualitative methods showed that issues revealed by experts only slightly overlapped with those expressed by employees. In addition, it was seen that the type of evaluation yielded different results.

Conclusions

Findings from this study provide the following recommendations for organizations that are planning to provide mHealth apps to their workers and for developers of mHealth apps: (1) system performance influences adoption and adherence, (2) relevancy and benefits of the mHealth app should be clear to the user and should address users' characteristics, (3) app should take into account the work context, and (4) employees should be alerted to their right to privacy and use of personal data. Furthermore, a qualitative evaluation of mHealth apps in a work setting might benefit from combining more than one method. Factors to consider when selecting a qualitative research method are the design, development stage, and implementation of the app; the working context in which it is being used; employees' mental models; practicability; resources; and skills required of experts and users.

SUBMITTER: de Korte EM

PROVIDER: S-EPMC5895922 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Workplace programs designed to improve the health and psychological well-being of employees are becoming increasingly popular. However, there are mixed reports regarding the effectiveness of such programs and little analysis of what helps people to engage with such programs. OBJECTIVE:This evaluation of a particularly broad, team-based, digital health and well-being program uses mixed methods to identify the elements of the program that reduce work stress and promote psychological well-being, sleep quality, and productivity of employees. METHODS:Participation in the Virgin Pulse Global Challenge program during May to September 2016 was studied. Self-reported stress, sleep quality, productivity, and psychological well-being data were collected both pre- and postprogram. Participant experience data were collected through a third final survey. However, the response rates for the last 2 surveys were only 48% and 10%, respectively. A random forest was used to estimate the probability of the completion of the last 2 surveys based on the preprogram assessment data and the demographic data for the entire sample (N=178,350). The inverse of these estimated probabilities were used as weights in hierarchical linear models in an attempt to address any estimation bias caused by the low response rates. These linear models described changes in psychological well-being, stress, sleep, and productivity over the duration of the program in relation to gender and age, engagement with each of the modules, each of the program features, and participant descriptions of the Virgin Pulse Global Challenge. A 0.1% significance level was used due to the large sample size for the final survey (N=18,653). RESULTS:The final analysis suggested that the program is more beneficial for older people, with 2.9% greater psychological well-being improvements observed on average in the case of women than men (P<.001). With one exception, all the program modules contributed significantly to the outcome measures with the following average improvements observed: psychological well-being, 4.1%-6.0%; quality of sleep, 3.2%-6.9%; work-related stress, 1.7%-6.8%; and productivity, 1.9%-4.2%. However, only 4 of the program features were found to have significant associations with the outcome measures with the following average improvements observed: psychological well-being, 3.7%-5.6%; quality of sleep, 3.4%-6.5%; work-related stress, 4.1%-6.4%; and productivity, 1.6%-3.2%. Finally, descriptions of the Virgin Pulse Global Challenge produced 5 text topics that were related to the outcome measures. Healthy lifestyle descriptions showed a positive association with outcomes, whereas physical activity and step count tracking descriptions showed a negative association with outcomes. CONCLUSIONS:The complementary use of qualitative and quantitative survey data in a mixed-methods analysis provided rich information that will inform the development of this and other programs designed to improve employee health. However, the low response rates and the lack of a control group are limitations, despite the attempts to address these problems in the analysis.

Project description:Adolescents are slowly being recognized as a generation, worldwide, that may require different policy approaches to improve staggering statistics on their failing well-being, including mental health. By providing the support to allow the next generation to achieve better mental health outcomes, they are going to be more economically successful and the future economic growth of nations can be better assured. Adoption of mobile-based health interventions (e.g., mHealth) has garnered a lot of attention toward this end. While mHealth interventions are growing in popularity, many researchers/policy-makers appear to have neglected assessing potential (indirect) costs/negative consequences from their use. Evidence from the developed world shows strong associations between extensive cell phone use and negative mental health outcomes, but similar research is minimal in developing world contexts. Additionally, the bulk of work on the outcomes of mobile phone use is studied using a unidirectional approach with blinders to front-end motivations. Using primary data from a large-scale, school-based survey of older adolescents in southwestern Nepal (N = 539), this work investigates such a tension between mobile/smartphone usage as a true mobile health (mHealth) opportunity in Nepal or as a potential problem, introducing additional deleterious well-being effects from over-use. Founded in Basic Psychological Needs Theory (BPNT), robust results of analyses using full structural modeling approaches (and traditional regression-based sensitivity analyses) indicate support for the BPNT framework in explaining statistically significant positive associations between bullying and anxiety, as well as, negative associations between bullying and grit, including evidence to support the mediating role of problematic mobile phone use in these relationships. More than 56% of the sample showed indicators of mild to moderate anxiety and over 10% claim experiences of bullying, coupled with over 75% of the sample scoring above the midline of a problematic mobile phone use scale, all of which motivates the relevance of our findings. Potential policy implications of these findings, and mention of other intriguing avenues for future work are further discussed.

Project description:BackgroundThere is growing evidence suggesting that the emotional well-being of the public has been negatively affected in the past year. Consequently, demand for well-being support has increased. Although there is substantial empirical support for mental health apps that target diagnosed conditions, there is less research on emotional well-being apps. Among existing well-being apps, few studies have been conducted on apps that are based on lived experience and those that seek to enhance users' understanding of their emotional patterns. Thus, the acceptability of these novel apps requires further evaluation before upscaling.ObjectiveThis evaluation aims to describe the acceptability, engagement, and preliminary outcomes of using an app (Paradym) designed to promote emotional well-being and positive mental health.MethodsThis is a pre-post, mixed-methods, single-arm evaluation that is aggregated with digital analytics data. We anonymously collected real-world data on the demographics and well-being of the participants as well as the usability and acceptance of the app using validated questionnaires and open-ended questions. Participants tested the app for a minimum of 2 weeks before completing the follow-up measures. Google Analytics was used to record the level of app engagement. Chi-square and 2-tailed t tests were conducted to analyze quantitative data, and a thematic analysis approach was adopted for qualitative data.ResultsA total of 115 participants completed baseline questionnaires, of which 79.1% (91/115) users downloaded the app. The sample was diverse in terms of ethnicity, including 43.4% (50/115) people who self-identified as belonging to minority ethnic groups. Most of the participants were female (78/115, 67.8%) and between the ages of 18 and 25 years (39/115, 33.9%). A total of 34 app users who completed questionnaires at baseline and follow-up provided valuable feedback to inform the future directions of Paradym. Favorable themes emerged describing the app's content, functionality, and underlying principles. Although usability feedback varied across items, a considerable number of participants (22/34, 64%) found that the app was easy to use. Google Analytics revealed that at least 79% (27/34) of people used the app daily. On the basis of preliminary observations, app users experience increased mental well-being. Post hoc analyses indicated that the reduction in depression scores (t33=-2.16) and the increase in the well-being measures (t33=2.87) were statistically significant. No adverse events were reported during the follow-up period.ConclusionsThe findings of this evaluation are encouraging and document positive preliminary evidence for the Paradym app.

Project description:Limited communication and care coordination following discharge from hospitals may contribute to surgical complications. Smartphone apps offer a novel mechanism for communication and care coordination. However, factors which may affect patient app use in a postoperative, at-home setting are poorly understood.The objectives of this study were to (1) gauge interest in smartphone app use among patients after colorectal surgery and (2) better understand factors affecting patient app use in a postoperative, at-home setting.A prospective feasibility study was performed at a hospital that principally serves low socioeconomic status patients. After colorectal surgery, patients were enrolled and given a smartphone app, which uses previously validated content to provide symptom-based recommendations. Patients were instructed to use the app daily for 14 days after discharge. Demographics and usability data were collected at enrollment. Usability was measured with the System Usability Scale (SUS). At follow-up, the SUS was repeated and patients underwent a structured interview covering ease of use, willingness to use, and utility of use. Two members of the research team independently reviewed the field notes from follow-up interviews and extracted the most consistent themes. Chart and app log reviews identified clinical endpoints.We screened 115 patients, enrolled 20 patients (17.4%), and completed follow-up interviews with 17 patients (85%). Reasons for nonenrollment included: failure to meet inclusion criteria (47/115, 40.9%), declined to participate (26/115, 22.6%), and other reasons (22/115, 19.1%). There was no difference in patient ratings between usability at first-use and after extended use, with SUS scores greater than the 95th percentile at both time points. Despite high usability ratings, 6/20 (30%) of patients never used the app at home after hospital discharge and 2/20 (10%) only used the app once. Interviews revealed three themes related to app use: (1) patient-related barriers could prevent use even though the app had high usability scores; (2) patients viewed the app as a second opinion, rather than a primary source of information; and (3) many patients viewed the app as an external burden.Use patterns in this study, and response rates after prompts to contact the operative team, suggest that apps need to be highly engaging to be adopted by patients. The growing penetration of smartphones and the proliferation of app-based interventions are unlikely to improve care coordination and communication, unless apps address the barriers and patient perceptions identified in this study. This study shows that high usability alone is not sufficient to motivate patients to use smartphone apps in the postoperative period.