Dataset Information

Design Features for Improving Mobile Health Intervention User Engagement: Systematic Review and Thematic Analysis.

ABSTRACT:

Background

Well-designed mobile health (mHealth) interventions support a positive user experience; however, a high rate of disengagement has been reported as a common concern regarding mHealth interventions. To address this issue, it is necessary to summarize the design features that improve user engagement based on research over the past 10 years, during which time the popularity of mHealth interventions has rapidly increased due to the use of smartphones.

Objective

The aim of this review was to answer the question "Which design features improve user engagement with mHealth interventions?" by summarizing published literature with the purpose of guiding the design of future mHealth interventions.

Methods

This review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. Databases, namely, PubMed, Web of Science, Cochrane Library, Ovid EMBASE, and Ovid PsycINFO, were searched for English and Chinese language papers published from January 2009 to June 2019. Thematic analysis was undertaken to assess the design features in eligible studies. The Mixed Methods Appraisal Tool was used to assess study quality.

Results

A total of 35 articles were included. The investigated mHealth interventions were mainly used in unhealthy lifestyle (n=17) and chronic disease (n=10) prevention programs. Mobile phone apps (n=24) were the most common delivery method. Qualitative (n=22) and mixed methods (n=9) designs were widely represented. We identified the following 7 themes that influenced user engagement: personalization (n=29), reinforcement (n=23), communication (n=20), navigation (n=17), credibility (n=16), message presentation (n=16), and interface aesthetics (n=7). A checklist was developed that contained these 7 design features and 29 corresponding specific implementations derived from the studies.

Conclusions

This systematic review and thematic synthesis identified useful design features that make an mHealth intervention more user friendly. We generated a checklist with evidence-based items to enable developers to use our findings easily. Future evaluations should use more robust quantitative approaches to elucidate the relationships between design features and user engagement.

SUBMITTER: Wei Y

PROVIDER: S-EPMC7758171 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Design Features for Improving Mobile Health Intervention User Engagement: Systematic Review and Thematic Analysis.

Wei Yanxia Y Zheng Pinpin P Deng Hui H Wang Xihui X Li Xiaomei X Fu Hua H

Journal of medical Internet research 20201209 12

<h4>Background</h4>Well-designed mobile health (mHealth) interventions support a positive user experience; however, a high rate of disengagement has been reported as a common concern regarding mHealth interventions. To address this issue, it is necessary to summarize the design features that improve user engagement based on research over the past 10 years, during which time the popularity of mHealth interventions has rapidly increased due to the use of smartphones.<h4>Objective</h4>The aim of th ...[more]

PMID: 33295292

Similar Datasets

Project description:BackgroundEcological momentary assessment (EMA) can be a useful tool for collecting real-time behavioral data in studies of health and health behavior. However, EMA administered through mobile technology can be burdensome, and it tends to suffer from suboptimal user engagement, particularly in low health-literacy populations.ObjectiveThis study aimed to report a case study involving the design and evaluation of a mobile EMA tool that supports context-sensitive EMA-reporting of location and social situations accompanying eating and sedentary behavior.MethodsAn iterative, user-centered design process with obese, middle-aged women seeking care in a safety-net health system was used to identify the preferred format of self-report measures and the look, feel, and interaction of the mobile EMA tool. A single-arm feasibility field trial with 21 participants receiving 12 prompts each day for momentary self-reports over a 4-week period (336 total prompts per participant) was used to determine user satisfaction with interface quality and user engagement, operationalized as response rate. A second trial among 38 different participants randomized to receive or not to receive a feature designed to improve engagement was conducted.ResultsThe feasibility trial results showed high interface satisfaction and engagement, with an average response rate of 50% over 4 weeks. Qualitative feedback pointed to the need for auditory alerts. We settled on 3 alerts at 10-min intervals to accompany each EMA-reporting prompt. The second trial testing this feature showed a statistically significant increase in the response rate between participants randomized to receive repeat auditory alerts versus those who were not (60% vs 40%).ConclusionsThis paper reviews the design research and a set of design constraints that may be considered in the creation of mobile EMA interfaces personalized to users' preferences. Novel aspects of the study include the involvement of low health-literacy adults in design research, the capture of data on time, place, and social context of eating and sedentary behavior, and reporting prompts tailored to an individual's location and schedule.Trial registrationClinicalTrials.gov NCT03083964; https://clinicaltrials.gov/ct2/show/NCT03083964.

Project description:BackgroundMobile apps are fundamental tools in today's society for practical and social endeavors. However, these technologies are often not usable for older users. Given the increased use of mobile apps by this group of users and the impact that certain services may have on their quality of life, such as mobile health, personal finance, or online administrative procedures, a clear set of guidelines for mobile app designers is needed. Existing recommendations for older adults focus on investigations with certain groups of older adults or have not been extracted from experimental results.ObjectiveIn this research work, we systematically reviewed the scientific literature that provided recommendations for the design of mobile apps based on usability testing with older adults and organized such recommendations into a meaningful set of design guidelines.MethodsWe conducted a systematic literature review of journal and conference articles from 2010 to 2021. We included articles that carried out usability tests with populations aged >60 years and presented transferable guidelines on mobile software design, resulting in a final set of 40 articles. We then carried out a thematic analysis with 3 rounds of analysis to provide meaning to an otherwise diverse set of recommendations. At this stage, we discarded recommendations that were made by just 1 article, were based on a specific mobile app and were therefore nontransferrable, were based on other authors' literature (as opposed to recommendations based on the results of usability tests), or were not sufficiently argued. With the remaining recommendations, we identified commonalities, wrote a faithful statement for each guideline, used a common language for the entire set, and organized the guidelines into categories, thereby giving shape to an otherwise diverse set of recommendations.ResultsAmong the 27 resulting guidelines, the rules Simplify and Increase the size and distance between interactive controls were transversal and of the greatest significance. The rest of the guidelines were divided into 5 categories (Help & Training, Navigation, Visual Design, Cognitive Load, and Interaction) and consequent subcategories in Visual Design (Layout, Icons, and Appearance) and Interaction (Input and Output). The recommendations were structured, explained in detail, and illustrated with applied examples extracted from the selected studies, where appropriate. We discussed the design implications of applying these guidelines, contextualized with relevant studies. We also discussed the limitations of the approach followed, stressing the need for further experimentation to gain a better understanding of how older adults use mobile apps and how to better design such apps with these users in mind.ConclusionsThe compiled guidelines support the design of mobile apps that cater to the needs of older adults because they are based on the results of actual usability tests with users aged >60 years.

Project description:BACKGROUND:There has recently been exponential growth in the development and use of health apps on mobile phones. As with most mobile apps, however, the majority of users abandon them quickly and after minimal use. One of the most critical factors for the success of a health app is how to support users' commitment to their health. Despite increased interest from researchers in mobile health, few studies have examined the measurement of user engagement with health apps. OBJECTIVE:User engagement is a multidimensional, complex phenomenon. The aim of this study was to understand the concept of user engagement and, in particular, to demonstrate the applicability of a user engagement scale (UES) to mobile health apps. METHODS:To determine the measurability of user engagement in a mobile health context, a UES was employed, which is a psychometric tool to measure user engagement with a digital system. This was adapted to Ada, developed by Ada Health, an artificial intelligence-powered personalized health guide that helps people understand their health. A principal component analysis (PCA) with varimax rotation was conducted on 30 items. In addition, sum scores as means of each subscale were calculated. RESULTS:Survey data from 73 Ada users were analyzed. PCA was determined to be suitable, as verified by the sampling adequacy of Kaiser-Meyer-Olkin=0.858, a significant Bartlett test of sphericity (?2300=1127.1; P<.001), and communalities mostly within the 0.7 range. Although 5 items had to be removed because of low factor loadings, the results of the remaining 25 items revealed 4 attributes: perceived usability, aesthetic appeal, reward, and focused attention. Ada users showed the highest engagement level with perceived usability, with a value of 294, followed by aesthetic appeal, reward, and focused attention. CONCLUSIONS:Although the UES was deployed in German and adapted to another digital domain, PCA yielded consistent subscales and a 4-factor structure. This indicates that user engagement with health apps can be assessed with the German version of the UES. These results can benefit related mobile health app engagement research and may be of importance to marketers and app developers.

Project description:BACKGROUND:Adolescents diagnosed with persistent asthma commonly take less than 50% of their prescribed inhaled corticosteroids (ICS), placing them at risk for asthma-related morbidity. Adolescents' difficulties with adherence occur in the context of normative developmental changes (eg, increased responsibility for disease management) and rely upon still developing self-regulation and problem-solving skills that are integral for asthma self-management. We developed an adaptive mobile health system, Responsive Asthma Care for Teens (ReACT), that facilitates self-regulation and problem-solving skills during times when adolescents' objectively measured ICS adherence data indicate suboptimal rates of medication use. OBJECTIVE:The current paper describes our user-centered and evidence-based design process in developing ReACT. We explain how we leveraged a combination of individual interviews, national crowdsourced feedback, and an advisory board comprised of target users to develop the intervention content. METHODS:We developed ReACT over a 15-month period using one-on-one interviews with target ReACT users (n=20), national crowdsourcing (n=257), and an advisory board (n=4) to refine content. Participants included 13-17-year-olds with asthma and their caregivers. A total of 280 adolescents and their caregivers participated in at least one stage of ReACT development. RESULTS:Consistent with self-regulation theory, adolescents identified a variety of salient intrapersonal (eg, forgetfulness, mood) and external (eg, changes in routine) barriers to ICS use during individual interviews. Adolescents viewed the majority of ReACT intervention content (514/555 messages, 93%) favorably during the crowdsourcing phase, and the advisory board helped to refine the content that did not receive favorable feedback during crowdsourcing. Additionally, the advisory board provided suggestions for improving additional components of ReACT (eg, videos, message flow). CONCLUSIONS:ReACT involved stakeholders via qualitative approaches and crowdsourcing throughout the creation and refinement of intervention content. The feedback we received from participants largely supported ReACT's emphasis on providing adaptive and personalized intervention content to facilitate self-regulation and problem-solving skills, and the research team successfully completed the recommended refinements to the intervention content during the iterative development process.

Project description:BackgroundPatient support apps have risen in popularity and provide novel opportunities for self-management of diabetes. Such apps offer patients to play an active role in monitoring their condition, thereby increasing their own treatment responsibility. Although many health apps require active user engagement to be effective, there is little evidence exploring engagement with mobile health (mHealth).ObjectiveThis study aims to analyze the extent to which users engage with mHealth for diabetes and identify patient characteristics that are associated with engagement.MethodsThe analysis is based on real-world data obtained by Novo Nordisk's Cornerstones4Care Powered by Glooko diabetes support app. User engagement was assessed as the number of active days and using measures expressing the persistence, longevity, and regularity of interaction within the first 180 days of use. Beta regressions were estimated to assess the associations between user characteristics and engagement outcomes for each module of the app.ResultsA total of 9051 individuals initiated use after registration and could be observed for 180 days. Among these, 55.39% (5013/9051) used the app for one specific purpose. The average user activity ratio varied from 0.05 (medication and food) to 0.55 (continuous glucose monitoring), depending on the module of the app. Average user engagement was lower if modules required manual data entries, although the initial uptake was higher for these modules. Regression analyses further revealed that although more women used the app (2075/3649, 56.86%), they engaged significantly less with it. Older people and users who were recently diagnosed tended to use the app more actively.ConclusionsStrategies to increase or sustain the use of apps and availability of health data may target the mode of data collection and content design and should take into account privacy concerns of the users at the same time. Users' engagement was determined by various user characteristics, indicating that particular patient groups should be targeted or assisted when integrating apps into the self-management of their disease.

Project description:The obesity epidemic has spread to young adults, and obesity is a significant risk factor for cardiovascular disease. The prominence and increasing functionality of mobile phones may provide an opportunity to deliver longitudinal and scalable weight management interventions in young adults. The aim of this article is to describe the design and development of the intervention tested in the Cell Phone Intervention for You study and to highlight the importance of adaptive intervention design that made it possible. The Cell Phone Intervention for You study was a National Heart, Lung, and Blood Institute-sponsored, controlled, 24-month randomized clinical trial comparing two active interventions to a usual-care control group. Participants were 365 overweight or obese (body mass index?25?kg/m2) young adults.Both active interventions were designed based on social cognitive theory and incorporated techniques for behavioral self-management and motivational enhancement. Initial intervention development occurred during a 1-year formative phase utilizing focus groups and iterative, participatory design. During the intervention testing, adaptive intervention design, where an intervention is updated or extended throughout a trial while assuring the delivery of exactly the same intervention to each cohort, was employed. The adaptive intervention design strategy distributed technical work and allowed introduction of novel components in phases intended to help promote and sustain participant engagement. Adaptive intervention design was made possible by exploiting the mobile phone's remote data capabilities so that adoption of particular application components could be continuously monitored and components subsequently added or updated remotely.The cell phone intervention was delivered almost entirely via cell phone and was always-present, proactive, and interactive-providing passive and active reminders, frequent opportunities for knowledge dissemination, and multiple tools for self-tracking and receiving tailored feedback. The intervention changed over 2 years to promote and sustain engagement. The personal coaching intervention, alternatively, was primarily personal coaching with trained coaches based on a proven intervention, enhanced with a mobile application, but where all interactions with the technology were participant-initiated.The complexity and length of the technology-based randomized clinical trial created challenges in engagement and technology adaptation, which were generally discovered using novel remote monitoring technology and addressed using the adaptive intervention design. Investigators should plan to develop tools and procedures that explicitly support continuous remote monitoring of interventions to support adaptive intervention design in long-term, technology-based studies, as well as developing the interventions themselves.

Project description:BackgroundNumerous mobile health (mHealth) apps have been developed to support smokers attempting to quit smoking. Although these apps have been reported to be successful, only modest improvements in the quit rate have been measured. It has been proposed that efforts to improve user engagement and retention may improve the quit rate further. Owing to the high cost of smoking-related disease, it is considered worthwhile to pursue even small improvements.ObjectiveThe aim of this study was to test a novel smartphone app that leverages premium currency strategies developed by the mobile games industry in an attempt to improve engagement and retention with a smoking cessation intervention.MethodsWe designed and developed a smoking cessation app called "Quittr" in line with previously developed smoking cessation mHealth apps. In addition to this established framework, we added a stand-alone fully featured city-building clicker-style game called "Tappy Town," and a premium virtual currency called "QuitCoins." The user earns QuitCoins for using the app in a way that contributes positively toward their quit attempt, and they can redeem these coins in Tappy Town for bonuses. To establish whether these features improved engagement and retention, we ran a 5-month randomized controlled trial where the intervention group had the full app with the extra games features, while the control group had the standard app only. Recruitment was performed via web-based advertising. Participants (N=175) had no direct contact with the researchers or other support staff.ResultsNo significant differences in terms of engagement, retention, or smoking outcomes were found between the control and intervention groups. However, survey data indicated that the majority of the participants valued Tappy Town (10/17, 59%) and the QuitCoins rewards system (13/17, 77%). Usage data also suggested that Tappy Town was widely played and was generally appealing to users (mean total time spent in app, control group: 797 seconds vs intervention group: 3502 seconds, P<.001). Analysis of the results suggests that users in the intervention group may have been negatively affected by the aspects of the chosen design, and some theories were explored to explain this unexpected outcome.ConclusionsAlthough the novel features of the Quittr app failed to improve the key outcomes measured in this study, there were enough positive indications to warrant further exploration of the concept. Additional research will be required to identify and correct any design flaws that may have adversely affected our participants before a follow-up study can be completed.Trial registrationAustralian and New Zealand Clinical Trials Register ACTRN12617000491369; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372661&isReview=true.

Dataset Information

Design Features for Improving Mobile Health Intervention User Engagement: Systematic Review and Thematic Analysis.

Background

Objective

Methods

Results

Conclusions

Publications

Design Features for Improving Mobile Health Intervention User Engagement: Systematic Review and Thematic Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets