Dataset Information

Developing Typologies of User Engagement With the BRANCH Alcohol-Harm Reduction Smartphone App: Qualitative Study.

ABSTRACT:

Background

Understanding how users engage with electronic screening and brief intervention (eSBI) is a critical research objective to improve effectiveness of app-based interventions to reduce harmful alcohol consumption. Although quantitative measures of engagement provide a strong indicator of how the user engages with an app at the group level, they do not elucidate finer-grained details of how apps function from an individual, experiential perspective and why, or how, users engage with an intervention in a particular manner.

Objective

The aim of this study was to (1) understand why and how participants engaged with the BRANCH app, (2) explore facilitators and barriers to engagement with app features, (3) explore how the BRANCH app impacted drinking behavior, (4) use these data to identify typologies of users of the BRANCH app in terms of engagement behaviors, and (5) identify future eSBI app design implications.

Methods

In total, 20 one-to-one semistructured telephone interviews were conducted with participants recruited from a randomized controlled trial, which evaluated the effectiveness of engagement-promoting strategies in the BRANCH app targeting harmful drinking in young adults (aged 18-30 years). The topic guide explored users' current engagement levels with existing health promotion apps, their views toward the effectiveness of such apps, and what they liked and disliked about BRANCH, specifically focusing on how they engaged with the app. Framework analysis was used to develop typologies of user engagement.

Results

The study identified 3 typologies of engagers. Trackers were defined by their motivations to use health-tracking apps to monitor and understand quantified self-data. They did not have intentions necessarily to cut down and predominantly used only the drinking diary. Cut-downers were motivated to use the app because they wanted to reduce their alcohol consumption Unlike Trackers, they did not use a range of different health apps daily, but saw the BRANCH app as an opportunity to test out a different method of trying to cut down their alcohol use. This typology used more features than Trackers, such as the goal setting function. Noncommitters were characterized as a group of users who were initially enthusiastic about using the app; however, this enthusiasm quickly waned and they gained no benefit from it.

Conclusions

This was the first study to identify typologies of user engagement with eSBI apps. Although in need of replication, it provides a first step in understanding independent categories of eSBI users, who may benefit from apps tailored to a user's typology or motivation. It also provides new evidence to suggest that apps may be used more effectively as a tool to raise awareness of drinking, instead of reducing alcohol use, and be a step in the care pathway, identifying at-risk individuals and signposting them to more intensive treatment.

Trial registration

International Standard Randomised Controlled Trial Number ISRCTN70980706; http://www.isrctn.com /ISRCTN70980706 (Archived by WebCite at http://www.webcitation.org/73vfDXYEZ).

SUBMITTER: Milward J

PROVIDER: S-EPMC6315270 | biostudies-literature | 2018 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing Typologies of User Engagement With the BRANCH Alcohol-Harm Reduction Smartphone App: Qualitative Study.

Milward Joanna J Deluca Paolo P Drummond Colin C Kimergård Andreas A

JMIR mHealth and uHealth 20181213 12

<h4>Background</h4>Understanding how users engage with electronic screening and brief intervention (eSBI) is a critical research objective to improve effectiveness of app-based interventions to reduce harmful alcohol consumption. Although quantitative measures of engagement provide a strong indicator of how the user engages with an app at the group level, they do not elucidate finer-grained details of how apps function from an individual, experiential perspective and why, or how, users engage wi ...[more]

PMID: 30545806

Similar Datasets

Project description:BackgroundDrink Less is a behavior change app that aims to help users in the general adult population reduce hazardous and harmful alcohol consumption. The app includes a daily push notification, delivered at 11 am, asking users to "Please complete your mood and drinking diaries." Previous analysis of Drink Less engagement data suggests the current notification strongly influences how users engage with the app in the subsequent hour. To exploit a potential increase of vulnerability of excess drinking and opportunity to engage with the app in the evenings, we changed the delivery time from 11 am to 8 pm. We now aim to further optimise the content and sequence of notifications, testing 30 new evidence-informed notifications targeting the user's perceived usefulness of the app.ObjectiveThe primary objective is to assess whether sending a notification at 8 pm increases behavioral engagement (opening the app) in the subsequent hour. Secondary objectives include comparing the effect of the new bank of messages with the standard message and effect moderation over time. We also aim to more generally understand the role notifications have on the overall duration, depth, and frequency of engagement with Drink Less over the first 30 days after download.MethodsThis is a protocol for a micro-randomized trial with two additional parallel arms. Inclusion criteria are Drink Less users who (1) consent to participate in the trial; (2) self-report a baseline Alcohol Use Disorders Identification Test score of 8 or above; (3) reside in the United Kingdom; (4) age ≥18 years and; (5) report interest in drinking less alcohol. In the micro-randomized trial, participants will be randomized daily at 8 pm to receive no notification, a notification with text from the new message bank, or the standard message. The primary outcome is the time-varying, binary outcome of "Did the user open the app in the hour from 8 pm to 9 pm?". The primary analysis will estimate the marginal relative risk for the notifications using an estimator developed for micro-randomized trials with binary outcomes. Participants randomized to the parallel arms will receive no notifications (Secondary Arm A), or the standard notification delivered daily at 11 am (Secondary Arm B) over 30 days, allowing the comparison of overall engagement between different notification delivery strategies.ResultsApproval was granted by the University College of London's Departmental Research Ethics Committee (CEHP/2016/556) on October 11, 2019, and The London School of Hygiene and Tropical Medicine Interventions Research Ethics Committee (17929) on November 27, 2019. Recruitment began on January 2, 2020, and is ongoing.ConclusionsUnderstanding how push notifications may impact engagement with a behavior change app can lead to further improvements in engagement, and ultimately help users reduce their alcohol consumption. This understanding may also be generalizable to other apps that target a variety of behavior changes.International registered report identifier (irrid)DERR1-10.2196/18690.

Project description:BackgroundBehavior change apps can develop iteratively, where the app evolves into a complex, dynamic, or personalized intervention through cycles of research, development, and implementation. Understanding how existing users engage with an app (eg, frequency, amount, depth, and duration of use) can help guide further incremental improvements. We aim to explore how simple visualizations can provide a good understanding of temporal patterns of engagement, as usage data are often longitudinal and rich.ObjectiveThis study aims to visualize behavioral engagement with Drink Less, a behavior change app to help reduce hazardous and harmful alcohol consumption in the general adult population of the United Kingdom.MethodsWe explored behavioral engagement among 19,233 existing users of Drink Less. Users were included in the sample if they were from the United Kingdom; were 18 years or older; were interested in reducing their alcohol consumption; had a baseline Alcohol Use Disorders Identification Test score of 8 or above, indicative of excessive drinking; and had downloaded the app between May 17, 2017, and January 22, 2019 (615 days). Measures of when sessions begin, length of sessions, time to disengagement, and patterns of use were visualized with heat maps, timeline plots, k-modes clustering analyses, and Kaplan-Meier plots.ResultsThe daily 11 AM notification is strongly associated with a change in engagement in the following hour; reduction in behavioral engagement over time, with 50.00% (9617/19,233) of users disengaging (defined as no use for 7 or more consecutive days) 22 days after download; identification of 3 distinct trajectories of use, namely engagers (4651/19,233, 24.18% of users), slow disengagers (3679/19,233, 19.13% of users), and fast disengagers (10,903/19,233, 56.68% of users); and limited depth of engagement with 85.076% (7,095,348/8,340,005) of screen views occurring within the Self-monitoring and Feedback module. In addition, a peak of both frequency and amount of time spent per session was observed in the evenings.ConclusionsVisualizations play an important role in understanding engagement with behavior change apps. Here, we discuss how simple visualizations helped identify important patterns of engagement with Drink Less. Our visualizations of behavioral engagement suggest that the daily notification substantially impacts engagement. Furthermore, the visualizations suggest that a fixed notification policy can be effective for maintaining engagement for some users but ineffective for others. We conclude that optimizing the notification policy to target both effectiveness and engagement is a worthwhile investment. Our future goal is to both understand the causal effect of the notification on engagement and further optimize the notification policy within Drink Less by tailoring to contextual circumstances of individuals over time. Such tailoring will be informed from the findings of our micro-randomized trial (MRT), and these visualizations were useful in both gaining a better understanding of engagement and designing the MRT.

Project description:BackgroundText messaging interventions can be an effective and efficient way to improve health behavioral changes. However, most texting interventions are neither tested nor designed with diverse end users, which could reduce their impact, and there is limited evidence regarding the optimal design methodology of health text messages tailored to low-income, low-health literacy populations and non-English speakers.ObjectiveThis study aims to combine participant feedback, crowdsourced data, and researcher expertise to develop motivational text messages in English and Spanish that will be used in a smartphone app-based texting intervention that seeks to encourage physical activity in low-income minority patients with diabetes diagnoses and depression symptoms.MethodsThe design process consisted of 5 phases and was iterative in nature, given that the findings from each step informed the subsequent steps. First, we designed messages to increase physical activity based on the behavior change theory and knowledge from the available evidence. Second, using user-centered design methods, we refined these messages after a card sorting task and semistructured interviews (N=10) and evaluated their likeability during a usability testing phase of the app prototype (N=8). Third, the messages were tested by English- and Spanish-speaking participants on the Amazon Mechanical Turk (MTurk) crowdsourcing platform (N=134). Participants on MTurk were asked to categorize the messages into overarching theoretical categories based on the capability, opportunity, motivation, and behavior framework. Finally, each coauthor rated the messages for their overall quality from 1 to 5. All messages were written at a sixth-grade or lower reading level and culturally adapted and translated into neutral Spanish by bilingual research staff.ResultsA total of 200 messages were iteratively refined according to the feedback from target users gathered through user-centered design methods, crowdsourced results of a categorization test, and an expert review. User feedback was leveraged to discard unappealing messages and edit the thematic aspects of messages that did not resonate well with the target users. Overall, 54 messages were sorted into the correct theoretical categories at least 50% of the time in the MTurk categorization tasks and were rated 3.5 or higher by the research team members. These were included in the final text message bank, resulting in 18 messages per motivational category.ConclusionsBy using an iterative process of expert opinion, feedback from participants that were reflective of our target study population, crowdsourcing, and feedback from the research team, we were able to acquire valuable inputs for the design of motivational text messages developed in English and Spanish with a low literacy level to increase physical activity. We describe the design considerations and lessons learned for the text messaging development process and provide a novel, integrative framework for future developers of health text messaging interventions.

Project description:BackgroundPrevious studies have identified psychological and smartphone app-related predictors of engagement with alcohol reduction apps at a group level. However, strategies to promote engagement need to be effective at the individual level. Evidence as to whether group-level predictors of engagement are also predictive for individuals is lacking.ObjectiveThe aim of this study was to examine whether daily fluctuations in (1) the receipt of a reminder, (2) motivation to reduce alcohol, (3) perceived usefulness of the app, (4) alcohol consumption, and (5) perceived lack of time predicted within-person variability in the frequency and amount of engagement with an alcohol reduction app.MethodsWe conducted a series of observational N-of-1 studies. The predictor variables were measured twice daily for 28 days via ecological momentary assessments. The outcome variables were measured through automated recordings of the participants' app screen views. A total of nine London-based adults who drank alcohol excessively and were willing to set a reduction goal took part. Each participant's dataset was analyzed separately using generalized additive mixed models to derive incidence rate ratios (IRRs) for the within-person associations of the predictor and outcome variables. Debriefing interviews, analyzed using thematic analysis, were used to contextualize the findings.ResultsPredictors of the frequency and amount of engagement differed between individuals, and for the variables 'perceived usefulness of the app' and 'perceived lack of time', the direction of associations also differed between individuals. The most consistent predictors of within-person variability in the frequency of engagement were the receipt of a daily reminder (IRR=1.80-3.88; P<.05) and perceived usefulness of the app (IRR=0.82-1.42; P<.05). The most consistent predictors of within-person variability in the amount of engagement were motivation to reduce alcohol (IRR=1.67-3.45; P<.05) and perceived usefulness of the app (IRR=0.52-137.32; P<.05).ConclusionsThe utility of the selected psychological and app-related variables in predicting the frequency and amount of engagement with an alcohol reduction app differed at the individual level. This highlights that key within-person associations may be masked in group-level designs and suggests that different strategies to promote engagement may be required for different individuals.

Project description:BackgroundThe use of mobile health (mHealth) interventions, including smartphone apps, for the prevention of cardiovascular disease (CVD) has demonstrated mixed results for obesity, hypercholesterolemia, diabetes, and hypertension management. A major factor attributing to the variation in mHealth study results may be mHealth user engagement.ObjectiveThis systematic review aims to determine if user engagement with smartphone apps for the prevention and management of CVD is associated with improved CVD health behavior change and risk factor outcomes.MethodsWe conducted a comprehensive search of PubMed, CINAHL, and Embase databases from 2007 to 2020. Studies were eligible if they assessed whether user engagement with a smartphone app used by an individual to manage his or her CVD risk factors was associated with the CVD health behavior change or risk factor outcomes. For eligible studies, data were extracted on study and sample characteristics, intervention description, app user engagement measures, and the relationship between app user engagement and the CVD risk factor outcomes. App user engagement was operationalized as general usage (eg, number of log-ins or usage days per week) or self-monitoring within the app (eg, total number of entries made in the app). The quality of the studies was assessed.ResultsOf the 24 included studies, 17 used a randomized controlled trial design, 4 used a retrospective analysis, and 3 used a single-arm pre- and posttest design. Sample sizes ranged from 55 to 324,649 adults, with 19 studies recruiting participants from a community setting. Most of the studies assessed weight loss interventions, with 6 addressing additional CVD risk factors, including diabetes, sleep, stress, and alcohol consumption. Most of the studies that assessed the relationship between user engagement and reduction in weight (9/13, 69%), BMI (3/4, 75%), body fat percentage (1/2, 50%), waist circumference (2/3, 67%), and hemoglobin A1c (3/5, 60%) found statistically significant results, indicating that greater app user engagement was associated with better outcomes. Of 5 studies, 3 (60%) found a statistically significant relationship between higher user engagement and an increase in objectively measured physical activity. The studies assessing the relationship between user engagement and dietary and diabetes self-care behaviors, blood pressure, and lipid panel components did not find statistically significant results.ConclusionsIncreased app user engagement for prevention and management of CVD may be associated with improved weight and BMI; however, only a few studies assessed other outcomes, limiting the evidence beyond this. Additional studies are needed to assess user engagement with smartphone apps targeting other important CVD risk factors, including dietary behaviors, hypercholesterolemia, diabetes, and hypertension. Further research is needed to assess mHealth user engagement in both inpatient and outpatient settings to determine the effect of integrating mHealth interventions into the existing clinical workflow and on CVD outcomes.

Project description:BackgroundChildhood obesity is an ongoing problem in developed countries that needs targeted prevention in the youngest age groups. Children in socioeconomically disadvantaged families are most at risk. Mobile health (mHealth) interventions offer a potential route to target these families because of its relatively low cost and high reach. The Growing healthy program was developed to provide evidence-based information on infant feeding from birth to 9 months via app or website. Understanding user engagement with these media is vital to developing successful interventions. Engagement is a complex, multifactorial concept that needs to move beyond simple metrics.ObjectiveThe aim of our study was to describe the development of an engagement index (EI) to monitor participant interaction with the Growing healthy app. The index included a number of subindices and cut-points to categorize engagement.MethodsThe Growing program was a feasibility study in which 300 mother-infant dyads were provided with an app which included 3 push notifications that was sent each week. Growing healthy participants completed surveys at 3 time points: baseline (T1) (infant age ≤3 months), infant aged 6 months (T2), and infant aged 9 months (T3). In addition, app usage data were captured from the app. The EI was adapted from the Web Analytics Demystified visitor EI. Our EI included 5 subindices: (1) click depth, (2) loyalty, (3) interaction, (4) recency, and (5) feedback. The overall EI summarized the subindices from date of registration through to 39 weeks (9 months) from the infant's date of birth. Basic descriptive data analysis was performed on the metrics and components of the EI as well as the final EI score. Group comparisons used t tests, analysis of variance (ANOVA), Mann-Whitney, Kruskal-Wallis, and Spearman correlation tests as appropriate. Consideration of independent variables associated with the EI score were modeled using linear regression models.ResultsThe overall EI mean score was 30.0% (SD 11.5%) with a range of 1.8% - 57.6%. The cut-points used for high engagement were scores greater than 37.1% and for poor engagement were scores less than 21.1%. Significant explanatory variables of the EI score included: parity (P=.005), system type including "app only" users or "both" app and email users (P<.001), recruitment method (P=.02), and baby age at recruitment (P=.005).ConclusionsThe EI provided a comprehensive understanding of participant behavior with the app over the 9-month period of the Growing healthy program. The use of the EI in this study demonstrates that rich and useful data can be collected and used to inform assessments of the strengths and weaknesses of the app and in turn inform future interventions.

Dataset Information

Developing Typologies of User Engagement With the BRANCH Alcohol-Harm Reduction Smartphone App: Qualitative Study.

Background

Objective

Methods

Results

Conclusions

Trial registration

Publications

Developing Typologies of User Engagement With the BRANCH Alcohol-Harm Reduction Smartphone App: Qualitative Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets