Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies.
Ontology highlight
ABSTRACT:
SUBMITTER: Short CE
PROVIDER: S-EPMC6269627 | biostudies-literature | 2018 Nov
REPOSITORIES: biostudies-literature
Publications
Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies.
Short Camille E CE DeSmet Ann A Woods Catherine C Williams Susan L SL Maher Carol C Middelweerd Anouk A Müller Andre Matthias AM Wark Petra A PA Vandelanotte Corneel C Poppe Louise L Hingle Melanie D MD Crutzen Rik R
Journal of medical Internet research 20181116 11
Engagement in electronic health (eHealth) and mobile health (mHealth) behavior change interventions is thought to be important for intervention effectiveness, though what constitutes engagement and how it enhances efficacy has been somewhat unclear in the literature. Recently published detailed definitions and conceptual models of engagement have helped to build consensus around a definition of engagement and improve our understanding of how engagement may influence effectiveness. This work has ...[more]
Similar Datasets
Project description:Trials of digital interventions can yield extensive, in-depth usage data, yet usage analyses tend to focus on broad descriptive summaries of how an intervention has been used by the whole sample. This paper proposes a novel framework to guide systematic, fine-grained usage analyses that better enables understanding of how an intervention works, when, and for whom. The framework comprises three stages to assist in the following: (1) familiarization with the intervention and its relationship to the captured data, (2) identification of meaningful measures of usage and specifying research questions to guide systematic analyses of usage data, and (3) preparation of datasheets and consideration of available analytical methods with which to examine the data. The framework can be applied to inform data capture during the development of a digital intervention and/or in the analysis of data after the completion of an evaluation trial. We will demonstrate how the framework shaped preparation and aided efficient data capture for a digital intervention to lower transmission of cold and flu viruses in the home, as well as how it informed a systematic, in-depth analysis of usage data collected from a separate digital intervention designed to promote self-management of colds and flu. The Analyzing and Measuring Usage and Engagement Data (AMUsED) framework guides systematic and efficient in-depth usage analyses that will support standardized reporting with transparent and replicable findings. These detailed findings may also enable examination of what constitutes effective engagement with particular interventions.
| S-EPMC6396072 | biostudies-literature
Project description:BackgroundCardiovascular disease (CVD) is the leading cause of premature death and disability in Europe, accounting for 4 million deaths per year and costing the European Union economy almost €196 billion annually. There is strong evidence to suggest that exercise-based secondary rehabilitation programs can decrease the mortality risk and improve health among patients with CVD. Theory-informed use of behavior change techniques (BCTs) is important in the design of cardiac rehabilitation programs aimed at changing cardiovascular risk factors. Electronic health (eHealth) is the use of information and communication technologies (ICTs) for health. This emerging area of health care has the ability to enhance self-management of chronic disease by making health care more accessible, affordable, and available to the public. However, evidence-based information on the use of BCTs in eHealth interventions is limited, and particularly so, for individuals living with CVD.ObjectiveThe aim of this systematic review was to assess the application of BCTs in eHealth interventions designed to increase physical activity (PA) in CVD populations.MethodsA total of 7 electronic databases, including EBSCOhost (MEDLINE, PsycINFO, Academic Search Complete, SPORTDiscus with Full Text, and CINAHL Complete), Scopus, and Web of Science (Core Collection) were searched. Two authors independently reviewed references using the software package Covidence (Veritas Health Innovation). The reviewers met to resolve any discrepancies, with a third independent reviewer acting as an arbitrator when required. Following this, data were extracted from the papers that met the inclusion criteria. Bias assessment of the studies was carried out using the Cochrane Collaboration's tool for assessing the risk of bias within Covidence; this was followed by a narrative synthesis.ResultsOut of the 987 studies that were identified, 14 were included in the review. An additional 9 studies were added following a hand search of review paper references. The average number of BCTs used across the 23 studies was 7.2 (range 1-19). The top three most frequently used BCTs included information about health consequences (78%, 18/23), goal setting (behavior; 74%, 17/23), and joint third, self-monitoring of behavior and social support (practical) were included in 11 studies (48%, 11/23) each.ConclusionsThis systematic review is the first to investigate the use of BCTs in PA eHealth interventions specifically designed for people with CVD. This research will have clear implications for health care policy and research by outlining the BCTs used in eHealth interventions for chronic illnesses, in particular CVD, thereby providing clear foundations for further research and developments in the area.
| S-EPMC5559649 | biostudies-literature
Project description:BackgroundContemporary mobile health (mHealth) interventions use various behavior change techniques to promote healthier lifestyles. Social comparison is one of the techniques that is consensually agreed to be effective in engaging the general population in mHealth interventions. However, it is unclear how this strategy can be best used to engage preadolescents. Nevertheless, this strategy has great potential for this target audience, as they are particularly developing their social skills.ObjectiveThis study aims to evaluate how social comparison drives preadolescents' engagement with an mHealth app.MethodsWe designed a 12-week crossover experiment in which we studied 3 approaches to implementing behavior change via social comparison. This study was hosted in a school environment to leverage naturally existing social structures among preadolescents. During the experiment, students and teachers used an mHealth tool that awarded points for performing healthy activities. Participants could read their aggregated scores on a leaderboard and compare their performance with others. In particular, these leaderboards were tweaked to implement 3 approaches of the social comparison technique. The first approach focused on intragroup comparison (ie, students and teachers competing against each other to obtain the most points), whereas the other two approaches focused on intergroup comparison (ie, classes of students and their mentoring teachers collaborating to compete against other classes). Additionally, in the third approach, the performance of teachers was highlighted to further increase students' engagement through teachers' natural exemplary function. To obtain our results, we used linear modeling techniques to analyze the dropout rates and engagement levels for the different approaches. In such analyses, we also considered individual participant traits.ResultsOur sample included 313 participants-290 students (92.7%) and 23 teachers (7.3%). It was found that student engagement levels dropped over time and declined during holidays. However, students seemed to monitor the intergroup competitions more closely than the intragroup competitions, as they, on average, checked the mHealth app more often when they were engaged in team-based comparisons. Students, on average, performed the most unique activities when they were engaged in the second intergroup setting, perhaps because their teachers were most active in this setting. Moreover, teachers seemed to play an important role in engaging their students, as their relationship with their students influenced the engagement of the students.ConclusionsWhen using social comparison to engage preadolescents with an mHealth tool, an intergroup setting, rather than an intragroup competition, motivated them to engage with the app but did not necessarily motivate them to perform more activities. It seems that the number of unique activities that preadolescents perform depends on the activeness of a role model. Moreover, this effect is amplified by preadolescents' perceptions of closeness to that role model.
| S-EPMC8367116 | biostudies-literature
Project description:BackgroundAn estimated 12.8% of children and adolescents experience chronic health conditions that lead to poor quality of life, adjustment and coping issues, and concurrent mental health problems. Digital health deployment of psychosocial interventions to support youth with chronic illness has become increasingly popular with the advent of the technological advances in the digital age.ObjectiveOur objectives were to systematically review published efficacy studies of eHealth and mHealth (mobile health) psychosocial interventions for youths with chronic illnesses and review intervention theory and treatment components.MethodsPubMed, Embase, Web of Science, PsycInfo, and Cochrane Database of Systematic Reviews were searched for studies published from 2008 to 2019 of eHealth and mHealth psychosocial interventions designed for children and adolescents with chronic illnesses in which efficacy outcomes were reported. We excluded studies of interventions for caregivers, healthy youth, disease and medication management, and telehealth interventions that function solely as a platform to connect patients to providers via phone, text, or videoconference.ResultsWe screened 2551 articles and 133 relevant full-text articles. Sixteen efficacy studies with psychosocial and health outcomes representing 12 unique interventions met the inclusion criteria. Of the included studies, 12 were randomized controlled trials and 4 were prospective cohort studies with no comparison group. Most interventions were based in cognitive behavioral theory and designed as eHealth interventions; only 2 were designed as mHealth interventions. All but 2 interventions provided access to support staff via text, phone, email, or discussion forums. The significant heterogeneity in intervention content, intervention structure, medical diagnoses, and outcomes precluded meta-analysis. For example, measurement time points ranged from immediately postcompletion of the mHealth program to 18 months later, and we identified 39 unique outcomes of interest. The majority of included studies (11/16, 69%) reported significant changes in measured health and/or psychosocial posttreatment outcomes, with small to large effect sizes.ConclusionsAlthough the available literature on the efficacy of eHealth and mHealth psychosocial interventions for youth with chronic illnesses is limited, preliminary research suggests some evidence of positive treatment responses. Future studies should continue to evaluate whether digital health platforms may be a viable alternative model of delivery to traditional face-to-face approaches.
| S-EPMC7685926 | biostudies-literature
Project description:BACKGROUND:Electronic health (eHealth) and mobile health (mHealth) approaches to address low physical activity levels, sedentary behavior, and unhealthy diets have received significant research attention. However, attempts to systematically map the entirety of the research field are lacking. This gap can be filled with a bibliometric study, where publication-specific data such as citations, journals, authors, and keywords are used to provide a systematic overview of a specific field. Such analyses will help researchers better position their work. OBJECTIVE:The objective of this review was to use bibliometric data to provide an overview of the eHealth and mHealth research field related to physical activity, sedentary behavior, and diet. METHODS:The Web of Science (WoS) Core Collection was searched to retrieve all existing and highly cited (as defined by WoS) physical activity, sedentary behavior, and diet related eHealth and mHealth research papers published in English between January 1, 2000 and December 31, 2016. Retrieved titles were screened for eligibility, using the abstract and full-text where needed. We described publication trends over time, which included journals, authors, and countries of eligible papers, as well as their keywords and subject categories. Citations of eligible papers were compared with those expected based on published data. Additionally, we described highly-cited papers of the field (ie, top ranked 1%). RESULTS:The search identified 4805 hits, of which 1712 (including 42 highly-cited papers) were included in the analyses. Publication output increased on an average of 26% per year since 2000, with 49.00% (839/1712) of papers being published between 2014 and 2016. Overall and throughout the years, eHealth and mHealth papers related to physical activity, sedentary behavior, and diet received more citations than expected compared with papers in the same WoS subject categories. The Journal of Medical Internet Research published most papers in the field (9.58%, 164/1712). Most papers originated from high-income countries (96.90%, 1659/1717), in particular the United States (48.83%, 836/1712). Most papers were trials and studied physical activity. Beginning in 2013, research on Generation 2 technologies (eg, smartphones, wearables) sharply increased, while research on Generation 1 (eg, text messages) technologies increased at a reduced pace. Reviews accounted for 20 of the 42 highly-cited papers (n=19 systematic reviews). Social media, smartphone apps, and wearable activity trackers used to encourage physical activity, less sedentary behavior, and/or healthy eating were the focus of 14 highly-cited papers. CONCLUSIONS:This study highlighted the rapid growth of the eHealth and mHealth physical activity, sedentary behavior, and diet research field, emphasized the sizeable contribution of research from high-income countries, and pointed to the increased research interest in Generation 2 technologies. It is expected that the field will grow and diversify further and that reviews and research on most recent technologies will continue to strongly impact the field.
| S-EPMC5932335 | biostudies-other
Project description:BACKGROUND:Electronic (eHealth) and mobile (mHealth) health interventions can provide a large coverage, and are promising tools to change health behavior (i.e. physical activity, sedentary behavior and healthy eating). However, the determinants of intervention effectiveness in primary prevention has not been explored yet. Therefore, the objectives of this umbrella review were to evaluate intervention effectiveness, to explore the impact of pre-defined determinants of effectiveness (i.e. theoretical foundations, behavior change techniques, social contexts or just-in-time adaptive interventions), and to provide recommendations for future research and practice in the field of primary prevention delivered via e/mHealth technology. METHODS:PubMed, Scopus, Web of Science and the Cochrane Library were searched for systematic reviews and meta-analyses (reviews) published between January 1990 and May 2020. Reviews reporting on e/mHealth behavior change interventions in physical activity, sedentary behavior and/or healthy eating for healthy subjects (i.e. subjects without physical or physiological morbidities which would influence the realization of behaviors targeted by the respective interventions) were included if they also investigated respective theoretical foundations, behavior change techniques, social contexts or just-in-time adaptive interventions. Included studies were ranked concerning their methodological quality and qualitatively synthesized. RESULTS:The systematic search revealed 11 systematic reviews and meta-analyses of moderate quality. The majority of original research studies within the reviews found e/mHealth interventions to be effective, but the results showed a high heterogeneity concerning assessment methods and outcomes, making them difficult to compare. Whereas theoretical foundation and behavior change techniques were suggested to be potential positive determinants of effective interventions, the impact of social context remains unclear. None of the reviews included just-in-time adaptive interventions. CONCLUSION:Findings of this umbrella review support the use of e/mHealth to enhance physical activity and healthy eating and reduce sedentary behavior. The general lack of precise reporting and comparison of confounding variables in reviews and original research studies as well as the limited number of reviews for each health behavior constrains the generalization and interpretation of results. Further research is needed on study-level to investigate effects of versatile determinants of e/mHealth efficiency, using a theoretical foundation and additionally explore the impact of social contexts and more sophisticated approaches like just-in-time adaptive interventions. TRIAL REGISTRATION:The protocol for this umbrella review was a priori registered with PROSPERO: CRD42020147902 .
| S-EPMC7585171 | biostudies-literature
Project description:Engagement with digital behavior change interventions (DBCIs) is a potentially important mediator of effectiveness; however, we lack validated measures of engagement. This study describes (a) the development of a self-report scale that captures the purported behavioral and experiential facets of engagement and (b) the evaluation of its validity in a real-world setting. A deductive approach to item generation was taken. The sample consisted of adults in the UK who drink excessively, downloaded the freely available Drink Less app with the intention to reduce alcohol consumption, and completed the scale immediately after their first login. Five types of validity (i.e., construct, criterion, predictive, incremental, divergent) were examined using exploratory factor analysis, correlational analyses, and through regressing the number of subsequent logins in the next 14 days onto total scale scores. Cronbach's α was calculated to assess internal reliability. A 10-item scale assessing amount and depth of use, interest, enjoyment, and attention was generated. Of 5,460 eligible users, only 203 (3.7%) users completed the scale. Seven items were retained, and the scale was found to be unifactorial and internally reliable (α = 0.77). Divergent and criterion validity were not established. Total scale scores were not significantly associated with the number of subsequent logins (B = 0.02; 95% CI = -0.01 to 0.05; p = .14). Behavioral and experiential indicators of engagement with DBCIs may constitute a single dimension, but low response rates to engagement surveys embedded in DBCIs may make their use impracticable in real-world settings.
| S-EPMC8411853 | biostudies-literature
Project description:Behavioral medicine is devoting increasing attention to the topic of participant engagement and its role in effective mobile health (mHealth) behavioral interventions. Several definitions of the term "engagement" have been proposed and discussed, especially in the context of digital health behavioral interventions. We consider that engagement refers to specific interaction and use patterns with the mHealth tools such as smartphone applications for intervention, whereas adherence refers to compliance with the directives of the health intervention, independent of the mHealth tools. Through our analysis of participant interaction and self-reported behavioral data in a college student health study with incentives, we demonstrate an example of measuring "effective engagement" as engagement behaviors that can be linked to the goals of the desired intervention. We demonstrate how clustering of one year of weekly health behavior self-reports generate four interpretable clusters related to participants' adherence to the desired health behaviors: healthy and steady, unhealthy and steady, decliners, and improvers. Based on the intervention goals of this study (health promotion and behavioral change), we show that not all app usage metrics are indicative of the desired outcomes that create effective engagement. As such, mHealth intervention design might consider eliciting not just more engagement or use overall, but rather, effective engagement defined by use patterns related to the desired behavioral outcome.
| S-EPMC7173729 | biostudies-literature
Project description:BackgroundThe behavior change technique taxonomy v1 (BCTTv1; Michie and colleagues, 2013) is a comprehensive tool to characterize active ingredients of interventions and includes 93 labels that are hierarchically clustered into 16 hierarchical clusters.ObjectiveThe aim of this study was to identify the active ingredients in electronic health (eHealth) interventions targeting patients with poorly controlled type 2 diabetes mellitus (T2DM) and relevant outcomes.MethodsWe conducted a scoping review using the BCTTv1. Randomized controlled trials (RCTs), studies with or pre-post-test designs, and quasi-experimental studies examining efficacy and effectiveness of eHealth interventions for disease management or the promotion of relevant health behaviors were identified by searching PubMed, Web of Science, and PsycINFO. Reviewers independently screened titles and abstracts for eligibility using predetermined eligibility criteria. Data were extracted following a data extraction sheet. The BCTTv1 was used to characterize active ingredients of the interventions reported in the included studies.ResultsOf the 1404 unique records screened, 32 studies fulfilled the inclusion criteria and reported results on the efficacy and or or effectiveness of interventions. Of the included 32 studies, 18 (56%) were Web-based interventions delivered via personal digital assistant (PDA), tablet, computer, and/or mobile phones; 7 (22%) were telehealth interventions delivered via landline; 6 (19%) made use of text messaging (short service message, SMS); and 1 employed videoconferencing (3%). Of the 16 hierarchical clusters of the BCTTv1, 11 were identified in interventions included in this review. Of the 93 individual behavior change techniques (BCTs), 31 were identified as active ingredients of the interventions. The most common BCTs identified were instruction on how to perform behavior, adding objects to the environment, information about health consequences, self-monitoring of the outcomes and/or and prefers to be explicit to avoid ambiguity. Response: Checked and avoided of a certain behavior Author: Please note that the journal discourages the use of parenthesis to denote either and/or and prefers to be explicit to avoid ambiguity. Response: Checked and avoided "and/or" and prefers to be explicit to avoid ambiguity. Response: Checked and avoided, and feedback on outcomes of behavior.ConclusionsOur results suggest that the majority of BCTs employed in interventions targeting persons with T2DM revolve around the promotion of self-regulatory behavior to manage the disease or to assist patients in performing health behaviors necessary to prevent further complications of the disease. Detailed reporting of the BCTs included in interventions targeting this population may facilitate the replication and further investigation of such interventions.
| S-EPMC5658649 | biostudies-literature
Project description:Small-scale fisheries are an important livelihood and primary protein source for coastal communities in many of the poorest regions in the world, yet many are overfished and thus require effective and scalable management solutions. Positive ecological and socioeconomic responses to management typically lag behind immediate costs borne by fishers from fishing pressure reductions necessary for fisheries recovery. These short-term costs challenge the long-term success of these interventions. However, social marketing may increase perceptions of management benefits before ecological and socioeconomic benefits are fully realized, driving new social norms and ultimately long-term sustainable behavior change. By conducting underwater visual surveys to quantify ecological conditions and by conducting household surveys with community members to quantify their perceptions of management support and socioeconomic conditions, we assessed the impact of a standardized small-scale fisheries management intervention that was implemented across 41 sites in Brazil, Indonesia, and the Philippines. The intervention combines TURF reserves (community-based territorial use rights for fishing coupled with no-take marine reserves) with locally tailored social-marketing behavior change campaigns. Leveraging data across 22 indicators and 4 survey types, along with data from 3 control sites, we found that ecological and socioeconomic impacts varied and that communities supported the intervention and were already changing their fishing practices. These results suggest that communities were developing new social norms and fishing more sustainably before long-term ecological and socioeconomic benefits of fisheries management materialized.
| S-EPMC7540413 | biostudies-literature