An Analytics Platform to Evaluate Effective Engagement With Pediatric Mobile Health Apps: Design, Development, and Formative Evaluation.
Ontology highlight
ABSTRACT:
SUBMITTER: Pham Q
PROVIDER: S-EPMC6320392 | biostudies-other | 2018 Dec
REPOSITORIES: biostudies-other
Similar Datasets
Project description:BackgroundThere is mixed evidence to support current ambitions for mobile health (mHealth) apps to improve chronic health and well-being. One proposed explanation for this variable effect is that users do not engage with apps as intended. The application of analytics, defined as the use of data to generate new insights, is an emerging approach to study and interpret engagement with mHealth interventions.ObjectiveThis study aimed to consolidate how analytic indicators of engagement have previously been applied across clinical and technological contexts, to inform how they might be optimally applied in future evaluations.MethodsWe conducted a scoping review to catalog the range of analytic indicators being used in evaluations of consumer mHealth apps for chronic conditions. We categorized studies according to app structure and application of engagement data and calculated descriptive data for each category. Chi-square and Fisher exact tests of independence were applied to calculate differences between coded variables.ResultsA total of 41 studies met our inclusion criteria. The average mHealth evaluation included for review was a two-group pretest-posttest randomized controlled trial of a hybrid-structured app for mental health self-management, had 103 participants, lasted 5 months, did not provide access to health care provider services, measured 3 analytic indicators of engagement, segmented users based on engagement data, applied engagement data for descriptive analyses, and did not report on attrition. Across the reviewed studies, engagement was measured using the following 7 analytic indicators: the number of measures recorded (76%, 31/41), the frequency of interactions logged (73%, 30/41), the number of features accessed (49%, 20/41), the number of log-ins or sessions logged (46%, 19/41), the number of modules or lessons started or completed (29%, 12/41), time spent engaging with the app (27%, 11/41), and the number or content of pages accessed (17%, 7/41). Engagement with unstructured apps was mostly measured by the number of features accessed (8/10, P=.04), and engagement with hybrid apps was mostly measured by the number of measures recorded (21/24, P=.03). A total of 24 studies presented, described, or summarized the data generated from applying analytic indicators to measure engagement. The remaining 17 studies used or planned to use these data to infer a relationship between engagement patterns and intended outcomes.ConclusionsAlthough researchers measured on average 3 indicators in a single study, the majority reported findings descriptively and did not further investigate how engagement with an app contributed to its impact on health and well-being. Researchers are gaining nuanced insights into engagement but are not yet characterizing effective engagement for improved outcomes. Raising the standard of mHealth app efficacy through measuring analytic indicators of engagement may enable greater confidence in the causal impact of apps on improved chronic health and well-being.
| S-EPMC6356188 | biostudies-literature
Project description:BackgroundMobile health (mHealth) apps are revolutionizing the way clinicians and researchers monitor and manage the health of their participants. However, many studies using mHealth apps are hampered by substantial participant dropout or attrition, which may impact the representativeness of the sample and the effectiveness of the study. Therefore, it is imperative for researchers to understand what makes participants stay with mHealth apps or studies using mHealth apps.ObjectiveThis study aimed to review the current peer-reviewed research literature to identify the notable factors and strategies used in adult participant engagement and retention.MethodsWe conducted a systematic search of PubMed, MEDLINE, and PsycINFO databases for mHealth studies that evaluated and assessed issues or strategies to improve the engagement and retention of adults from 2015 to 2020. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Notable themes were identified and narratively compared among different studies. A binomial regression model was generated to examine the factors affecting retention.ResultsOf the 389 identified studies, 62 (15.9%) were included in this review. Overall, most studies were partially successful in maintaining participant engagement. Factors related to particular elements of the app (eg, feedback, appropriate reminders, and in-app support from peers or coaches) and research strategies (eg, compensation and niche samples) that promote retention were identified. Factors that obstructed retention were also identified (eg, lack of support features, technical difficulties, and usefulness of the app). The regression model results showed that a participant is more likely to drop out than to be retained.ConclusionsRetaining participants is an omnipresent challenge in mHealth studies. The insights from this review can help inform future studies about the factors and strategies to improve participant retention.
| S-EPMC9092233 | biostudies-literature
Project description:IntroductionProcedural training is a universal concern amongst pediatric residents and their teachers. We developed and implemented formative assessments to generate direct and indirect procedural feedback. We analyzed changes in residents' perceived procedural knowledge, skills, confidence, and entrustment.MethodsSenior pediatric residents rotating in the pediatric emergency department participated in video-recorded formative assessments of informed consent OSCEs and simulated toddler forehead laceration repair and infant lumbar puncture. Residents reflected on their perceived procedural knowledge, skills, confidence, and entrustment through Likert and entrustment scales. Secondary outcomes of formative assessment completion rates and proportions of procedures performed by pediatric residents tracked feasibility and potential clinical impact, respectively.ResultsIncluding the pilot period, 89% of residents (31 out of 35) received direct and indirect procedural feedback. Perceived composite competency and entrustment improved for laceration repair (competency: from 3.1 to 3.9, p < .001; entrustment: from 4.0 to 5.1, p < .001) and lumbar puncture (competency: from 3.5 to 4.0, p < .001; entrustment: from 4.6 to 5.6, p = .001). We observed an increase in the proportion of clinical laceration repairs (11% [97 out of 885] vs. 23% [218 out of 946], p < .001) and lumbar punctures (23% [12 out of 54] vs. 41% [21 out of 52], p = .05) performed by pediatric residents.DiscussionIntegrating feasible procedural formative assessments into the pediatric emergency department rotation had a positive impact on senior pediatric residents' perceptions of their procedural knowledge, skills, confidence, and entrustment and was associated with increased procedural engagement.
| S-EPMC9273678 | biostudies-literature
Project description:Both mobile apps and responsive-design websites (web apps) can be used to deliver mobile health (mHealth) interventions, but it can be difficult to discern which to use in research. The goal of this paper is to present four case studies from behavioral interventions that developed either a mobile app or a web app for research and present an information table to help researchers determine which mobile option would work best for them. Four behavioral intervention case studies (two developed a mobile app, and two developed a web app) presented include time, cost, and expertise. Considerations for adopting a mobile app or a web app-such as time, cost, access to programmers, data collection, security needs, and intervention components- are presented. Future studies will likely integrate both mobile app and web app modalities. The considerations presented here can help guide researchers on which platforms to choose prior to starting an mHealth intervention.
| S-EPMC5526804 | biostudies-other
Project description:IntroductionLack of engagement is a common challenge for digital health interventions. To achieve their potential, it is necessary to understand how best to support users' engagement with interventions and target health behaviors. The aim of this systematic review was to identify the behavioral theories and behavior change techniques being incorporated into mobile health apps and how they are associated with the different components of engagement.MethodsThe review was structured using the PRISMA and PICOS frameworks and searched six databases in July 2022: PubMed, Embase, CINAHL, APA PsycArticles, ScienceDirect, and Web of Science. Risk of bias was evaluated using the Cochrane Collaboration Risk of Bias 2 and the Mixed Methods Appraisal Tools.AnalysisA descriptive analysis provided an overview of study and app characteristics and evidence for potential associations between Behavior Change Techniques (BCTs) and engagement was examined.ResultsThe final analysis included 28 studies. Six BCTs were repeatedly associated with user engagement: goal setting, self-monitoring of behavior, feedback on behavior, prompts/cues, rewards, and social support. There was insufficient data reported to examine associations with specific components of engagement, but the analysis indicated that the different components were being captured by various measures.ConclusionThis review provides further evidence supporting the use of common BCTs in mobile health apps. To enable developers to leverage BCTs and other app features to optimize engagement in specific contexts and individual characteristics, we need a better understanding of how BCTs are associated with different components of engagement.Systematic review registrationhttps://www.crd.york.ac.uk/prospero/, identifier CRD42022312596.
| S-EPMC10545861 | biostudies-literature
Project description:BackgroundAsthma is a highly prevalent, chronic disease with significant morbidity, cost, and disparities in health outcomes. While adherence to asthma treatment guidelines can improve symptoms and decrease exacerbations, most patients receive care that is not guideline-based. New approaches that incorporate shared decision-making (SDM) and health information technology (IT) are needed to positively impact asthma management. Despite the promise of health IT to improve efficiency and outcomes in health care, new IT solutions frequently suffer from a lack of widespread adoption and do not achieve desired results, as a consequence of not involving end-users in design.ObjectiveTo describe a case study of a pediatric asthma SDM health IT solution's development and demonstrate a methodology for engaging actual patients and families in IT development. Perspectives are shared from the vantage point of the research team and a parent of a child with asthma, who participated on the development team.MethodsWe adapted user-centric design principles to engage actual users across three main development phases: project initiation, ideation, and usability testing. To facilitate the necessary level of user engagement, our approach included: (1) a Development Workgroup consisting of patients, caregivers, and providers who met regularly with the research team; and (2) "real-world users" consisting of patients, caregivers, and providers recruited from a variety of care locations, including safety-net clinics.ResultsUsing this methodology, we successful partnered with asthma patients and families to create an interactive, digital solution called Carolinas Asthma Coach. Carolinas Asthma Coach incorporates SDM principles to elicit patient information, including goals and preferences, and provides health-literate, tailored education with specific guideline-based recommendations for patients and their providers. Of the patients, caregivers, and providers surveyed, 100% (n=60) said they would recommend Carolinas Asthma Coach to a friend or colleague. Qualitative feedback from users provided support for the usability and engaging nature of the app.ConclusionsThis project demonstrates the feasibility and benefits of deploying user-centric design methods that engage real patients and caregivers throughout the health IT design process.
| S-EPMC5887041 | biostudies-literature
Project description:BackgroundThe Cholera-Hospital-Based-Intervention-for-7-Days (CHoBI7) is a handwashing with soap and water treatment intervention program delivered by a health promoter bedside in a health facility and through home visits to diarrhea patients and their household members during the 7?days after admission to a health facility. In a randomized controlled trial among cholera patient households in Bangladesh, the 7-day CHoBI7 program resulted in a significant reduction in cholera among household members of cholera patients and sustained improvements in drinking water quality and handwashing with soap practices 12 months post-intervention. In an effort to take this intervention to scale across Bangladesh in partnership with the Bangladesh Ministry of Health and Family Welfare, this study evaluates the feasibility and acceptability of mobile health (mHealth) programs as a low-cost, scalable approach for CHoBI7 program delivery.MethodsFormative research for the development of the CHoBI7 mHealth intervention included 40 semi-structured interviews, 4 mHealth workshops, 2 group discussions, and a pilot study of 52 households to assess the feasibility and acceptability of the developed mHealth program. Thematic analysis of the interviews and group discussions was conducted by two individuals separately based on emergent themes, and then themes were compared and discussed.ResultsA theory- and evidence-based approach using qualitative research methods was implemented to design the CHoBI7 mHealth program. Semi-structured interviews with government stakeholders identified perceptions and preferences for scaling the CHoBI7 mHealth program. Group discussions and semi-structured interviews with diarrhea patients and their family members identified beneficiary perceptions of mHealth and preferences for CHoBI7 mHealth program delivery. mHealth workshops were conducted as an interactive approach to draft and refine mobile message content based on stakeholder preferences. The pilot findings indicate that the CHoBI7 mHealth program has high user acceptability and is feasible to deliver to diarrhea patients that present at health facilities for treatment in Bangladesh. Both text and voice messages were recommended for program delivery. Dr. Chobi, the sender of mHealth messages, was viewed as a credible source of information that could be shared with others.ConclusionThis study presents a theory- and evidence-based approach that can be implemented for the development of future water, sanitation, and hygiene mHealth programs in low-resource settings.
| S-EPMC6670164 | biostudies-literature
Project description:BackgroundA range of mobile apps for anxiety have been developed in response to the high prevalence of anxiety disorders. Although the number of publicly available apps for anxiety is increasing, attrition rates among mobile apps are high. These apps must be engaging and relevant to end users to be effective; thus, engagement features and the ability to tailor delivery to the needs of individual users are key. However, our understanding of the functionality of these apps concerning engagement and tailoring features is limited.ObjectiveThe aim of this study is to review how cognitive behavioral elements are delivered by anxiety apps and their functionalities to support user engagement and tailoring based on user needs.MethodsA systematic search for anxiety apps described as being based on cognitive behavioral therapy (CBT) was conducted on Android and iPhone marketplaces. Apps were included if they mentioned the use of CBT for anxiety-related disorders. We identified 597 apps, of which 36 met the inclusion criteria and were reviewed through direct use.ResultsCognitive behavioral apps for anxiety incorporate a variety of functionalities, offer several engagement features, and integrate low-intensity CBT exercises. However, the provision of features to support engagement is highly uneven, and support is provided only for low-intensity CBT treatment. Cognitive behavioral elements combine various modalities to deliver intervention content and support the interactive delivery of these elements. Options for personalization are limited and restricted to goal selection upon beginning use or based on self-monitoring entries. Apps do not appear to provide individualized content to users based on their input.ConclusionsEngagement and tailoring features can be significantly expanded in existing apps, which make limited use of social features and clinical support and do not use sophisticated features such as personalization based on sensor data. To guide the evolution of these interventions, further research is needed to explore the effectiveness of different types of engagement features and approaches to tailoring therapeutic content.
| S-EPMC8529472 | biostudies-literature
Project description:BackgroundDigitally enabled care along with an emphasis on self-management of health is steadily growing. Mobile health apps provide a promising means of supporting health behavior change; however, engagement with them is often poor and evidence of their impact on health outcomes is lacking. As engagement is a key prerequisite to health behavior change, it is essential to understand how engagement with mobile health apps and their target health behaviors can be better supported. Although the importance of engagement is emphasized strongly in the literature, the understanding of how different components of engagement are associated with specific techniques that aim to change behaviors is lacking.ObjectiveThe purpose of this systematic review protocol is to provide a synthesis of the associations between various behavior change techniques (BCTs) and the different components and measures of engagement with mobile health apps.MethodsThe review protocol was structured using the PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols) and the PICOS (Population, Intervention, Comparator, Outcome, and Study type) frameworks. The following seven databases will be systematically searched: PubMed, Embase, Cumulative Index to Nursing and Allied Health Literature, APA PsycInfo, ScienceDirect, Cochrane Library, and Web of Science. Title and abstract screening, full-text review, and data extraction will be conducted by 2 independent reviewers. Data will be extracted into a predetermined form, any disagreements in screening or data extraction will be discussed, and a third reviewer will be consulted if consensus cannot be reached. Risk of bias will be assessed using the Cochrane Collaboration Risk of Bias 2 and the Risk Of Bias In Non-Randomized Studies - of Interventions (ROBINS-I) tools; descriptive and thematic analyses will be conducted to summarize the relationships between BCTs and the different components of engagement.ResultsThe systematic review has not yet started. It is expected to be completed and submitted for publication by May 2022.ConclusionsThis systematic review will summarize the associations between different BCTs and various components and measures of engagement with mobile health apps. This will help identify areas where further research is needed to examine BCTs that could potentially support effective engagement and help inform the design and evaluation of future mobile health apps.Trial registrationPROSPERO CRD42022312596; https://tinyurl.com/nhzp8223.International registered report identifier (irrid)PRR1-10.2196/35172.
| S-EPMC9006128 | biostudies-literature
Project description:BACKGROUND:Despite the detailed patient package inserts (PPIs) with prescription drugs that communicate crucial information about safety, there is a critical gap between patient understanding and the knowledge presented. As a result, patients may suffer from adverse events. We propose using human factors design methodologies such as hierarchical task analysis (HTA) and interactive visualization to bridge this gap. We hypothesize that an innovative mobile app employing human factors design with an interactive visualization can deliver PPI information aligned with patients' information processing heuristics. Such an app may help patients gain an improved overall knowledge of medications. OBJECTIVE:The objective of this study was to explore the feasibility of designing an interactive visualization-based mobile app using an HTA approach through a mobile prototype. METHODS:Two pharmacists constructed the HTA for the drug risperidone. Later, the specific requirements of the design were translated using infographics. We transferred the wireframes of the prototype into an interactive user interface. Finally, a usability evaluation of the mobile health app was conducted. RESULTS:A mobile app prototype using HTA and infographics was successfully created. We reiterated the design based on the specific recommendations from the usability evaluations. CONCLUSIONS:Using HTA methodology, we successfully created a mobile prototype for delivering PPI on the drug risperidone to patients. The hierarchical goals and subgoals were translated into a mobile prototype.
| S-EPMC6902132 | biostudies-literature