Dataset Information

Selecting and Evaluating Mobile Health Apps for the Healthy Life Trajectories Initiative: Development of the eHealth Resource Checklist.

ABSTRACT:

Background

The ubiquity of smartphones and mobile devices in the general population presents an unprecedented opportunity for preventative health. Not surprisingly, the use of electronic health (eHealth) resources accessed through mobile devices in clinical trials is becoming more prevalent; the selection, screening, and collation of quality eHealth resources is necessary to clinical trials using these technologies. However, the constant creation and turnover of new eHealth resources can make this task difficult. Although syntheses of eHealth resources are becoming more common, their methodological and reporting quality require improvement so as to be more accessible to nonexperts. Further, there continues to be significant variation in quality criteria employed for assessment, with no clear method for developing the included criteria. There is currently no single existing framework that addresses all six dimensions of mobile health app quality identified in Agarwal et al's recent scoping review (ie, basic descriptions of the design and usage of the resource; technical features and accessibility; health information quality; usability; evidence of impact; and user engagement and behavior change). In instances where highly systematic tactics are not possible (due to time constraints, cost, or lack of expertise), there may be value in adopting practical and pragmatic approaches to helping researchers and clinicians identify and disseminate e-resources.

Objective

The study aimed to create a set of guidelines (ie, a checklist) to aid the members of the Healthy Life Trajectories Initiative (HeLTI) Canada trial-a preconception randomized controlled clinical trial to prevent child obesity-to assist their efforts in searching, identifying, screening, and including selected eHealth resources for participant use in the study intervention.

Methods

A framework for searching, screening, and selecting eHealth resources was adapted from the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) checklist for systematic and scoping reviews to optimize the rigor, clarity, and transparency of the process. Details regarding searching, selecting, extracting, and assessing quality of eHealth resources are described.

Results

This study resulted in the systematic development of a checklist consisting of 12 guiding principles, organized in a chronological versus priority sequence to aid researchers in searching, screening, and assessing the quality of various eHealth resources.

Conclusions

The eHealth Resource Checklist will assist researchers in navigating the eHealth resource space by providing a mechanism to detail their process of developing inclusion criteria, identifying search location, selecting and reviewing evidence, extracting information, evaluating the quality of the evidence, and synthesizing the extracted evidence. The overarching goal of this checklist is to provide researchers or generalists new to the eHealth field with a tool that balances pragmatism with rigor and that helps standardize the process of searching and critiquing digital material-a particularly important aspect given the recent explosion of and reliance on eHealth resources. Moreover, this checklist may be useful to other researchers and practitioners developing similar health interventions.

SUBMITTER: Vanderloo LM

PROVIDER: S-EPMC8686460 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundModern families are facing conflicting demands on their time and resources, which may be at the detriment of child and family diet quality. Innovative nutrition interventions providing parents with behavioral support for the provision of healthy food could alleviate this issue. Mobile apps have the potential to deliver such interventions by providing practical behavioral support remotely, interactively, and in context.ObjectiveThis review aimed to identify and assess popular, commercially available food- and nutrition-related mobile apps that offer support for the provision of healthy family food by (1) describing app scope and characteristics, (2) assessing app quality, and (3) conducting a behavioral analysis of app content and features.MethodsSearches in the Google Play Store and Apple App Store between August 2017 and November 2017 identified apps addressing the food provision process. Apps were included if they were applicable to parents or families, written in English, and with a user rating of ?4 stars. Weight loss and diet monitoring apps and subscription apps with no free versions were excluded. App quality was assessed using the Mobile App Rating Scale (4 domains: engagement, functionality, aesthetics, and information). App content and features were extracted and behavior change techniques (BCTs) identified.ResultsOf the 2881 apps screened, 1.77% (51/2881) were included for assessment, comprising 23 recipe and recipe manager apps, 12 meal planning apps, 10 shopping list apps, 4 family organizers, and 2 food choice apps. Half (n=26) of the apps functioned primarily through user data input. Food choice and family organizer apps scored highest for app quality (mean 3.5 [SD 0.6] out of 5), whereas most apps scored well for functionality and poorly for engagement. Common app features with the potential to support healthy food provision included meal planners (n=26), shopping lists (n=44), and the ability to share app content (n=48). Behavioral support features mapped to relatively few BCTs (mean 3.9 [SD 1.9] per app), with Adding objects to the environment present in all apps, and 65% (33/51) including Instruction on how to perform the behavior.ConclusionsRecipe and recipe manager apps, meal planning apps, and family organizers with integrated meal planning and shopping lists scored well for functionality and incorporated behavioral support features that could be used to address barriers to healthy food provision, although features were focused on planning behaviors. Future apps should combine a range of features such as meal planners, shopping lists, simple recipes, reminders and prompts, and food ordering to reduce the burden of the food provision pathway and incorporate a range of BCTs to maximize behavior change potential. Researchers and developers should consider features and content that improve the engagement quality of such apps.

Project description:IntroductionThe Healthy Life Trajectories Initiative is an international consortium comprising four harmonised but independently powered trials to evaluate whether an integrated intervention starting preconceptionally will reduce non-communicable disease risk in their children. This paper describes the protocol of the India study.Methods and analysisThe study set in rural Mysore will recruit ~6000 married women over the age of 18 years. The village-based cluster randomised design has three arms (preconception, pregnancy and control; 35 villages per arm). The longitudinal multifaceted intervention package will be delivered by community health workers and comprise: (1) measures to optimise nutrition; (2) a group parenting programme integrated with cognitive-behavioral therapy; (3) a lifestyle behaviour change intervention to support women to achieve a diverse diet, exclusive breast feeding for the first 6 months, timely introduction of diverse and nutritious infant weaning foods, and adopt appropriate hygiene measures; and (4) the reduction of environmental pollution focusing on indoor air pollution and toxin avoidance.The primary outcome is adiposity in children at age 5 years, measured by fat mass index. We will report on a host of intermediate and process outcomes. We will collect a range of biospecimens including blood, urine, stool and saliva from the mothers, as well as umbilical cord blood, placenta and specimens from the offspring.An intention-to-treat analysis will be adopted to assess the effect of interventions on outcomes. We will also undertake process and economic evaluations to determine scalability and public health translation.Ethics and disseminationThe study has been approved by the institutional ethics committee of the lead institute. Findings will be published in peer-reviewed journals. We will interact with policy makers at local, national and international agencies to enable translation. We will also share the findings with the participants and local community through community meetings, newsletters and local radio.Trial registration numberISRCTN20161479, CTRI/2020/12/030134; Pre-results.

Project description:BackgroundSelecting and integrating health-related apps into patient care is impeded by the absence of objective guidelines for identifying high-quality apps from the many thousands now available.ObjectiveThis study aimed to evaluate the App Rating Inventory, which was developed by the Defense Health Agency's Connected Health branch, to support clinical decisions regarding app selection and evaluate medical and behavioral apps.MethodsTo enhance the tool's performance, eliminate item redundancy, reduce scoring system subjectivity, and ensure a broad application of App Rating Inventory-derived results, inventory development included 3 rounds of validation testing and 2 trial periods conducted over a 6-month interval. The development focused on content validity testing, dimensionality (ie, whether the tool's criteria performed as operationalized), factor and commonality analysis, and interrater reliability (reliability scores improved from 0.62 to 0.95 over the course of development).ResultsThe development phase culminated in a review of 248 apps for a total of 6944 data points and a final 28-item, 3-category app rating system. The App Rating Inventory produces scores for the following three categories: evidence (6 items), content (11 items), and customizability (11 items). The final (fourth) metric is the total score, which constitutes the sum of the 3 categories. All 28 items are weighted equally; no item is considered more (or less) important than any other item. As the scoring system is binary (either the app contains the feature or it does not), the ratings' results are not dependent on a rater's nuanced assessments.ConclusionsUsing predetermined search criteria, app ratings begin with an environmental scan of the App Store and Google Play. This first step in market research funnels hundreds of apps in a given disease category down to a manageable top 10 apps that are, thereafter, rated using the App Rating Inventory. The category and final scores derived from the rating system inform the clinician about whether an app is evidence informed and easy to use. Although a rating allows a clinician to make focused decisions about app selection in a context where thousands of apps are available, clinicians must weigh the following factors before integrating apps into a treatment plan: clinical presentation, patient engagement and preferences, available resources, and technology expertise.

Project description:BackgroundAlthough typically measured during the resting state, a growing literature is illustrating the ability to map intrinsic connectivity with functional MRI during task and naturalistic viewing conditions. These paradigms are drawing excitement due to their greater tolerability in clinical and developing populations and because they enable a wider range of analyses (e.g., inter-subject correlations). To be clinically useful, the test-retest reliability of connectivity measured during these paradigms needs to be established. This resource provides data for evaluating test-retest reliability for full-brain connectivity patterns detected during each of four scan conditions that differ with respect to level of engagement (rest, abstract animations, movie clips, flanker task). Data are provided for 13 participants, each scanned in 12 sessions with 10 minutes for each scan of the four conditions. Diffusion kurtosis imaging data was also obtained at each session.FindingsTechnical validation and demonstrative reliability analyses were carried out at the connection-level using the Intraclass Correlation Coefficient and at network-level representations of the data using the Image Intraclass Correlation Coefficient. Variation in intrinsic functional connectivity across sessions was generally found to be greater than that attributable to scan condition. Between-condition reliability was generally high, particularly for the frontoparietal and default networks. Between-session reliabilities obtained separately for the different scan conditions were comparable, though notably lower than between-condition reliabilities.ConclusionsThis resource provides a test-bed for quantifying the reliability of connectivity indices across subjects, conditions and time. The resource can be used to compare and optimize different frameworks for measuring connectivity and data collection parameters such as scan length. Additionally, investigators can explore the unique perspectives of the brain's functional architecture offered by each of the scan conditions.

Project description:BackgroundThe role of individual-tailored dietary recording in mobile phone health apps has become increasingly important in management of self-health care and population-based preventive service. The development of such mobile apps for user-centered designing is still challengeable and requires further scientific evidence.ObjectiveThis study aims to conduct a randomized trial to assess the accuracy and time efficiency of two prototypes for dietary recoding utilization related to the input method of food intake.MethodsWe first present an innovative combinatorial concept for dietary recording to account for dish variation. One prototype was a self-chosen tab app that featured choosing each food ingredient to synthesize an individual dish, whereas the other was an autonomous exhaustive list app that provided one selection from a comprehensive list of dish items. The concept included commercially available choices that allowed users to more accurately account for their individual food selection. The two mobile apps were compared in a head-to-head parallel randomized trial evaluation. Young adults (n=70, aged 18-29) and older adults (n=35, aged 55-73) were recruited and randomized into two groups for accuracy and response time evaluation based on 12 types of food items in use of the developed self-chosen tab and autonomous exhaustive list apps, respectively.ResultsFor the trials based on the self-chosen tab (53 participants) and autonomous exhaustive list groups (52 participants), the two prototypes were found to be highly accurate (>98%). The self-chosen tab app was found to be more efficient, requiring significantly less time for input of 11 of 12 items (P<.05). The self-chosen tab users occasionally neglected to select food attributes, an issue which did not occur in the autonomous exhaustive list group.ConclusionsOur study contributes through the scientific evaluation of the transformation step into prototype development to demonstrate that a self-chosen tab app has potentially better opportunity in effectiveness and efficiency. The combinatorial concept offers potential for dietary recording and planning which can account for high food item variability. Our findings on prototype development of diversified dietary recordings provide design consideration and user interaction for related further app development and improvement.Trial registrationISRCTN Registry ISRCTN86142301; http://www.isrctn.com/ ISRCTN86142301 (Archived by WebCite at http://www.webcitation.org/74YLEPYnS).

Project description:BACKGROUND:The literature suggests that the product design of self-guided electronic health (eHealth) interventions impacts user engagement. Traditional trial settings, however, do not enable the examination of these relationships in real-world use. OBJECTIVE:This study aimed to examine whether the qualities of product design, research evidence, and publicly available data predict real-world user engagement with mobile and Web-based self-guided eHealth interventions. METHODS:This analysis included self-guided mobile and Web-based eHealth interventions available to the public-with their qualities assessed using the Enlight suite of scales. Scales included Usability, Visual Design, User Engagement, Content, Therapeutic Persuasiveness, Therapeutic Alliance, Credibility, and Research Evidence. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with websites and mobile apps, based on a time window of 18 months that was set between November 1, 2016 and April 30, 2018. Real-world user engagement variables included average usage time (for both mobile apps and websites) and mobile app user retention 30 days after download. RESULTS:The analysis included 52 mobile apps (downloads median 38,600; interquartile range [IQR] 116,000) and 32 websites (monthly unique visitors median 5689; IQR 30,038). Results point to moderate correlations between Therapeutic Persuasiveness, Therapeutic Alliance, and the 3 user engagement variables (.31?rs?.51; Ps?.03). Visual Design, User Engagement, and Content demonstrated similar degrees of correlation with mobile app engagement variables (.25?rs?.49; Ps?.04) but not with average usage time of Web-based interventions. Positive correlations were also found between the number of reviews on Google Play and average app usage time (r=.58; P<.001) and user retention after 30 days (r=.23; P=.049). Although several product quality ratings were positively correlated with research evidence, the latter was not significantly correlated with real-world user engagement. Hierarchical stepwise regression analysis revealed that either Therapeutic Persuasiveness or Therapeutic Alliance explained 15% to 26% of user engagement variance. Data on Google Play (number of reviews) explained 15% of the variance of mobile app usage time above Enlight ratings; however, publicly available data did not significantly contribute to explaining the variance of the other 2 user-engagement variables. CONCLUSIONS:Results indicate that the qualities of product design predict real-world user engagement with eHealth interventions. The use of real-world behavioral datasets is a novel way to learn about user behaviors, creating new avenues for eHealth intervention research.

Project description:BACKGROUND:The emergence and advancement of mobile technologies offer a promising opportunity for people with diabetes to improve their self-management. Despite the proliferation of mobile apps, few studies have evaluated the apps that are available to the millions of people with diabetes in China. OBJECTIVE:This study aimed to conduct a systematic search of Chinese mobile apps for diabetes self-management and to evaluate their quality, functionality, and features by using validated rating scales. METHODS:A systematic search was conducted to identify Chinese apps for diabetes self-management in the four most popular Chinese language mobile app stores. Apps were included if they were designed for diabetes self-management and contained at least one of the following components: blood glucose management, dietary and physical activity management, medication taking, and prevention of diabetes-related comorbidities. Apps were excluded if they were unrelated to health, not in Chinese, or the targeted users are health care professionals. Apps meeting the identified inclusion criteria were downloaded and evaluated by a team of 5 raters. The quality, functionalities, and features of these apps were assessed by using the Mobile App Rating Scale (MARS), the IMS Institute for Healthcare Informatics Functionality score, and a checklist of self-management activities developed based on the Chinese diabetes self-management guideline, respectively. RESULTS:Among 2072 apps searched, 199 were eligible based on the inclusion criteria, and 67 apps were successfully downloaded for rating. These 67 apps had an average MARS score of 3.42 out of 5, and 76% (51/67) of the apps achieved an acceptable quality (MARS score >3.0). The scores for the four subdomains of MARS were 3.97 for functionality, 3.45 for aesthetics, 3.21 for information, and 3.07 for engagement. On average, reviewed apps applied five out of the 19 examined behavior change techniques, whereas the average score on the subjective quality for the potential impact on behavior change is 3 out of 5. In addition, the average score on IMS functionality was 6 out of 11. Functionalities in collecting, recording, and displaying data were mostly presented in the reviewed apps. Most of the apps were multifeatured with monitoring blood glucose and tracking lifestyle behaviors as common features, but some key self-management activities recommended by clinical guidelines, such as stress and emotional management, were rarely presented in these apps. CONCLUSIONS:The general quality of the reviewed apps for diabetes self-management is suboptimal, although the potential for improvement is significant. More attention needs to be paid to the engagement and information quality of these apps through co-design with researchers, public health practitioners, and consumers. There is also a need to promote the awareness of the public on the benefit and potential risks of utilizing health apps for self-management.