New Checklist for the Heuristic Evaluation of mHealth Apps (HE4EH): Development and Usability Study.
Ontology highlight
ABSTRACT: Background
Diabetes is one of the leading causes of death in developing countries. Existing mobile health (mHealth) app design guidelines lack a description of the support of continuous self-monitoring of health status, behavior change to improve and adopt a healthy lifestyle, and communication with health educators and health care professionals in case of any need.Objective
This paper presents the development of a specialized set of heuristics called heuristic evaluation for mHealth apps (HE4EH) as an all-in-one tool and its applicability by performing a heuristic evaluation of an mHealth app.Methods
An extensive review of heuristics and checklists was used to develop the HE4EH. The HE4EH was evaluated by domain experts for heuristics, checklist items, severity ratings, and overall satisfaction. The OneTouch app, which helps individuals with diabetes manage their blood glucose levels, was evaluated using HE4EH to identify usability problems that need to be fixed in the app.Results
The expert evaluation of HE4EH revealed that the heuristics were important, relevant, and clear. The checklist items across the heuristics were clear, relevant, and acceptably grouped. In terms of evaluating the OneTouch app using the HE4EH, the most frequently violated heuristics included Content, Visibility, Match, and Self-monitoring. Most of the usability problems found were minor. The system usability scale score indicated that the OneTouch app is marginally acceptable.Conclusions
This heuristic evaluation using the OneTouch app shows that the HE4EH can play a vital role for designers, researchers, and practitioners to use HE4EH heuristics and checklist items as a tool to design a new or evaluate and improve an existing mHealth app.
SUBMITTER: Khowaja K
PROVIDER: S-EPMC7657716 | biostudies-literature | 2020 Oct
REPOSITORIES: biostudies-literature
Publications
New Checklist for the Heuristic Evaluation of mHealth Apps (HE4EH): Development and Usability Study.
Khowaja Kamran K Al-Thani Dena D
JMIR mHealth and uHealth 20201028 10
<h4>Background</h4>Diabetes is one of the leading causes of death in developing countries. Existing mobile health (mHealth) app design guidelines lack a description of the support of continuous self-monitoring of health status, behavior change to improve and adopt a healthy lifestyle, and communication with health educators and health care professionals in case of any need.<h4>Objective</h4>This paper presents the development of a specialized set of heuristics called heuristic evaluation for mHe ...[more]
Similar Datasets
Project description:BACKGROUND:The recent proliferation of self-tracking technologies has allowed individuals to generate significant quantities of data about their lifestyle. These data can be used to support health interventions and monitor outcomes. However, these data are often stored and processed by vendors who have commercial motivations, and thus, they may not be treated with the sensitivity with which other medical data are treated. As sensors and apps that enable self-tracking continue to become more sophisticated, the privacy implications become more severe in turn. However, methods for systematically identifying privacy issues in such apps are currently lacking. OBJECTIVE:The objective of our study was to understand how current mass-market apps perform with respect to privacy. We did this by introducing a set of heuristics for evaluating privacy characteristics of self-tracking services. METHODS:Using our heuristics, we conducted an analysis of 64 popular self-tracking services to determine the extent to which the services satisfy various dimensions of privacy. We then used descriptive statistics and statistical models to explore whether any particular categories of an app perform better than others in terms of privacy. RESULTS:We found that the majority of services examined failed to provide users with full access to their own data, did not acquire sufficient consent for the use of the data, or inadequately extended controls over disclosures to third parties. Furthermore, the type of app, in terms of the category of data collected, was not a useful predictor of its privacy. However, we found that apps that collected health-related data (eg, exercise and weight) performed worse for privacy than those designed for other types of self-tracking. CONCLUSIONS:Our study draws attention to the poor performance of current self-tracking technologies in terms of privacy, motivating the need for standards that can ensure that future self-tracking apps are stronger with respect to upholding users' privacy. Our heuristic evaluation method supports the retrospective evaluation of privacy in self-tracking apps and can be used as a prescriptive framework to achieve privacy-by-design in future apps.
| S-EPMC6231850 | biostudies-literature
Project description:The rapid evolution and adoption of mobile devices raise new usability challenges, given their limitations (in screen size, battery life, etc.) as well as the specific requirements of this new interaction. Traditional evaluation techniques need to be adapted in order for these requirements to be met. Heuristic evaluation (HE), an Inspection Method based on evaluation conducted by experts over a real system or prototype, is based on checklists which are desktop-centred and do not adequately detect mobile-specific usability issues. In this paper, we propose a compilation of heuristic evaluation checklists taken from the existing bibliography but readapted to new mobile interfaces. Selecting and rearranging these heuristic guidelines offer a tool which works well not just for evaluation but also as a best-practices checklist. The result is a comprehensive checklist which is experimentally evaluated as a design tool. This experimental evaluation involved two software engineers without any specific knowledge about usability, a group of ten users who compared the usability of a first prototype designed without our heuristics, and a second one after applying the proposed checklist. The results of this experiment show the usefulness of the proposed checklist for avoiding usability gaps even with nontrained developers.
| S-EPMC4177852 | biostudies-literature
Project description:BackgroundUsability is a key factor affecting the acceptance of mobile health applications (mHealth apps) for elderly individuals, but traditional usability evaluation methods may not be suitable for use in this population because of aging barriers. The objectives of this study were to identify, explore, and summarize the current state of the literature on the usability evaluation of mHealth apps for older adults and to incorporate these methods into the appropriate evaluation stage.MethodsElectronic searches were conducted in 10 databases. Inclusion criteria were articles focused on the usability evaluation of mHealth apps designed for older adults. The included studies were classified according to the mHealth app usability evaluation framework, and the suitability of evaluation methods for use among the elderly was analyzed.ResultsNinety-six articles met the inclusion criteria. Research activity increased steeply after 2013 (n = 92). Satisfaction (n = 74) and learnability (n = 60) were the most frequently evaluated critical measures, while memorability (n = 13) was the least evaluated. The ratios of satisfaction, learnability, operability, and understandability measures were significantly related to the different stages of evaluation (P < 0.05). The methods used for usability evaluation were questionnaire (n = 68), interview (n = 36), concurrent thinking aloud (n = 25), performance metrics (n = 25), behavioral observation log (n = 14), screen recording (n = 3), eye tracking (n = 1), retrospective thinking aloud (n = 1), and feedback log (n = 1). Thirty-two studies developed their own evaluation tool to assess unique design features for elderly individuals.ConclusionIn the past five years, the number of studies in the field of usability evaluation of mHealth apps for the elderly has increased rapidly. The mHealth apps are often used as an auxiliary means of self-management to help the elderly manage their wellness and disease. According to the three stages of the mHealth app usability evaluation framework, the critical measures and evaluation methods are inconsistent. Future research should focus on selecting specific critical measures relevant to aging characteristics and adapting usability evaluation methods to elderly individuals by improving traditional tools, introducing automated evaluation tools and optimizing evaluation processes.
| S-EPMC9717549 | biostudies-literature
Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.
| S-EPMC6482399 | biostudies-other
Project description:BackgroundReduced or absence of melanin poses physical, social, and psychological challenges to individuals with albinism. Mobile health (mHealth) applications have the potential to improve the accessibility of information and services while reducing time and costs. This study aimed to develop and evaluate a mHealth application for self-management of albinism.MethodsThis applied study was conducted in two stages (development and evaluation) in 2022. Initially, the functional requirements were determined, and the conceptual model of the application was then developed using Microsoft Visio 2021. In the second phase, the application was evaluated using the Mobile Application Usability Questionnaire (MAUQ) involving patients with albinism to reflect their views on the usability of the application.ResultsThe key capabilities of the application included: reminders, alerts, educational content, useful links, storage and exchange of images of skin lesions, specialist finder, and notifications for albinism-relevant events. Twenty-one users with albinism participated in the usability testing of the application. The users were predominantly satisfied with the application (5.53 ± 1.10; Max: 7.00).ConclusionsThe findings of this study suggest that the developed mobile application could assist individuals with albinism to effectively manage their condition by considering the users' requirements and services that the application should deliver.
| S-EPMC10262590 | biostudies-literature
Project description:BackgroundFalls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.ObjectiveThe aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.MethodsA fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.ResultsThere were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.ConclusionsOur fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.
| S-EPMC6716481 | biostudies-literature
Project description:BackgroundMobile electronic platforms provide exciting possibilities for health behavior promotion. For instance, they can promote smoking cessation, moderate alcohol consumption, healthy eating, and physical activity. Young adults in Sweden are proficient in the use of technology, having been exposed to computers, smartphones, and the internet from an early age. However, with the high availability of mobile health (mHealth) interventions of varying quality, it is critical to optimize the usability of mHealth interventions to ensure long-term use of these health promotion interventions.ObjectiveThis study aims to investigate the usability of an mHealth intervention (LIFE4YOUth) targeting health behaviors among high school students through heuristic evaluation and usability testing.MethodsA preliminary version of the LIFE4YOUth mHealth intervention, which was aimed at promoting healthy eating, physical activity, smoking cessation, and nonrisky drinking among high school students, was developed in early 2019. We completed a total of 15 heuristic evaluations and 5 usability tests to evaluate the usability of the mHealth intervention prototype to improve its functioning, content, and design.ResultsHeuristic evaluation from a total of 15 experts (10 employees and 5 university students, both women and men, aged 18-25 years) revealed that the major usability problems and the worst ratings, a total of 17 problems termed usability catastrophes, concerned shortcomings in displaying easy-to-understand information to the users or technical errors. The results of the usability testing including 5 high school students (both girls and boys, aged 15-18 years) showed that the design, quality, and quantity of content in the intervention may impact the users' level of engagement. Poor functionality was considered a major barrier to usability. Of the 5 participants, one rated the LIFE4YOUth intervention as poor, 2 rated as average, and 2 assessed it as good, according to the System Usability Scale.ConclusionsHigh school students have high expectations of digital products. If an mHealth intervention does not offer optimal functions, they may cease to use it. Optimizing the usability of mHealth interventions is a critical step in the development process. Heuristic evaluation and usability testing in this study provided valuable knowledge about the prototype from a user's perspective. The findings may lead to the development of similar interventions targeting the high school population.
| S-EPMC7661261 | biostudies-literature
Project description:BackgroundHealthy sleep is a fundamental component of physical and brain health. Insomnia, however, is a prevalent sleep disorder that compromises functioning, productivity, and health. Therefore, developing efficient treatment delivery methods for insomnia can have significant societal and personal health impacts. Cognitive behavioral therapy for insomnia (CBTI) is the recommended first-line treatment of insomnia but access is currently limited for patients, since treatment must occur in specialty sleep clinics, which suffer from an insufficient number of trained clinicians. Smartphone-based interventions offer a promising means for improving the delivery of CBTI. Furthermore, novel features such as real-time monitoring and assessment, personalization, dynamic adaptations of the intervention, and context awareness can enhance treatment personalization and effectiveness, and reduce associated costs. Ultimately, this "Just in Time Adaptive Intervention" for insomnia-an intervention approach that is acceptable to patients and clinicians, and is based on mobile health (mHealth) platform and tools-can significantly improve patient access and clinician delivery of evidence-based insomnia treatments.ObjectiveThis study aims to develop and assess the usability of a Just in Time Adaptive Intervention application platform called iREST ("interactive Resilience Enhancing Sleep Tactics") for use in behavioral insomnia interventions. iREST can be used by both patients and clinicians.MethodsThe development of iREST was based on the Iterative and Incremental Development software development model. Requirement analysis was based on the case study's description, workflow and needs, clinician inputs, and a previously conducted BBTI military study/implementation of the Just in Time Adaptive Intervention architecture. To evaluate the usability of the iREST mHealth tool, a pilot usability study was conducted. Additionally, this study explores the feasibility of using an off-the-shelf wearable device to supplement the subjective assessment of patient sleep patterns.ResultsThe iREST app was developed from the mobile logical architecture of Just in Time Adaptive Intervention. It consists of a cross-platform smartphone app, a clinician portal, and secure 2-way communications platform between the app and the portal. The usability study comprised 19 Active Duty Service Members and Veterans between the ages of 18 and 60. Descriptive statistics based on in-app questionnaires indicate that on average, 12 (mean 12.23, SD 8.96) unique devices accessed the clinician portal per day for more than two years, while the app was rated as "highly usable", achieving a mean System Usability Score score of 85.74 (SD 12.37), which translates to an adjective rating of "Excellent". The participants also gave high scores on "ease of use and learnability" with an average score of 4.33 (SD 0.65) on a scale of 1 to 5.ConclusionsiREST provides a feasible platform for the implementation of Just in Time Adaptive Intervention in mHealth-based and remote intervention settings. The system was rated highly usable and its cross-platformness made it readily implemented within the heavily segregated smartphone market. The use of wearables to track sleep is promising; yet the accuracy of this technology needs further improvement. Ultimately, iREST demonstrates that mHealth-based Just in Time Adaptive Intervention is not only feasible, but also works effectively.
| S-EPMC5981058 | biostudies-literature
Project description:To test the feasibility and usability of mHealth TLC, an interactive, immersive 3-dimensional iPad health game that coaches lung cancer patients toward assertive communication strategies during first-person virtual clinics visits.We observed players and conducted semi-structured interviews. Research questions focused on scenario believability, the impact of technical issues, transparency of game goals, and potential of mHealth TLC to decrease lung cancer stigma (LCS) and improve patient-clinician communication.Eight users confirmed mHealth TLC to be: (1) believable, (2) clinic-appropriate, and (3) helpful in support of informed healthcare consumers. Concerns were expressed about emotionally charged content and plans to use mHealth TLC in clinic settings as opposed to at home.Although the dialog and interactions addressed emotionally charged issues, players were able to engage, learn, and benefit from role-play in a virtual world. Health games have the potential to improve patient-clinician communication, and mHealth TLC specifically may decrease LCS, and promote optimal self-management.Process reflection revealed the need for health games to be created by experienced game developers in collaboration with health care experts. To prepare for this best practice, research institutions and game developers interested in health games should proactively seek out networking and collaboration opportunities.
| S-EPMC4451946 | biostudies-literature
Project description:BACKGROUND:Falls have implications for older adults' health and well-being. Strength and balance interventions significantly reduce the risk of falls. However, patients do not always perform the unsupervised home exercise needed for fall reduction. OBJECTIVE:This study aims to develop motivational smartphone apps co-designed with health professionals and older adults to support patients to perform exercise proven to aid fall reduction and to explore the apps' usability and acceptability with both health professionals and patients. METHODS:There were 3 phases of app development that included analysis, design, and implementation. For analysis, we examined the literature to establish key app components and had a consultation with 12 older adults attending a strength and balance class, exercise instructors, and 3 fall services. For design, we created prototype apps and conducted 2 patient and public involvement workshops, one with 5 health professionals and the second with 8 older adults from an exercise group. The apps were revised based on the feedback. For implementation, we tested them with one fall service and their patients for 3 weeks. Participatory evaluation was used through testing, semistructured interviews, and focus groups to explore acceptability and usability. Focus groups were conducted with the service that tested the apps and two other services. Qualitative data were analyzed using the framework approach. RESULTS:On the basis of findings from the literature and consultations in the analysis phase, we selected Behavior Change Techniques, such as goal setting, action planning, and feedback on behavior, to be key parts of the app. We developed goals using familiar icons for patients to select and add while self-reporting exercise and decided to develop 2 apps, one for patients (My Activity Programme) and one for health professionals (Motivate Me). This enabled health professionals to guide patients through the goal-setting process, making it more accessible to nontechnology users. Storyboards were created during the design phase, leading to prototypes of "Motivate Me" and "My Activity Programme." Key changes from the workshops included being able to add more details about the patients' exercise program and a wider selection of goals within "Motivate Me." The overall app design was acceptable to health professionals and older adults. In total, 7 patients and 3 health professionals participated in testing in the implementation phase, with interviews conducted with 6 patients and focus groups, with 3 teams (11 health professionals). Barriers, facilitators, and further functionality were identified for both apps, with 2 cross-cutting themes around phone usability and confidence. CONCLUSIONS:The motivational apps were found to be acceptable for older adults taking part in the design stage and patients and health professionals testing the apps in a clinical setting. User-led design is important to ensure that the apps are usable and acceptable.
| S-EPMC7551104 | biostudies-literature