Dataset Information

An Electronic Patient-Reported Outcome Mobile App for Data Collection in Type A Hemophilia: Design and Usability Study.

ABSTRACT:

Background

There is currently limited evidence on the level and intensity of physical activity in individuals with hemophilia A. Mobile technologies can offer a rigorous and reliable alternative to support data collection processes but they are often associated with poor user retention. The lack of longitudinal continuity in their use can be partly attributed to the insufficient consideration of stakeholder inputs in the development process of mobile apps. Several user-centered models have been proposed to guarantee that a thorough knowledge of the end user needs is considered in the development process of mobile apps.

Objective

The aim of this study is to design and validate an electronic patient-reported outcome mobile app that requires sustained active input by individuals during POWER, an observational study that aims at evaluating the relationship between physical activity levels and bleeding in patients with hemophilia A.

Methods

We adopted a user-centered design and engaged several stakeholders in the development and usability testing of this mobile app. During the concept generation and ideation phase, we organized a need-assessment focus group (FG) with patient representatives to elicit specific design requirements for the end users. We then conducted 2 exploratory FGs to seek additional inputs for the app's improvement and 2 confirmatory FGs to validate the app and test its usability in the field through the mobile health app usability questionnaire.

Results

The findings from the thematic analysis of the need-assessment FG revealed that there was a demand for sense making, for simplification of app functionalities, for maximizing integration, and for minimizing the feeling of external control. Participants involved in the later stages of the design refinement contributed to improving the design further by upgrading the app's layout and making the experience with the app more efficient through functions such as chatbots and visual feedback on the number of hours a wearable device had been worn, to ensure that the observed data were actually registered. The end users rated the app highly during the quantitative assessment, with an average mobile health app usability questionnaire score of 5.32 (SD 0.66; range 4.44-6.23) and 6.20 (SD 0.43; range 5.72-6.88) out of 7 in the 2 iterative usability testing cycles.

Conclusions

The results of the usability test indicated a high, growing satisfaction with the electronic patient-reported outcome app. The adoption of a thorough user-centered design process using several types of FGs helped maximize the likelihood of sustained retention of the app's users and made it fit for data collection of relevant outcomes in the observational POWER study. The continuous use of the app and the actual level of engagement will be evaluated during the ongoing trial.

Trial registration

ClinicalTrials.gov NCT04165135; https://clinicaltrials.gov/ct2/show/NCT04165135.

SUBMITTER: Petracca F

PROVIDER: S-EPMC8686465 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. OBJECTIVE:The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. METHODS:The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. RESULTS:All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. CONCLUSIONS:The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.

Project description:ObjectiveThis scoping review aims to characterize the current literature on electronic patient-reported outcome measures (ePROMs) in rheumatology and assess the feasibility and utility of ePROMs and mobile health technology in the management of rheumatic disease.IntroductionPatient-reported outcome measures (PROMs) are commonly used in rheumatology as they are important markers of disease activity and overall function, encourage shared decision-making, and are associated with high rates of patient satisfaction. With the widespread use of mobile devices, there is increasing interest in the use of mobile health technology to collect electronic PROMs (ePROM).Inclusion criteriaAll primary studies that involve the collection of ePROMs using mobile devices by individuals with a rheumatic disease were included. Articles were excluded if ePROMs were measured during clinic appointments.MethodsA scoping review was performed using Medline, Embase, PsycINFO, and CINAHL with index terms and key words related to "patient-reported outcome measures", "rheumatic diseases", and "mobile health technology".ResultsA total of 462 records were identified after duplicates were removed. Of the 70 studies selected for review, 43% were conference proceedings and 57% were journal articles, with the majority published in 2016 or later. Inflammatory arthritis was the most common rheumatic disease studied. Generic ePROMs were used over three times more often than disease-specific ePROMs. A total of 39 (56%) studies directly evaluated the feasibility of ePROMs in clinical practice, 19 (27%) were clinical trials that used ePROMs as study endpoints, 9 (13%) were focus groups or surveys on smartphone application development, and 3 (4%) did not fit into one defined category.ConclusionThe use of ePROMs in rheumatology is a growing area of research and shows significant utility in clinical practice, particularly in inflammatory arthritis. Further research is needed to better characterize the feasibility of ePROMs in rheumatology and their impact on patient outcomes.

Project description:BackgroundAs a result of an aging population, there has been an increasing incidence of hip fractures worldwide. In the Netherlands, in order to improve the quality of care for elderly patients with hip fractures, the multidisciplinary Centre for Geriatric Traumatology was established in 2008 at the Department of Trauma Surgery at Ziekenhuisgroep Twente hospital (located in Almelo and Hengelo in the Netherlands).ObjectiveThough the Dutch Hip Fracture audit is used to monitor the quality of care for patients with fractures of the hip, only 30.7% of patients complete registration in the 3-month follow-up period. Mobile apps offer an opportunity for improvement in this area. The aim of this study was to investigate the usability and acceptance of a mobile app for gathering indicators of quality of care in a 3-month follow-up period after postoperative treatment of hip fracture.MethodsFrom July 2017 to December 2017, patients who underwent surgical treatment for hip fracture were recruited. Patients and caregivers, who were collectively considered the participant cohort, were asked to download the app and answer a questionnaire. Participants were divided into two groups-those who downloaded the app and those who did not download the app. A telephone interview that was based upon the Unified Theory of Acceptance and Use of Technology was conducted with a subset of participants from each group (1:1 ratio). This study was designated as not being subject to the Dutch Medical Research Involving Human Subjects Act according to the appropriate medical research ethics committees.ResultsOf the patients and caregivers who participated, 26.4% (29/110) downloaded the app, whereas 73.6% (81/110) did not. Telephone interviews with the subset of participants (n=24 per group) revealed that 54.0% (13/24) of the group of participants who did not download the app had forgotten the study. Among the group who downloaded the app, 95.8% (23/24) had the intention of completing the questionnaire, but only 4.2% (1/24) did so. The reasons for not completing the questionnaire included technical problems, cognitive disorders, or patient dependency on caregivers. Most participants in the group who downloaded the app self-reported a high level of expertise in using a smartphone (22/24, 91.7%), and sufficient facilitating conditions for using a smartphone were self-reported in both groups (downloaded the app: 23/24, 95.8%; did not download the app: 21/24, 87.5%), suggesting that these factors were not barriers to completion.ConclusionsDespite self-reported intention to use the app, smartphone expertise, and sufficient facilitating conditions for smartphone use, implementation of the mobile app was infeasible for daily practice. This was due to a combination of technical problems, factors related to the implementation process, and the population of interest having cognitive disorders or a dependency on caregivers for mobile technology.

Project description:BackgroundThe use of digital therapeutics (DTx) in the prevention and management of medical conditions has increased through the years, with an estimated 44 million people using one as part of their treatment plan in 2021, nearly double the number from the previous year. DTx are commonly accessed through smartphone apps, but offering these treatments through additional platforms can improve the accessibility of these interventions. Voice apps are an emerging technology in the digital health field; not only do they have the potential to improve DTx adherence, but they can also create a better user experience for some user groups.ObjectiveThis research aimed to identify the acceptability and feasibility of offering a voice app for a chronic disease self-management program. The objective of this project was to design, develop, and evaluate a voice app of an already-existing smartphone-based heart failure self-management program, Medly, to be used as a case study.MethodsA voice app version of Medly was designed and developed through a user-centered design process. We conducted a usability study and semistructured interviews with patients with heart failure (N=8) at the Peter Munk Cardiac Clinic in Toronto General Hospital to better understand the user experience. A Medly voice app prototype was built using a software development kit in tandem with a cloud computing platform and was verified and validated before the usability study. Data collection and analysis were guided by a mixed methods triangulation convergence design.ResultsCommon themes were identified in the results of the usability study, which involved 8 participants with heart failure. Almost all participants (7/8, 88%) were satisfied with the voice app and felt confident using it, although half of the participants (4/8, 50%) were unsure about using it in the future. Six main themes were identified: changes in physical behavior, preference between voice app and smartphone, importance of music during voice app interaction, lack of privacy concerns, desired reassurances during voice app interaction, and helpful aids during voice app interaction. These findings were triangulated with the quantitative data, and it concluded that the main area for improvement was related to the ease of use; design changes were then implemented to better improve the user experience.ConclusionsThis work offered preliminary insight into the acceptability and feasibility of a Medly voice app. Given the recent emergence of voice apps in health care, we believe that this research offered invaluable insight into successfully deploying DTx for chronic disease self-management using this technology.