Dataset Information

A Mobile Patient-Reported Outcome Measure App With Talking Touchscreen: Usability Assessment.

ABSTRACT: BACKGROUND:In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. OBJECTIVE:The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. METHODS:The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. RESULTS:All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. CONCLUSIONS:The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.

SUBMITTER: Welbie M

PROVIDER: S-EPMC6789421 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Mobile Patient-Reported Outcome Measure App With Talking Touchscreen: Usability Assessment.

Welbie Marlies M Wittink Harriet H Westerman Marjan J MJ Topper Ilse I Snoei Josca J Devillé Walter L J M WLJM

JMIR formative research 20190927 3

<h4>Background</h4>In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills.<h4>Objective</h4>The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the D ...[more]

PMID: 31573909

Similar Datasets

Project description:BackgroundThere is currently limited evidence on the level and intensity of physical activity in individuals with hemophilia A. Mobile technologies can offer a rigorous and reliable alternative to support data collection processes but they are often associated with poor user retention. The lack of longitudinal continuity in their use can be partly attributed to the insufficient consideration of stakeholder inputs in the development process of mobile apps. Several user-centered models have been proposed to guarantee that a thorough knowledge of the end user needs is considered in the development process of mobile apps.ObjectiveThe aim of this study is to design and validate an electronic patient-reported outcome mobile app that requires sustained active input by individuals during POWER, an observational study that aims at evaluating the relationship between physical activity levels and bleeding in patients with hemophilia A.MethodsWe adopted a user-centered design and engaged several stakeholders in the development and usability testing of this mobile app. During the concept generation and ideation phase, we organized a need-assessment focus group (FG) with patient representatives to elicit specific design requirements for the end users. We then conducted 2 exploratory FGs to seek additional inputs for the app's improvement and 2 confirmatory FGs to validate the app and test its usability in the field through the mobile health app usability questionnaire.ResultsThe findings from the thematic analysis of the need-assessment FG revealed that there was a demand for sense making, for simplification of app functionalities, for maximizing integration, and for minimizing the feeling of external control. Participants involved in the later stages of the design refinement contributed to improving the design further by upgrading the app's layout and making the experience with the app more efficient through functions such as chatbots and visual feedback on the number of hours a wearable device had been worn, to ensure that the observed data were actually registered. The end users rated the app highly during the quantitative assessment, with an average mobile health app usability questionnaire score of 5.32 (SD 0.66; range 4.44-6.23) and 6.20 (SD 0.43; range 5.72-6.88) out of 7 in the 2 iterative usability testing cycles.ConclusionsThe results of the usability test indicated a high, growing satisfaction with the electronic patient-reported outcome app. The adoption of a thorough user-centered design process using several types of FGs helped maximize the likelihood of sustained retention of the app's users and made it fit for data collection of relevant outcomes in the observational POWER study. The continuous use of the app and the actual level of engagement will be evaluated during the ongoing trial.Trial registrationClinicalTrials.gov NCT04165135; https://clinicaltrials.gov/ct2/show/NCT04165135.

Project description:BackgroundAs a result of an aging population, there has been an increasing incidence of hip fractures worldwide. In the Netherlands, in order to improve the quality of care for elderly patients with hip fractures, the multidisciplinary Centre for Geriatric Traumatology was established in 2008 at the Department of Trauma Surgery at Ziekenhuisgroep Twente hospital (located in Almelo and Hengelo in the Netherlands).ObjectiveThough the Dutch Hip Fracture audit is used to monitor the quality of care for patients with fractures of the hip, only 30.7% of patients complete registration in the 3-month follow-up period. Mobile apps offer an opportunity for improvement in this area. The aim of this study was to investigate the usability and acceptance of a mobile app for gathering indicators of quality of care in a 3-month follow-up period after postoperative treatment of hip fracture.MethodsFrom July 2017 to December 2017, patients who underwent surgical treatment for hip fracture were recruited. Patients and caregivers, who were collectively considered the participant cohort, were asked to download the app and answer a questionnaire. Participants were divided into two groups-those who downloaded the app and those who did not download the app. A telephone interview that was based upon the Unified Theory of Acceptance and Use of Technology was conducted with a subset of participants from each group (1:1 ratio). This study was designated as not being subject to the Dutch Medical Research Involving Human Subjects Act according to the appropriate medical research ethics committees.ResultsOf the patients and caregivers who participated, 26.4% (29/110) downloaded the app, whereas 73.6% (81/110) did not. Telephone interviews with the subset of participants (n=24 per group) revealed that 54.0% (13/24) of the group of participants who did not download the app had forgotten the study. Among the group who downloaded the app, 95.8% (23/24) had the intention of completing the questionnaire, but only 4.2% (1/24) did so. The reasons for not completing the questionnaire included technical problems, cognitive disorders, or patient dependency on caregivers. Most participants in the group who downloaded the app self-reported a high level of expertise in using a smartphone (22/24, 91.7%), and sufficient facilitating conditions for using a smartphone were self-reported in both groups (downloaded the app: 23/24, 95.8%; did not download the app: 21/24, 87.5%), suggesting that these factors were not barriers to completion.ConclusionsDespite self-reported intention to use the app, smartphone expertise, and sufficient facilitating conditions for smartphone use, implementation of the mobile app was infeasible for daily practice. This was due to a combination of technical problems, factors related to the implementation process, and the population of interest having cognitive disorders or a dependency on caregivers for mobile technology.

Project description:BackgroundSymptoms related to endometriosis have a significant impact on the quality of life, and symptoms often recur. The experience sampling method (ESM), a digital questioning method characterized by randomly repeated momentary assessments, has several advantages over traditionally used measurements, including the ability to assess the temporal relationship between variables such as physical, mental, and social factors.ObjectiveThe aim of this study is to develop an ESM tool for patients with endometriosis to accurately measure symptoms and their course over time, allowing for personalized treatment and adequate monitoring of treatment efficacy in individual patients.MethodsOn the basis of international guidelines, items from validated questionnaires were selected through a literature review and during focus groups and multidisciplinary expert meetings. Data analysis was conducted using ATLAS.ti (ATLAS.ti Scientific Software Development GmbH). The feasibility and usability of the newly developed momentary assessment tool were tested for 28 consecutive days in 5 patients with endometriosis-related pain symptoms.ResultsMomentary assessment items contained questions concerning endometriosis symptoms, general somatic symptoms, psychological symptoms, contextual information, and the use of food and medication. A morning questionnaire on sleep and sexuality was included. In a pilot study, the patients considered the tool easy to use but time consuming. The average compliance rate of momentary assessments was 37.8% (106/280), with the highest completion rate during the first week (39/70, 56%). Therefore, it is advisable to use the ESM for a maximum of 7 days.ConclusionsA new digital tool for endometriosis symptom assessment was developed using the ESM, which may help overcome the limitations of current retrospective questionnaires. After validation and testing, future studies will be planned to evaluate the use of this tool in a clinical setting in order to propose a personalized treatment plan for women with endometriosis.

Project description:BackgroundSelf-regulation theory suggests people learn to influence their own behavior through self-monitoring, goal-setting, feedback, self-reward, and self-instruction, all of which smartphones are now capable of facilitating. Several mobile apps exist to manage asthma; however, little evidence exists about whether these apps employ user-centered design processes that adhere to government usability guidelines for mobile apps.ObjectiveBuilding upon a previous study that documented adolescent preferences for an asthma self-management app, we employed a user-centered approach to assess the usability of a high-fidelity wireframe for an asthma self-management app intended for use by adolescents with persistent asthma.MethodsIndividual interviews were conducted with adolescents (ages 11-18 years) with persistent asthma who owned a smartphone (N=8). Adolescents were asked to evaluate a PDF app wireframe consisting of 76 screen shots displaying app features, including log in and home screen, profile setup, settings and info, self-management features, and graphical displays for charting asthma control and medication. Preferences, comments, and suggestions for each set of screen shots were assessed using the audio-recorded interviews. Two coders reached consensus on adolescent evaluations of the following aspects of app features: (1) usability, (2) behavioral intentions to use, (3) confusing aspects, and (4) suggestions for improvement.ResultsThe app wireframe was generally well received, and several suggestions for improvement were recorded. Suggestions included increased customization of charts and notifications, reminders, and alerts. Participants preferred longitudinal data about asthma control and medication use to be displayed using line graphs. All participants reported that they would find an asthma management app like the one depicted in the wireframe useful for managing their asthma.ConclusionsEarly stage usability tests guided by government usability guidelines (usability.gov) revealed areas for improvement for an asthma self-management app for adolescents. Addressing these areas will be critical to developing an engaging and effective asthma self-management app that is capable of improving adolescent asthma outcomes.

Project description:Background Validity is the ability of an instrument to measure what it claims to measure. It means the degree to which the empirical evidence supports the trustworthiness of interpretations based on the calculated scores. The hematological malignancy (HM) specific patient reported outcome measure (HM-PRO), is a newly developed instrument for use in daily clinical practice as well as in research. This study, provides the evidence for construct validity of the HM-PRO, specifically focusing on the convergent and divergent validity compared to the other established instruments used in hematology. Methods This validation study adopted a prospective cross-sectional design where a heterogeneous group of patients diagnosed with different HMs and different disease state were recruited. A total of 905 patients were recruited from seven secondary care hospitals in the UK and online through five patient organizations. Patients were asked to complete the HM-PRO and other cancer specific PRO’s, FACT-G and EORTC QLQ C-30. Data analysis was performed using IBM SPSS 23 statistical software. Results A total of 486 males (53.7%) and 419 females (46.3%), with a mean age of 64.3 (± 12.4) years and mean time since diagnosis of 4.6 ( ± 5.2) were recruited. The total score of Part A of the HM-PRO highly correlated with the five functional scales of the EORTC QLQ-C30 (Physical = ?0.71, Role = ?0.72, Emotional = ?0.64, Cognitive = ?0.58, Social = ?0.74—p < 0.001). With respect to correlation with FACT-G, the total score of Part A of the HM-PRO highly correlated with Physical (?0.74), Emotional (?0.57), Functional (?0.66) domains and overall score of FACT-G (?0.74). Similarly, the total score of Part B of the HM-PRO highly correlated with three symptoms scales of EORTC QLQ-C30 (Fatigue scale = ?0.74, Nausea and Vomiting = ?0.52, Pain = ?0.59—p < 0.001) and individual symptom items (Dyspnea = 0.51, Insomnia= 0.43, Appetite loss = 0.54—p < 0.001). Conclusion The construct validity evidence presented in this research is a testimony to the HM-PRO’s ability to measure HRQoL issues which it intends to measure. This is of utmost importance when a PRO is used in routine clinical practice so that the interpretation of the scores or response to an individual item is understood by the clinicians/nurses as intended by the patients.

Dataset Information

A Mobile Patient-Reported Outcome Measure App With Talking Touchscreen: Usability Assessment.

Publications

A Mobile Patient-Reported Outcome Measure App With Talking Touchscreen: Usability Assessment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets