Dataset Information

Designing a Tablet-Based Software App for Mapping Bodily Symptoms: Usability Evaluation and Reproducibility Analysis.

ABSTRACT: Symptom drawings are widely used as a qualitative and quantitative method of assessing pain symptoms for both clinical and research purposes. As electronic drawings offer many advantages over classical pen-and-paper drawings, the last years have seen a shift toward tablet-based acquisition of symptom drawings. However, software that is used in clinical care requires special attention to usability aspects and design to provide easy access for physically impaired or elderly patients.The aims of this project were to develop a new tablet-based software app specifically designed to collect patients' and doctors' drawings of pain and related bodily symptoms and test it for usability in 2 samples of chronic pain patients (Aim 1) and their treating doctors (Aim 2) as well as for test-retest reliability (Aim 3).In 2 separate studies, symptom drawings from 103 chronic pain patients and their treating doctors were collected using 2 different versions of the app. Both patients and doctors evaluated usability aspects of the app through questionnaires. Results from study 1 were used to improve certain features of the app, which were then evaluated in study 2. Furthermore, a subgroup of 25 patients in study 2 created 2 consecutive symptom drawings for test-retest reproducibility analysis. Usability of both app versions was compared, and reproducibility was calculated for symptom extent, number of symptom clusters, and the whole symptom pattern.The changes we made to the app and the body outline led to significant improvements in patients' usability evaluation regarding the identification with the body outline (P=.007) and the evaluation of symptom depth (P=.02), and the overall difficultness of the drawing process (P=.003) improved significantly. Doctors' usability evaluation of the final app showed good usability with 75.63 (SD 19.51) points on the System Usability Scale, Attrakdiff 2 scores from 0.93 to 1.41, and ISONORM 9241/10 scores from -0.05 to 1.80. Test-retest analysis showed excellent reproducibility for pain extent (intraclass correlation coefficient, ICC=0.92) and good results for the number of symptom clusters (ICC=0.70) and a mean overlap of 0.47 (Jaccard index).We developed a tablet-based symptom drawing app and improved it based on usability assessment in a sample of chronic pain patients and their treating doctors. Increases in usability of the improved app comprised identification with the body outline, symptom depth evaluation, and difficultness of the drawing process. Test-retest reliability of symptom drawings by chronic pain patients showed fair to excellent reproducibility. Patients' usability evaluation is an important factor that should not be neglected when designing apps for mobile or eHealth apps.

SUBMITTER: Neubert TA

PROVIDER: S-EPMC6000481 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Designing a Tablet-Based Software App for Mapping Bodily Symptoms: Usability Evaluation and Reproducibility Analysis.

Neubert Till-Ansgar TA Dusch Martin M Karst Matthias M Beissner Florian F

JMIR mHealth and uHealth 20180530 5

<h4>Background</h4>Symptom drawings are widely used as a qualitative and quantitative method of assessing pain symptoms for both clinical and research purposes. As electronic drawings offer many advantages over classical pen-and-paper drawings, the last years have seen a shift toward tablet-based acquisition of symptom drawings. However, software that is used in clinical care requires special attention to usability aspects and design to provide easy access for physically impaired or elderly pati ...[more]

PMID: 29848470

Similar Datasets

Project description:BackgroundPediatric cardiac arrest (PCA), although rare, is associated with high mortality. Deviations from international management guidelines are frequent and associated with poorer outcomes. Different strategies/devices have been developed to improve the management of cardiac arrest, including cognitive aids. However, there is very limited experience on the usefulness of interactive cognitive aids in the format of an app in PCA. No app has so far been tested for its usability and effectiveness in guiding the management of PCA.ObjectiveTo develop a new audiovisual interactive app for tablets, named PediAppRREST, to support the management of PCA and to test its usability in a high-fidelity simulation-based setting.MethodsA research team at the University of Padova (Italy) and human-machine interface designers, as well as app developers, from an Italian company (RE:Lab S.r.l.) developed the app between March and October 2019, by applying an iterative design approach (ie, design-prototyping-evaluation iterative loops). In October-November 2019, a single-center nonrandomized controlled simulation-based pilot study was conducted including 48 pediatric residents divided into teams of 3. The same nonshockable PCA scenario was managed by 11 teams with and 5 without the app. The app user's experience and interaction patterns were documented through video recording of scenarios, debriefing sessions, and questionnaires. App usability was evaluated with the User Experience Questionnaire (UEQ) (scores range from -3 to +3 for each scale) and open-ended questions, whereas participants' workload was measured using the NASA Raw-Task Load Index (NASA RTLX).ResultsUsers' difficulties in interacting with the app during the simulations were identified using a structured framework. The app usability, in terms of mean UEQ scores, was as follows: attractiveness 1.71 (SD 1.43), perspicuity 1.75 (SD 0.88), efficiency 1.93 (SD 0.93), dependability 1.57 (SD 1.10), stimulation 1.60 (SD 1.33), and novelty 2.21 (SD 0.74). Team leaders' perceived workload was comparable (P=.57) between the 2 groups; median NASA RTLX score was 67.5 (interquartile range [IQR] 65.0-81.7) for the control group and 66.7 (IQR 54.2-76.7) for the intervention group. A preliminary evaluation of the effectiveness of the app in reducing deviations from guidelines showed that median time to epinephrine administration was significantly longer in the group that used the app compared with the control group (254 seconds versus 165 seconds; P=.015).ConclusionsThe PediAppRREST app received a good usability evaluation and did not appear to increase team leaders' workload. Based on the feedback collected from the participants and the preliminary results of the evaluation of its effects on the management of the simulated scenario, the app has been further refined. The effectiveness of the new version of the app in reducing deviations from guidelines recommendations in the management of PCA and its impact on time to critical actions will be evaluated in an upcoming multicenter simulation-based randomized controlled trial.

Project description:Saudi Arabia has faced a steady growth in the prevalence of obesity. The concurrent and ubiquitous use of mobile technology, such as smartphones and apps, provides an opportunity for the implementation of mHealth technology, a method for delivering behavioral interventions. Despite their effectiveness in promoting lifestyle and diet modification, culturally adapted weight loss apps and related interventions are lacking in Gulf Cooperation Council countries.The objective of our study was to identify the relationship between adherence to evidence-informed practices, potential user expectations, and actual user experiences in order to enhance the understanding of the overall usability of the Twazon Arabic weight loss app.In 2 previous studies, 39 Saudi women were recruited for focus group discussions and 240 Saudi women were recruited for an app-based weight loss intervention. Usability of the Twazon Arabic weight loss app was evaluated by analyzing the opinions and experiences of 26 participants who engaged with the Twazon app for 4 months; the System Usability Scale (SUS) and word clouds were used. The results were triangulated with potential user expectations obtained in the focus group discussion and with the findings from an Arabic app screening for evidence-informed practices.The average reported SUS score was 69.3. The most favored features were the calorie counter, step counter, and physical activity calorie counter. The features in need of improvement were the social network, notifications, and the Twazon Saudi Food Database. Twazon users preferred and found useful 7 of the 13 evidence-informed weight loss practices that were integrated into the features of the app.Triangulation identified the most notable relationship to be the disparity between user experience and 2 of the evidence-informed practices, namely a minimum weight loss goal of 0.5 to 1 kg/week and social support; no relationship was found between user expectations and evidence-informed weight loss practices. The overall usability of the Twazon Arabic weight loss app ranged between high marginal and acceptable, indicating that some improvements to the app should be considered for implementation in future app-based weight loss interventions of this kind.

Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.

Project description:BACKGROUND:Supporting patient engagement and empowerment is increasingly seen as essential in providing person-centered health care to people with chronic illness. Mobile apps helping patients reflect on their concerns as preparation for consultations with their health care providers can have beneficial effects on the consultation quality. However, apps focusing on empowerment and personal strengths are still scarce. OBJECTIVE:This study aimed to (1) develop a mobile app to support patients with rheumatic diseases in reflecting on their strengths in preparation for consultations with health care providers and (2) explore patients' perceived usability of the app in a nonclinical test setting. METHODS:A prototype app was developed based on input from patients and health care providers, as reported in previous studies. The app was designed for use in self-management support settings aiming to promote awareness of strengths and to focus attention on strengths in the patient-health care provider dialogue. The features included in the prototype were as follows: (1) introduction to the topic of strengths, (2) list of examples of strengths to promote reflection and registration of own strengths, (3) summary of registered strengths, (4) value-based goal setting, (5) linking of strengths to goals, (6) summary of all registrations, and (7) options to share summary digitally or as a print version. In this study, the app was refined through a formative evaluation with patients and health care providers recruited from a specialized rheumatology hospital unit. Patients' perceptions of the app's usability were explored in a test setting with self-report measurements and semistructured interviews. The interviews were audiotaped, transcribed, and analyzed with directed content analysis. Data from questionnaires were analyzed with descriptive statistics. RESULTS:Developmental and formative evaluation included 18 patients and 7 health care providers. The evaluation resulted in minor adjustments to the prototype but no major changes in features. The usability testing included 12 patients. All participants found the usability acceptable; the median score on the System Usability Scale was 86.3 (range 70-100). All reported that it was meaningful and relevant to use the app. Out of 12 participants, 9 (75%) reported becoming more aware of their own strengths by using the app; 1 (8%) disagreed and 2 (17%) provided a neutral response. The results on the goal-related feature were mixed, with half of the patients finding it useful to link strengths to concrete goals. A statistically significant positive change from pre- to postintervention was identified on measures of self-efficacy and negative emotions. CONCLUSIONS:In this formative evaluation of a mobile app to promote patients' reflections on their strengths, patients perceived the app as meaningful and supporting awareness. The results suggest the usefulness of building in functionality to support use of strengths and goal attainment. Further studies on efficacy and usability in a clinical setting, including health care providers, are needed.

Project description:BackgroundGlobally, the uptake of health screening is suboptimal, especially in men and those of younger age. In view of the increasing internet access and mobile phone ownership, ScreenMen, a mobile Web app, was developed to improve health screening uptake in men.ObjectiveThis study aimed to evaluate the utility and usability of ScreenMen.MethodsThis study used both qualitative and quantitative methods. Healthy men working in a banking institution were recruited to participate in this study. They were purposively sampled according to job position, age, education level, and screening status. Men were asked to use ScreenMen independently while the screen activities were being recorded. Once completed, retrospective think aloud with playback was conducted with men to obtain their feedback. They were asked to answer the System Usability Scale (SUS). Intention to undergo screening pre- and postintervention was also measured. Qualitative data were analyzed using a framework approach followed by thematic analysis. For quantitative data, the mean SUS score was calculated and change in intention to screening was analyzed using McNemar test.ResultsIn total, 24 men participated in this study. On the basis of the qualitative data, men found ScreenMen useful as they could learn more about their health risks and screening. They found ScreenMen convenient to use, which might trigger men to undergo screening. In terms of usability, men thought that ScreenMen was user-friendly and easy to understand. The key revision done on utility was the addition of a reminder function, whereas for usability, the revisions done were in terms of attracting and gaining users' trust, improving learnability, and making ScreenMen usable to all types of users. To attract men to use it, ScreenMen was introduced to users in terms of improving health instead of going for screening. Another important revision made was emphasizing the screening tests the users do not need, instead of just informing them about the screening tests they need. A Quick Assessment Mode was also added for users with limited attention span. The quantitative data showed that 8 out of 23 men (35%) planned to attend screening earlier than intended after using the ScreenMen. Furthermore, 4 out of 12 (33%) men who were in the precontemplation stage changed to either contemplation or preparation stage after using ScreenMen with P=.13. In terms of usability, the mean SUS score of 76.4 (SD 7.72) indicated that ScreenMen had good usability.ConclusionsThis study showed that ScreenMen was acceptable to men in terms of its utility and usability. The preliminary data suggested that ScreenMen might increase men's intention to undergo screening. This paper also presented key lessons learned from the beta testing, which is useful for public health experts and researchers when developing a user-centered mobile Web app.

Dataset Information

Designing a Tablet-Based Software App for Mapping Bodily Symptoms: Usability Evaluation and Reproducibility Analysis.

Publications

Designing a Tablet-Based Software App for Mapping Bodily Symptoms: Usability Evaluation and Reproducibility Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets