Dataset Information

Using a Web-Based App to Deliver Rehabilitation Strategies to Persons With Chronic Conditions: Development and Usability Study.

ABSTRACT:

Background

The global rise in the incidence of chronic conditions and aging is associated with increased disability. Physiotherapists and occupational therapists can mitigate the resulting burden on the health care system with their expertise in optimizing function. Rehabilitation self-management strategies can assist people with chronic conditions to accept, adjust, and manage different aspects of their daily functioning. Interventions delivered using technology have the potential to increase the accessibility, availability, and affordability of rehabilitation self-management support and services.

Objective

This study aims to describe the development and usability evaluation of iamable, a web-based app created to provide rehabilitation self-management support for people with chronic conditions.

Methods

The development and evaluation of iamable were undertaken in several phases. We used user-centered design principles and an iterative process that included consultations with rehabilitation experts; developed a prototype; and conducted usability tests, heuristic evaluations, and a focus group analysis.

Results

The iamable app was developed to provide rehabilitation self-management strategies in the areas of exercise, fall prevention, fatigue management, pain management, physical activity, and stress management. We engaged adults aged ≥45 years with at least one chronic condition (N=11) in usability testing. They identified navigation and the understanding of instructions as the primary issues for end users. During the heuristic evaluation, clinicians (N=6) recommended that some areas of app content should be more succinct and that help should be more readily available. The focus group provided input to help guide clinical simulation testing, including strategies for selecting patients and overcoming barriers to implementation.

Conclusions

We engaged end users and clinicians in the development and evaluation of the iamable app in an effort to create a web-based tool that was useful to therapists and their patients. By addressing usability issues, we were able to ensure that patients had access to rehabilitation strategies that could be used to help them better manage their health. Our app also provides therapists with a platform that they can trust to empower their patients to be more active in the management of chronic conditions. This paper provides a resource that can be used by others to develop and evaluate web-based health apps.

SUBMITTER: Richardson J

PROVIDER: S-EPMC8294797 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Falls have implications for older adults' health and well-being. Strength and balance interventions significantly reduce the risk of falls. However, patients do not always perform the unsupervised home exercise needed for fall reduction. OBJECTIVE:This study aims to develop motivational smartphone apps co-designed with health professionals and older adults to support patients to perform exercise proven to aid fall reduction and to explore the apps' usability and acceptability with both health professionals and patients. METHODS:There were 3 phases of app development that included analysis, design, and implementation. For analysis, we examined the literature to establish key app components and had a consultation with 12 older adults attending a strength and balance class, exercise instructors, and 3 fall services. For design, we created prototype apps and conducted 2 patient and public involvement workshops, one with 5 health professionals and the second with 8 older adults from an exercise group. The apps were revised based on the feedback. For implementation, we tested them with one fall service and their patients for 3 weeks. Participatory evaluation was used through testing, semistructured interviews, and focus groups to explore acceptability and usability. Focus groups were conducted with the service that tested the apps and two other services. Qualitative data were analyzed using the framework approach. RESULTS:On the basis of findings from the literature and consultations in the analysis phase, we selected Behavior Change Techniques, such as goal setting, action planning, and feedback on behavior, to be key parts of the app. We developed goals using familiar icons for patients to select and add while self-reporting exercise and decided to develop 2 apps, one for patients (My Activity Programme) and one for health professionals (Motivate Me). This enabled health professionals to guide patients through the goal-setting process, making it more accessible to nontechnology users. Storyboards were created during the design phase, leading to prototypes of "Motivate Me" and "My Activity Programme." Key changes from the workshops included being able to add more details about the patients' exercise program and a wider selection of goals within "Motivate Me." The overall app design was acceptable to health professionals and older adults. In total, 7 patients and 3 health professionals participated in testing in the implementation phase, with interviews conducted with 6 patients and focus groups, with 3 teams (11 health professionals). Barriers, facilitators, and further functionality were identified for both apps, with 2 cross-cutting themes around phone usability and confidence. CONCLUSIONS:The motivational apps were found to be acceptable for older adults taking part in the design stage and patients and health professionals testing the apps in a clinical setting. User-led design is important to ensure that the apps are usable and acceptable.

Project description:BACKGROUND:Cardiac rehabilitation (CR) improves outcomes for patients with ischemic heart disease or heart failure but is underused. New strategies to improve access to and engagement in CR are needed. There is considerable interest in technology-facilitated home CR. However, little is known about patient acceptance and use of mobile technology for CR. OBJECTIVE:The aim of this study was to develop a mobile app for technology-facilitated home CR and seek to determine its usability. METHODS:We recruited patients eligible for CR who had access to a mobile phone, tablet, or computer with Internet access. The mobile app includes physical activity goal setting, logs for tracking physical activity and health metrics (eg, weight, blood pressure, and mood), health education, reminders, and feedback. Study staff demonstrated the mobile app to participants in person and then observed participants completing prespecified tasks with the mobile app. Participants completed the System Usability Scale (SUS, 0-100), rated likelihood to use the mobile app (0-100), questionnaires on mobile app use, and participated in a semistructured interview. The Unified Theory of Acceptance and Use of Technology and the Theory of Planned Behavior informed the analysis. On the basis of participant feedback, we made iterative revisions to the mobile app between users. RESULTS:We conducted usability testing in 13 participants. The first version of the mobile app was used by the first 5 participants, and revised versions were used by the final 8 participants. From the first version to revised versions, task completion success rate improved from 44% (11/25 tasks) to 78% (31/40 tasks; P=.05), SUS improved from 54 to 76 (P=.04; scale 0-100, with 100 being the best usability), and self-reported likelihood of use remained high at 76 and 87 (P=.30; scale 0-100, with 100 being the highest likelihood). In interviews, patients expressed interest in tracking health measures ("I think it'll be good to track my exercise and to see what I'm doing"), a desire for introductory training ("Initially, training with a technical person, instead of me relying on myself"), and an expectation for sharing data with providers ("It would also be helpful to share with my doctor, it just being a matter of clicking a button and sharing it with my doctor"). CONCLUSIONS:With participant feedback and iterative revisions, we significantly improved the usability of a mobile app for CR. Patient expectations for using a mobile app for CR include tracking health metrics, introductory training, and sharing data with providers. Iterative mixed-method evaluation may be useful for improving the usability of health technology.

Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.

Project description:BackgroundBiofeedback is effective in treating migraines. It is believed to have a beneficial effect on autonomous nervous system activity and render individuals resilient to stressors that may trigger a migraine. However, widespread use of biofeedback is hampered by the need for a trained therapist and specialized equipment. Emerging digital health technology, including smartphones and wearables (mHealth), enables new ways of administering biofeedback. Currently, mHealth interventions for migraine appear feasible, but development processes and usability testing remain insufficient.ObjectiveThe objective of this study was to evaluate and improve the feasibility and usability of an mHealth biofeedback treatment app for adults with migraine.MethodsIn a prospective development and usability study, 18 adults with migraine completed a 4-week testing period of self-administered therapist-independent biofeedback treatment consisting of a smartphone app connected to wearable sensors (Cerebri, Nordic Brain Tech AS). The app included biofeedback training, instructions for self-delivery, and a headache diary. Two wearable sensors were used to measure surface electromyographic voltage at the trapezius muscle and peripheral skin temperature and heart rate at the right second fingertip. Participants were instructed to complete a daily headache diary entry and biofeedback session of 10 minutes duration. The testing period was preceded by a preusability expectation interview and succeeded by a postusability experience interview. In addition, an evaluation questionnaire was completed at weeks 2 and 4. Adherence was calculated as the proportion of 10-minute sessions completed within the first 28 days of treatment. Usability and feasibility were analyzed and summarized quantitatively and qualitatively.ResultsA total of 391 biofeedback sessions were completed with a median of 25 (IQR 17-28) per participant. The mean adherence rate was 0.76 (SD 0.26). The evaluation questionnaire revealed that functionality and design had the highest scores, whereas engagement and biofeedback were lower. Qualitative preexpectation analysis revealed that participants expected to become better familiar with physical signals and gain more understanding of their migraine attacks and noted that the app should be simple and understandable. Postusability analysis indicated that participants had an overall positive user experience with some suggestions for improvement regarding the design of the wearables and app content. The intervention was safe and tolerable. One case of prespecified adverse events was recorded in which a patient developed a skin rash from the sticky surface electromyography electrodes.ConclusionsThe app underwent a rigorous development process that indicated an overall positive user experience, good usability, and high adherence rate. This study highlights the value of usability testing in the development of mHealth apps.

Project description:BackgroundWorkplace bullying has been measured in many studies to investigate its effects on mental health issues. However, none have used web-based computerized adaptive testing (CAT) with bully classifications and convolutional neural networks (CNN) for reporting the extent of individual bullying in the workplace.ObjectiveThis study aims to build a model using CNN to develop an app for automatic detection and classification of nurse bullying-levels, incorporated with online Rasch computerized adaptive testing, to help assess nurse bullying at an earlier stage.MethodsWe recruited 960 nurses working in a Taiwan Ch-Mei hospital group to fill out the 22-item Negative Acts Questionnaire-Revised (NAQ-R) in August 2012. The k-mean and the CNN were used as unsupervised and supervised learnings, respectively, for: (1) dividing nurses into three classes (n=918, 29, and 13 with suspicious mild, moderate, and severe extent of being bullied, respectively); and (2) building a bully prediction model to estimate 69 different parameters. Finally, data were separated into training and testing sets in a proportion of 70:30, where the former was used to predict the latter. We calculated the sensitivity, specificity, and receiver operating characteristic curve (area under the curve [AUC]), along with the accuracy across studies for comparison. An app predicting the respondent bullying-level was developed, involving the model's 69 estimated parameters and the online Rasch CAT module as a website assessment.ResultsWe observed that: (1) the 22-item model yields higher accuracy rates for three categories, with an accuracy of 94% for the total 960 cases, and accuracies of 99% (AUC 0.99; 95% CI 0.99-1.00) and 83% (AUC 0.94; 95% CI 0.82-0.99) for the lower and upper groups (cutoff points at 49 and 66 points) based on the 947 cases and 42 cases, respectively; and (2) the 700-case training set, with 95% accuracy, predicts the 260-case testing set reaching an accuracy of 97. Thus, a NAQ-R app for nurses that predicts bullying-level was successfully developed and demonstrated in this study.ConclusionsThe 22-item CNN model, combined with the Rasch online CAT, is recommended for improving the accuracy of the nurse NAQ-R assessment. An app developed for helping nurses self-assess workplace bullying at an early stage is required for application in the future.

Project description:BackgroundThe Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) is a tailored, progressive exercise program for people having difficulties with wrist and hand function due to rheumatoid arthritis (RA). The program was evaluated in a large-scale clinical trial and was found to improve hand function, was safe to deliver, and was cost-effective. These findings led to the SARAH program being recommended in the UK National Institute for Health and Care Excellence guidelines for the management of adults with RA. To facilitate the uptake of this evidence-based program by clinicians, we proposed a Web-based training program for SARAH (iSARAH) to educate and train physiotherapists and occupational therapists on delivering the SARAH program in their practice. The overall iSARAH implementation project was guided by the 5 phases of the analysis, design, development, implementation, and evaluation (ADDIE) system design model.ObjectiveThe objective of our study was to conduct the first 3 phases of the model in the development of the iSARAH project.MethodsFollowing publication of the trial, the SARAH program materials were made available to therapists to download from the trial website for use in clinical practice. A total of 35 therapists who downloaded these materials completed an online survey to provide feedback on practice trends in prescribing hand exercises for people with RA, perceived barriers and facilitators to using the SARAH program in clinical practice, and their preferences for the content and Web features of iSARAH. The development and design of iSARAH were further guided by a team of multidisciplinary health professionals (n=17) who took part in a half-day development meeting. We developed the preliminary version of iSARAH and tested it among therapists (n=10) to identify and rectify usability issues and to produce the final version.ResultsThe major recommendations made by therapists and the multidisciplinary team were having a simple Web design and layout, clear exercise pictures and videos, and compatibility of iSARAH on various browsers and devices. We rectified all usability issues in the preliminary version to develop the final version of iSARAH, which included 4 short modules and additional sections on self-assessment, frequently asked questions, and a resource library.ConclusionsThe use of the ADDIE design model and engagement of end users in the development and evaluation phases have rendered iSARAH a convenient, easy-to-use, and effective Web-based learning resource for therapists on how to deliver the SARAH program. There is also huge potential for adapting iSARAH across different cultures and languages, thus opening more opportunities for wider uptake and application of the SARAH program into practice.

Project description:BACKGROUND:Patient-reported outcomes (PROs) translate subjective outcomes into objective data that can be quantified and analyzed. Nevertheless, the use of PROs in their traditional paper format is not practical for clinical practice due to limitations associated with the analysis and management of the data. To address the need for a viable way to group and utilize the main functioning assessment tools in the field of musculoskeletal disorders, the Physiotherapy Questionnaires app was developed. OBJECTIVE:This study aims to explain the development of the app, to validate it using two questionnaires, and to analyze whether participants prefer to use the app or the paper version of the questionnaires. METHODS:In the first stage, the app for an Android operational system was developed. In the second stage, the aim was to select questionnaires that were most often used in musculoskeletal clinical practice and research. The Foot and Ankle Outcome Score (FAOS) and American Orthopaedic Foot and Ankle Society (AOFAS) questionnaire were selected to validate the app. In total, 50 participants completed the paper and app versions of the AOFAS and 50 completed the FAOS. The study's outcomes were the correlation of the data between the paper and app versions as well as the preference of the participants between the two versions. RESULTS:The app was approved by experts after the adaptations of the layout for mobile phones and a total of 18 questionnaires were included in the app. Moreover, the app allows the generation of PDF and Excel files with the patients' data. In regards to validity, the mean of the total scores of the FAOS were 91.54% (SD 8.86%) for the paper version and 91.74% (SD 9.20%) for the app. There was no statistically significant differences in the means of the total scores or the subscales (P=.11-.94). The mean total scores for the AOFAS were 93.94 (SD 8.47) for the paper version and 93.96 (SD 8.48) for the app. No statistically significant differences were found for the total scores for the AOFAS or the subscales (P>.99). The app showed excellent agreement with the paper version of the FAOS, with an ICC value of 0.98 for the total score (95% CI 0.98-0.99), which was also found for the AOFAS with the ICC for the total score of 0.99 (95% CI 0.98-0.99). For compliance, 72% (36/50) of the participants in the FAOS group and 94% (47/50) in the AOFAS group preferred the app version. CONCLUSIONS:The Physiotherapy Questionnaires app showed validity and high levels of compliance for the FAOS and AOFAS, which indicates it is not inferior to the paper version of these two questionnaires and confirms its viability and feasibility for use in clinical practice.

Project description:BackgroundFalls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.ObjectiveThe aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.MethodsA fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.ResultsThere were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.ConclusionsOur fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.

Project description:BackgroundGlobally, the uptake of health screening is suboptimal, especially in men and those of younger age. In view of the increasing internet access and mobile phone ownership, ScreenMen, a mobile Web app, was developed to improve health screening uptake in men.ObjectiveThis study aimed to evaluate the utility and usability of ScreenMen.MethodsThis study used both qualitative and quantitative methods. Healthy men working in a banking institution were recruited to participate in this study. They were purposively sampled according to job position, age, education level, and screening status. Men were asked to use ScreenMen independently while the screen activities were being recorded. Once completed, retrospective think aloud with playback was conducted with men to obtain their feedback. They were asked to answer the System Usability Scale (SUS). Intention to undergo screening pre- and postintervention was also measured. Qualitative data were analyzed using a framework approach followed by thematic analysis. For quantitative data, the mean SUS score was calculated and change in intention to screening was analyzed using McNemar test.ResultsIn total, 24 men participated in this study. On the basis of the qualitative data, men found ScreenMen useful as they could learn more about their health risks and screening. They found ScreenMen convenient to use, which might trigger men to undergo screening. In terms of usability, men thought that ScreenMen was user-friendly and easy to understand. The key revision done on utility was the addition of a reminder function, whereas for usability, the revisions done were in terms of attracting and gaining users' trust, improving learnability, and making ScreenMen usable to all types of users. To attract men to use it, ScreenMen was introduced to users in terms of improving health instead of going for screening. Another important revision made was emphasizing the screening tests the users do not need, instead of just informing them about the screening tests they need. A Quick Assessment Mode was also added for users with limited attention span. The quantitative data showed that 8 out of 23 men (35%) planned to attend screening earlier than intended after using the ScreenMen. Furthermore, 4 out of 12 (33%) men who were in the precontemplation stage changed to either contemplation or preparation stage after using ScreenMen with P=.13. In terms of usability, the mean SUS score of 76.4 (SD 7.72) indicated that ScreenMen had good usability.ConclusionsThis study showed that ScreenMen was acceptable to men in terms of its utility and usability. The preliminary data suggested that ScreenMen might increase men's intention to undergo screening. This paper also presented key lessons learned from the beta testing, which is useful for public health experts and researchers when developing a user-centered mobile Web app.