Dataset Information

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

ABSTRACT: People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations).This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation.Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach.During testing of the app's effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial.A multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis).

SUBMITTER: Thirumalai M

PROVIDER: S-EPMC5992455 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

Thirumalai Mohanraj M Rimmer James H JH Johnson George G Wilroy Jereme J Young Hui-Ju HJ Mehta Tapan T Lai Byron B

JMIR mHealth and uHealth 20180524 5

<h4>Background</h4>People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with m ...[more]

PMID: 29798832

Similar Datasets

Project description:BackgroundMultiple sclerosis (MS) is a chronic, neurodegenerative disease that causes a range of motor, sensory, and cognitive symptoms. Due to these symptoms, people with MS are at a high risk for falls, fall-related injuries, and reductions in quality of life. There is no cure for MS, and managing symptoms and disease progression is important to maintain a high quality of life. Mobile health (mHealth) apps are commonly used by people with MS to help manage their health. However, there are limited health apps for people with MS designed to evaluate fall risk. A fall risk app can increase access to fall risk assessments and improve self-management. When designing mHealth apps, a user-centered approach is critical for improving use and adoption.ObjectiveThe purpose of this study is to undergo a user-centered approach to test and refine the usability of the app through an iterative design process.MethodsThe fall risk app Steady-MS is an extension of Steady, a fall risk app for older adults. Steady-MS consists of 2 components: a 25-item questionnaire about demographics and MS symptoms and 5 standing balance tasks. Data from the questionnaire and balance tasks were inputted into an algorithm to compute a fall risk score. Two iterations of semistructured interviews (n=5 participants per iteration) were performed to evaluate usability. People with MS used Steady-MS on a smartphone, thinking out loud. Interviews were recorded, transcribed, and developed into codes and themes. People with MS also completed the System Usability Scale.ResultsA total of 3 themes were identified: intuitive navigation, efficiency of use, and perceived value. Overall, the participants found Steady-MS efficient to use and useful to learn their fall risk score. There were challenges related to cognitive overload during the balance tasks. Modifications were made, and after the second iteration, people with MS reported that the app was intuitive and efficient. Average System Usability Scale scores were 95.5 in both iterations, representing excellent usability.ConclusionsSteady-MS is the first mHealth app for people with MS to assess their overall risk of falling and is usable by a subset of people with MS. People with MS found Steady-MS to be usable and useful for understanding their risk of falling. When developing future mHealth apps for people with MS, it is important to prevent cognitive overload through simple and clear instructions and present scores that are understood and interpreted correctly through visuals and text. These findings underscore the importance of user-centered design and provide a foundation for the future development of tools to assess and prevent scalable falls for people with MS. Future steps include understanding the validity of the fall risk algorithm and evaluating the clinical utility of the app.

Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.

Project description:BackgroundFalls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.ObjectiveThe aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.MethodsA fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.ResultsThere were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.ConclusionsOur fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.

Project description:Pre-eclampsia is one of the leading causes of maternal death and morbidity in low-resource countries due to delays in case identification and a shortage of health workers trained to manage the disorder. Pre-eclampsia Integrated Estimate of RiSk (PIERS) on the Move (PotM) is a low cost, easy-to-use, mobile health (mHealth) platform that has been created to aid health workers in making decisions around the management of hypertensive pregnant women. PotM combines two previously successful innovations into a mHealth app: the miniPIERS risk assessment model and the Phone Oximeter.The aim of this study was to assess the usability of PotM (with mid-level health workers) for iteratively refining the system.Development of the PotM user interface involved usability testing with target end-users in South Africa. Users were asked to complete clinical scenario tasks, speaking aloud to give feedback on the interface and then complete a questionnaire. The tool was then evaluated in a pilot clinical evaluation in Tygerberg Hospital, Cape Town.After ethical approval and informed consent, 37 nurses and midwives evaluated the tool. During Study 1, major issues in the functionality of the touch-screen keyboard and date scroll wheels were identified (total errors n=212); during Study 2 major improvements in navigation of the app were suggested (total errors n=144). Overall, users felt the app was usable using the Computer Systems Usability Questionnaire; median (range) values for Study 1 = 2 (1-6) and Study 2 = 1 (1-7). To demonstrate feasibility, PotM was used by one research nurse for the pilot clinical study. In total, more than 500 evaluations were performed on more than 200 patients. The median (interquartile range) time to complete an evaluation was 4 min 55 sec (3 min 25 sec to 6 min 56 sec).By including target end-users in the design and evaluation of PotM, we have developed an app that can be easily integrated into health care settings in low- and middle-income countries. Usability problems were often related to mobile phone features (eg, scroll wheels, touch screen use). Larger scale evaluation of the clinical impact of this tool is underway.

Project description:BackgroundMobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients' health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness.ObjectiveThis study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia.MethodsForward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app.ResultsThe content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app.ConclusionsThe M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

Project description:BackgroundThe experience of infertility and its treatment engenders considerable stress and is often described as an emotional rollercoaster. A mobile health (mHealth) app may be a novel solution to address the psychoeducational and psychosocial support needs of fertility patients because of its potential to reduce stress and increase patient empowerment. There are a few fertility-related apps that provide information and support to both men and women undergoing fertility treatment; however, none have documented their development and evaluation process.ObjectiveThis study aims to describe the development and evaluation process of a bilingual mHealth app, Infotility, designed to meet the psychoeducational and psychosocial support needs of men and women undergoing fertility treatment.MethodsTo develop the Infotility app, we adhered to the Medical Research Council guidelines for the development and evaluation of complex interventions. First, we conducted literature reviews and needs assessment surveys of fertility patients and health care providers who informed the content and design of the app. Second, we tested the intervention with a small group of end users who provided feedback on the design and appropriateness of the app's content. Third, we evaluated the uptake and usability of the app using a pre-post study design. Finally, we updated the app's content based on participants' feedback and searched for partners to disseminate the app to the broader public.ResultsThis study is the first to describe the development and evaluation process of an mHealth app for men and women undergoing fertility treatment. The app met its goal in providing fertility patients with a clinician-approved, portable resource for reliable information about medical and psychosocial aspects of infertility and its treatments and a confidential peer support forum monitored by trained peer supporters. Participants rated the engagement, functionality, information, and esthetics of the app positively, with an overall app quality mean score of 3.75 (SD 0.53) and a star rating of 3.43 (SD 0.75), with a total possible score and star rating of 5.00.ConclusionsBy documenting the systematic development and evaluation of the mHealth app for men and women undergoing fertility treatment, this paper can facilitate the replication of the study intervention and the development of similar mHealth apps.

Project description:BackgroundFollowing the need for the prevention of noncommunicable diseases, mobile health (mHealth) apps are increasingly used for promoting lifestyle behavior changes. Although mHealth apps have the potential to reach all population segments, providing accessible and personalized services, their effectiveness is often limited by low participant engagement and high attrition rates.ObjectiveThis study concerns a large-scale, open-access mHealth app, based in the Netherlands, focused on improving the lifestyle behaviors of its participants. The study examines whether periodic email prompts increased participant engagement with the mHealth app and how this effect evolved over time. Points gained from the activities in the app were used as an objective measure of participant engagement with the program. The activities considered were physical workouts tracked through the mHealth app and interactions with the web-based coach.MethodsThe data analyzed covered 22,797 unique participants over a period of 78 weeks. A hidden Markov model (HMM) was used for disentangling the overtime effects of periodic email prompts on participant engagement with the mHealth app. The HMM accounted for transitions between latent activity states, which generated the observed measure of points received in a week.ResultsThe HMM indicated that, on average, 70% (15,958/22,797) of the participants were in the inactivity state, gaining 0 points in total per week; 18% (4103/22,797) of the participants were in the average activity state, gaining 27 points per week; and 12% (2736/22,797) of the participants were in the high activity state, gaining 182 points per week. Receiving and opening a generic email was associated with a 3 percentage point increase in the likelihood of becoming active in that week, compared with the weeks when no email was received. Examining detailed email categories revealed that the participants were more likely to increase their activity level following emails that were in line with the program's goal, such as emails regarding health campaigns, while being resistant to emails that deviated from the program's goal, such as emails regarding special deals.ConclusionsParticipant engagement with a behavior change mHealth app can be positively influenced by email prompts, albeit to a limited extent. Given the relatively low costs associated with emails and the high population reach that mHealth apps can achieve, such instruments can be a cost-effective means of increasing participant engagement in the stride toward improving program effectiveness.

Project description:BackgroundSwallowing difficulties (ie, dysphagia) are common among older adults, with a 13% to 54% prevalence. Adequate interventions to improve the swallowing function of older adults would reduce morbidity and enhance health-related quality of life outcomes. Mobile health (mHealth) apps may help alleviate dysphagia symptoms by providing programs that maximize the intensity and frequency of training without requiring high costs or regular clinic visits.ObjectiveThe aim of this pilot study was to assess the usability of swallowing training apps by quantitatively and qualitatively evaluating older adults' self-reported data, taking into consideration their educational levels and exposure to mobile technology. We conducted surveys and brief interviews while the participants used a swallowing intervention app we developed. We subsequently identified and resolved individual-specific usability issues to improve future implementation of the app protocol for older persons with swallowing difficulties.MethodsA total of 11 participants (10 women, 91%; mean age 75.7 years, SD 3.93) from two district-run senior welfare centers took part in this study. The participants were divided into a high-potential group and a low-potential group based on their total number of years of education and smart device usage. To investigate the usability of the app twice (ie, in the second week of the intervention and the postintervention stage), we used mixed methods consisting of both quantitative approaches, namely the System Usability Scale (SUS) and modified Computer Self-Efficacy Scale (mCSES) surveys, and qualitative approaches (ie, interviews).ResultsThe quantitative results of the SUS and mCSES surveys revealed that the high-potential group was more inclined to adopt and learn new technology than the low-potential group. Specifically, within the high-potential group, a Wilcoxon signed-rank test indicated that the postintervention mCSES scores (median 65.50) were significantly higher than those in the second week of intervention (median 54.00; z=-2.023, P=.04). Additionally, the usability scores in the low-potential group were within the "marginal acceptability" range even after completion of an 8-week intervention program. Qualitative analyses via semi-structured interviews yielded promising outcomes regarding app acceptability, training program utilization, emotional responses, and learning experience.ConclusionsTo the best of the authors' knowledge, this usability and feasibility study is the first report of a swallowing training app designed to improve the swallowing function of older adults. Future research should consider several issues, such as user characteristics, pretraining education, and the intensity and innate characteristics of the intervention program.

Dataset Information

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

Publications

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets