Dataset Information

Usability and Preliminary Effectiveness of a Preoperative mHealth App for People Undergoing Major Surgery: Pilot Randomized Controlled Trial.

ABSTRACT:

Background

Major surgery is associated with negative postoperative outcomes such as complications and delayed or poor recovery. Multimodal prehabilitation can help to reduce the negative effects of major surgery. Offering prehabilitation by means of mobile health (mHealth) could be an effective new approach.

Objective

The objectives of this pilot study were to (1) evaluate the usability of the Be Prepared mHealth app prototype for people undergoing major surgery, (2) explore whether the app was capable of bringing about a change in risk behaviors, and (3) estimate a preliminary effect of the app on functional recovery after major surgery.

Methods

A mixed-methods pilot randomized controlled trial was conducted in two Dutch academic hospitals. In total, 86 people undergoing major surgery participated. Participants in the intervention group received access to the Be Prepared app, a smartphone app using behavior change techniques to address risk behavior prior to surgery. Both groups received care as usual. Usability (System Usability Scale), change in risk behaviors 3 days prior to surgery, and functional recovery 30 days after discharge from hospital (Patient-Reported Outcomes Measurement Information System physical functioning 8-item short form) were assessed using online questionnaires. Quantitative data were analyzed using descriptive statistics, chi-square tests, and multivariable linear regression. Semistructured interviews about the usability of the app were conducted with 12 participants in the intervention group. Thematic analysis was used to analyze qualitative data.

Results

Seventy-nine people-40 in the intervention group and 39 in the control group-were available for further analysis. Participants had a median age of 61 (interquartile range 51.0-68.0) years. The System Usability Scale showed that patients considered the Be Prepared app to have acceptable usability (mean 68.2 [SD 18.4]). Interviews supported the usability of the app. The major point of improvement identified was further personalization of the app. Compared with the control group, the intervention group showed an increase in self-reported physical activity and muscle strengthening activities prior to surgery. Also, 2 of 2 frequent alcohol users in the intervention group versus 1 of 9 in the control group drank less alcohol in the run-up to surgery. No difference was found in change of smoking cessation. Between-group analysis showed no meaningful differences in functional recovery after correction for baseline values (?=-2.4 [95% CI -5.9 to 1.1]).

Conclusions

The Be Prepared app prototype shows potential in terms of usability and changing risk behavior prior to major surgery. No preliminary effect of the app on functional recovery was found. Points of improvement have been identified with which the app and future research can be optimized.

Trial registration

Netherlands Trial Registry NL8623; https://www.trialregister.nl/trial/8623.

SUBMITTER: van der Velde M

PROVIDER: S-EPMC7819776 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Usability and Preliminary Effectiveness of a Preoperative mHealth App for People Undergoing Major Surgery: Pilot Randomized Controlled Trial.

van der Velde Miriam M Valkenet Karin K Geleijn Edwin E Kruisselbrink Marjoke M Marsman Marije M Janssen Liedewij Mj LM Ruurda Jelle P JP van der Peet Donald L DL Aarden Jesse J JJ Veenhof Cindy C van der Leeden Marike M

JMIR mHealth and uHealth 20210107 1

<h4>Background</h4>Major surgery is associated with negative postoperative outcomes such as complications and delayed or poor recovery. Multimodal prehabilitation can help to reduce the negative effects of major surgery. Offering prehabilitation by means of mobile health (mHealth) could be an effective new approach.<h4>Objective</h4>The objectives of this pilot study were to (1) evaluate the usability of the Be Prepared mHealth app prototype for people undergoing major surgery, (2) explore wheth ...[more]

PMID: 33410758

Similar Datasets

Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.

Project description:BackgroundMultiple sclerosis (MS) is a chronic, neurodegenerative disease that causes a range of motor, sensory, and cognitive symptoms. Due to these symptoms, people with MS are at a high risk for falls, fall-related injuries, and reductions in quality of life. There is no cure for MS, and managing symptoms and disease progression is important to maintain a high quality of life. Mobile health (mHealth) apps are commonly used by people with MS to help manage their health. However, there are limited health apps for people with MS designed to evaluate fall risk. A fall risk app can increase access to fall risk assessments and improve self-management. When designing mHealth apps, a user-centered approach is critical for improving use and adoption.ObjectiveThe purpose of this study is to undergo a user-centered approach to test and refine the usability of the app through an iterative design process.MethodsThe fall risk app Steady-MS is an extension of Steady, a fall risk app for older adults. Steady-MS consists of 2 components: a 25-item questionnaire about demographics and MS symptoms and 5 standing balance tasks. Data from the questionnaire and balance tasks were inputted into an algorithm to compute a fall risk score. Two iterations of semistructured interviews (n=5 participants per iteration) were performed to evaluate usability. People with MS used Steady-MS on a smartphone, thinking out loud. Interviews were recorded, transcribed, and developed into codes and themes. People with MS also completed the System Usability Scale.ResultsA total of 3 themes were identified: intuitive navigation, efficiency of use, and perceived value. Overall, the participants found Steady-MS efficient to use and useful to learn their fall risk score. There were challenges related to cognitive overload during the balance tasks. Modifications were made, and after the second iteration, people with MS reported that the app was intuitive and efficient. Average System Usability Scale scores were 95.5 in both iterations, representing excellent usability.ConclusionsSteady-MS is the first mHealth app for people with MS to assess their overall risk of falling and is usable by a subset of people with MS. People with MS found Steady-MS to be usable and useful for understanding their risk of falling. When developing future mHealth apps for people with MS, it is important to prevent cognitive overload through simple and clear instructions and present scores that are understood and interpreted correctly through visuals and text. These findings underscore the importance of user-centered design and provide a foundation for the future development of tools to assess and prevent scalable falls for people with MS. Future steps include understanding the validity of the fall risk algorithm and evaluating the clinical utility of the app.

Project description:BackgroundSwallowing difficulties (ie, dysphagia) are common among older adults, with a 13% to 54% prevalence. Adequate interventions to improve the swallowing function of older adults would reduce morbidity and enhance health-related quality of life outcomes. Mobile health (mHealth) apps may help alleviate dysphagia symptoms by providing programs that maximize the intensity and frequency of training without requiring high costs or regular clinic visits.ObjectiveThe aim of this pilot study was to assess the usability of swallowing training apps by quantitatively and qualitatively evaluating older adults' self-reported data, taking into consideration their educational levels and exposure to mobile technology. We conducted surveys and brief interviews while the participants used a swallowing intervention app we developed. We subsequently identified and resolved individual-specific usability issues to improve future implementation of the app protocol for older persons with swallowing difficulties.MethodsA total of 11 participants (10 women, 91%; mean age 75.7 years, SD 3.93) from two district-run senior welfare centers took part in this study. The participants were divided into a high-potential group and a low-potential group based on their total number of years of education and smart device usage. To investigate the usability of the app twice (ie, in the second week of the intervention and the postintervention stage), we used mixed methods consisting of both quantitative approaches, namely the System Usability Scale (SUS) and modified Computer Self-Efficacy Scale (mCSES) surveys, and qualitative approaches (ie, interviews).ResultsThe quantitative results of the SUS and mCSES surveys revealed that the high-potential group was more inclined to adopt and learn new technology than the low-potential group. Specifically, within the high-potential group, a Wilcoxon signed-rank test indicated that the postintervention mCSES scores (median 65.50) were significantly higher than those in the second week of intervention (median 54.00; z=-2.023, P=.04). Additionally, the usability scores in the low-potential group were within the "marginal acceptability" range even after completion of an 8-week intervention program. Qualitative analyses via semi-structured interviews yielded promising outcomes regarding app acceptability, training program utilization, emotional responses, and learning experience.ConclusionsTo the best of the authors' knowledge, this usability and feasibility study is the first report of a swallowing training app designed to improve the swallowing function of older adults. Future research should consider several issues, such as user characteristics, pretraining education, and the intensity and innate characteristics of the intervention program.

Project description:BackgroundFalls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.ObjectiveThe aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.MethodsA fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.ResultsThere were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.ConclusionsOur fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.

Project description:BackgroundHip and knee osteoarthritis (OA) are highly prevalent worldwide. The guidelines recommend physical activity and education as the core treatments for osteoarthritis. Digital health has the potential to engage people in physical activity and disease management. Therefore, we conducted a pilot trial to assess the usability and preliminary effectiveness of an app-based physical activity and education program (Join2Move) compared to usual care for people with hip and/or knee OA in Germany.MethodsA randomized controlled pilot study was conducted. Individuals with diagnosed or self-reported knee and hip OA were included. Allocation to the intervention or control group was randomized. The intervention group received the Join2Move program. The Join2Move program was previously developed as a website and evaluated in the Netherlands. For the current study, the program was translated and adapted to the German context and adjusted from a website to an app. The control group received usual care. The primary outcomes were usability and preliminary effectiveness (pain and physical functioning). Measurements were taken at baseline and at twelve weeks. The data analysis was performed using SPSS (IBM SPSS Statistics 29.0).ResultsSixty participants, with a mean age of 61.9 (SD ± 7.2) years, were allocated to the intervention (n = 32) or the control group (n = 28) and included in the analysis. The majority of participants had knee OA (68%), and 12% had hip and knee OA. The dropout rate was n = 11 (18%). No adverse events were reported. Usability was rated as acceptable (mean System Usability Scale = 71.3/100) with a wide range (32.5 to 100). Statistically significant between-group differences were found only for pain (mean difference 8.52 (95% CI 1.01 to 16.04), p = 0.027).ConclusionsJoin2Move demonstrated acceptable usability. The preliminary results of the pilot trial indicate the potential of a stand-alone app for the treatment of patients with hip or knee OA. However, the acceptable usability of Join2Move limits its recommendation for everyone. There appears to be room for improvement in app usability and in identifying patients for whom the app is suitable and the right time to use a stand-alone app.Trial registrationGerman Clinical Trials Register DRKS00027164 .

Project description:ObjectiveTo establish the feasibility and acceptability of a preoperative exercise program, and to obtain pilot data on the likely difference in key surgical outcomes to inform the sample size calculation for a full-scale trial.DesignPilot randomized controlled trial.SettingRoyal Prince Alfred Hospital, Sydney, Australia.SubjectsWe included patients undergoing elective pelvic exenteration or cytoreductive surgery aged 18 to 80 years, who presented to the participating gastrointestinal surgeon at least 2 weeks prior to surgery. Patients presenting cognitive impairment, co-morbidity preventing participation in exercise, inadequate English language, currently participating in an exercise program or unable to attend the exercise program sessions were excluded.MethodsParticipants were randomized to a 2-6 weeks preoperative, face-to-face, individualised exercise program or to usual care. Feasibility was assessed with consent rates to the study, and for the intervention group, retention and adherence rates to the preoperative exercise program. Acceptability of the exercise program was assessed with a semi-structured questionnaire exploring the advice received and the amount, duration and intensity of the exercise program. In addition, postoperative complication rates (Clavien-Dindo), length of hospital stay and self-reported measures of health-related quality of life (SF-36v2) were collected at baseline, day before surgery and in-hospital up to discharge from hospital.ResultsOf 122 patients screened, 26 (21%) were eligible and 22 (85%) accepted to participate in the trial and were randomized to the intervention (11; 50%) or control group (11; 50%). The median age of the include participants was 63 years. Adherence to the preoperative exercise sessions was 92.7%, with all participants either satisfied (33%) or extremely satisfied (67%) with the overall design of the preoperative exercise program. No significant differences in outcomes were found between groups.ConclusionsThe results of our pilot trial demonstrate that a preoperative exercise program is feasible and acceptable to patients undergoing major abdominal cancer surgery. There is an urgent need for a definite trial investigating the effectiveness of a preoperative exercise program on postoperative outcomes in patients undergoing major abdominal cancer surgery. This could potentially reduce postoperative complication rates, length of hospital stay and subsequently overall health care costs.Trial registrationACTRN12617001129370. Registered on August 1, 2017, https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=373396&showOriginal=true&isReview=true.

Project description:Pre-eclampsia is one of the leading causes of maternal death and morbidity in low-resource countries due to delays in case identification and a shortage of health workers trained to manage the disorder. Pre-eclampsia Integrated Estimate of RiSk (PIERS) on the Move (PotM) is a low cost, easy-to-use, mobile health (mHealth) platform that has been created to aid health workers in making decisions around the management of hypertensive pregnant women. PotM combines two previously successful innovations into a mHealth app: the miniPIERS risk assessment model and the Phone Oximeter.The aim of this study was to assess the usability of PotM (with mid-level health workers) for iteratively refining the system.Development of the PotM user interface involved usability testing with target end-users in South Africa. Users were asked to complete clinical scenario tasks, speaking aloud to give feedback on the interface and then complete a questionnaire. The tool was then evaluated in a pilot clinical evaluation in Tygerberg Hospital, Cape Town.After ethical approval and informed consent, 37 nurses and midwives evaluated the tool. During Study 1, major issues in the functionality of the touch-screen keyboard and date scroll wheels were identified (total errors n=212); during Study 2 major improvements in navigation of the app were suggested (total errors n=144). Overall, users felt the app was usable using the Computer Systems Usability Questionnaire; median (range) values for Study 1 = 2 (1-6) and Study 2 = 1 (1-7). To demonstrate feasibility, PotM was used by one research nurse for the pilot clinical study. In total, more than 500 evaluations were performed on more than 200 patients. The median (interquartile range) time to complete an evaluation was 4 min 55 sec (3 min 25 sec to 6 min 56 sec).By including target end-users in the design and evaluation of PotM, we have developed an app that can be easily integrated into health care settings in low- and middle-income countries. Usability problems were often related to mobile phone features (eg, scroll wheels, touch screen use). Larger scale evaluation of the clinical impact of this tool is underway.

Project description:BackgroundMobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients' health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness.ObjectiveThis study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia.MethodsForward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app.ResultsThe content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app.ConclusionsThe M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

Dataset Information

Usability and Preliminary Effectiveness of a Preoperative mHealth App for People Undergoing Major Surgery: Pilot Randomized Controlled Trial.

Background

Objective

Methods

Results

Conclusions

Trial registration

Publications

Usability and Preliminary Effectiveness of a Preoperative mHealth App for People Undergoing Major Surgery: Pilot Randomized Controlled Trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets