Dataset Information

Satisfaction, Usability, and Compliance With the Use of Smartwatches for Ecological Momentary Assessment of Knee Osteoarthritis Symptoms in Older Adults: Usability Study.

ABSTRACT:

Background

Smartwatches enable physicians to monitor symptoms in patients with knee osteoarthritis, their behavior, and their environment. Older adults experience fluctuations in their pain and related symptoms (mood, fatigue, and sleep quality) that smartwatches are ideally suited to capture remotely in a convenient manner.

Objective

The aim of this study was to evaluate satisfaction, usability, and compliance using the real-time, online assessment and mobility monitoring (ROAMM) mobile app designed for smartwatches for individuals with knee osteoarthritis.

Methods

Participants (N=28; mean age 73.2, SD 5.5 years; 70% female) with reported knee osteoarthritis were asked to wear a smartwatch with the ROAMM app installed. They were prompted to report their prior night's sleep quality in the morning, followed by ecological momentary assessments (EMAs) of their pain, fatigue, mood, and activity in the morning, afternoon, and evening. Satisfaction, comfort, and usability were evaluated using a standardized questionnaire. Compliance with regard to answering EMAs was calculated after excluding time when the watch was not being worn for technical reasons (eg, while charging).

Results

A majority of participants reported that the text displayed was large enough to read (22/26, 85%), and all participants found it easy to enter ratings using the smartwatch. Approximately half of the participants found the smartwatch to be comfortable (14/26, 54%) and would consider wearing it as their personal watch (11/24, 46%). Most participants were satisfied with its battery charging system (20/26, 77%). A majority of participants (19/26, 73%) expressed their willingness to use the ROAMM app for a 1-year research study. The overall EMA compliance rate was 83% (2505/3036 responses). The compliance rate was lower among those not regularly wearing a wristwatch (10/26, 88% vs 16/26, 71%) and among those who found the text too small to read (4/26, 86% vs 22/26, 60%).

Conclusions

Older adults with knee osteoarthritis positively rated the ROAMM smartwatch app and were generally satisfied with the device. The high compliance rates coupled with the willingness to participate in a long-term study suggest that the ROAMM app is a viable approach to remotely collecting health symptoms and behaviors for both research and clinical endeavors.

SUBMITTER: Rouzaud Laborde C

PROVIDER: S-EPMC8319786 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe Knee OsteoArthritis, Linking Activity and Pain (KOALAP) study is the first to test the feasibility of using consumer-grade cellular smartwatches for health care research.ObjectiveThe overall aim was to investigate the feasibility of using consumer-grade cellular smartwatches as a novel tool to capture data on pain (multiple times a day) and physical activity (continuously) in patients with knee osteoarthritis. Additionally, KOALAP aimed to investigate smartwatch sensor data quality and assess whether engagement, acceptability, and user experience are sufficient for future large-scale observational and interventional studies.MethodsA total of 26 participants with self-diagnosed knee osteoarthritis were recruited in September 2017. All participants were aged 50 years or over and either lived in or were willing to travel to the Greater Manchester area. Participants received a smartwatch (Huawei Watch 2) with a bespoke app that collected patient-reported outcomes via questionnaires and continuous watch sensor data. All data were collected daily for 90 days. Additional data were collected through interviews (at baseline and follow-up) and baseline and end-of-study questionnaires. This study underwent full review by the University of Manchester Research Ethics Committee (#0165) and University Information Governance (#IGRR000060). For qualitative data analysis, a system-level security policy was developed in collaboration with the University Information Governance Office. Additionally, the project underwent an internal review process at Google, including separate reviews of accessibility, product engineering, privacy, security, legal, and protection regulation compliance.ResultsParticipants were recruited in September 2017. Data collection via the watches was completed in January 2018. Collection of qualitative data through patient interviews is still ongoing. Data analysis will commence when all data are collected; results are expected in 2019.ConclusionsKOALAP is the first health study to use consumer cellular smartwatches to collect self-reported symptoms alongside sensor data for musculoskeletal disorders. The results of this study will be used to inform the design of future mobile health studies. Results for feasibility and participant motivations will inform future researchers whether or under which conditions cellular smartwatches are a useful tool to collect patient-reported outcomes alongside passively measured patient behavior. The exploration of associations between self-reported symptoms at different moments will contribute to our understanding of whether it may be valuable to collect symptom data more frequently. Sensor data-quality measurements will indicate whether cellular smartwatch usage is feasible for obtaining sensor data. Methods for data-quality assessment and data-processing methods may be reusable, although generalizability to other clinical areas should be further investigated.International registered report identifier (irrid)DERR1-10.2196/10238.

Project description:BackgroundMobile device-based ecological momentary assessment (mobile-EMA) is increasingly used to collect participants' data in real-time and in context. Although EMA offers methodological advantages, these advantages can be diminished by participant noncompliance. However, evidence on how well participants comply with mobile-EMA protocols and how study design factors associated with participant compliance is limited, especially in the youth literature.ObjectiveTo systematically and meta-analytically examine youth's compliance to mobile-EMA protocols and moderators of participant compliance in clinical and nonclinical settings.MethodsStudies using mobile devices to collect EMA data among youth (age ?18 years old) were identified. A systematic review was conducted to describe the characteristics of mobile-EMA protocols and author-reported factors associated with compliance. Random effects meta-analyses were conducted to estimate the overall compliance across studies and to explore factors associated with differences in youths' compliance.ResultsThis review included 42 unique studies that assessed behaviors, subjective experiences, and contextual information. Mobile phones were used as the primary mode of EMA data collection in 48% (20/42) of the reviewed studies. In total, 12% (5/42) of the studies used wearable devices in addition to the EMA data collection platforms. About half of the studies (62%, 24/42) recruited youth from nonclinical settings. Most (98%, 41/42) studies used a time-based sampling protocol. Among these studies, most (95%, 39/41) prompted youth 2-9 times daily, for a study length ranging from 2-42 days. Sampling frequency and study length did not differ between studies with participants from clinical versus nonclinical settings. Most (88%, 36/41) studies with a time-based sampling protocol defined compliance as the proportion of prompts to which participants responded. In these studies, the weighted average compliance rate was 78.3%. The average compliance rates were not different between studies with clinical (76.9%) and nonclinical (79.2%; P=.29) and studies that used only a mobile-EMA platform (77.4%) and mobile platform plus additional wearable devices (73.0%, P=.36). Among clinical studies, the mean compliance rate was significantly lower in studies that prompted participants 2-3 times (73.5%) or 4-5 times (66.9%) compared with studies with a higher sampling frequency (6+ times: 89.3%). Among nonclinical studies, a higher average compliance rate was observed in studies that prompted participants 2-3 times daily (91.7%) compared with those that prompted participants more frequently (4-5 times: 77.4%; 6+ times: 75.0%). The reported compliance rates did not differ by duration of EMA period among studies from either clinical or nonclinical settings.ConclusionsThe compliance rate among mobile-EMA studies in youth is moderate but suboptimal. Study design may affect protocol compliance differently between clinical and nonclinical participants; including additional wearable devices did not affect participant compliance. A more consistent compliance-related result reporting practices can facilitate understanding and improvement of participant compliance with EMA data collection among youth.

Project description:BackgroundStudies that use ecological momentary assessments (EMAs) or wearable sensors to track numerous attributes, such as physical activity, sleep, and heart rate, can benefit from reductions in missing data. Maximizing compliance is one method of reducing missing data to increase the return on the heavy investment of time and money into large-scale studies.ObjectiveThis paper aims to identify the extent to which compliance can be prospectively predicted from individual attributes and initial compliance.MethodsWe instrumented 757 information workers with fitness trackers for 1 year and conducted EMAs in the first 56 days of study participation as part of an observational study. Their compliance with the EMA and fitness tracker wearing protocols was analyzed. Overall, 31 individual characteristics (eg, demographics and personalities) and behavioral variables (eg, early compliance and study portal use) were considered, and 14 variables were selected to create beta regression models for predicting compliance with EMAs 56 days out and wearable compliance 1 year out. We surveyed study participation and correlated the results with compliance.ResultsOur modeling indicates that 16% and 25% of the variance in EMA compliance and wearable compliance, respectively, could be explained through a survey of demographics and personality in a held-out sample. The likelihood of higher EMA and wearable compliance was associated with being older (EMA: odds ratio [OR] 1.02, 95% CI 1.00-1.03; wearable: OR 1.02, 95% CI 1.01-1.04), speaking English as a first language (EMA: OR 1.38, 95% CI 1.05-1.80; wearable: OR 1.39, 95% CI 1.05-1.85), having had a wearable before joining the study (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.50, 95% CI 1.23-1.83), and exhibiting conscientiousness (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.34, 95% CI 1.14-1.58). Compliance was negatively associated with exhibiting extraversion (EMA: OR 0.74, 95% CI 0.64-0.85; wearable: OR 0.67, 95% CI 0.57-0.78) and having a supervisory role (EMA: OR 0.65, 95% CI 0.54-0.79; wearable: OR 0.66, 95% CI 0.54-0.81). Furthermore, higher wearable compliance was negatively associated with agreeableness (OR 0.68, 95% CI 0.56-0.83) and neuroticism (OR 0.85, 95% CI 0.73-0.98). Compliance in the second week of the study could help explain more variance; 62% and 66% of the variance in EMA compliance and wearable compliance, respectively, was explained. Finally, compliance correlated with participants' self-reflection on the ease of participation, usefulness of our compliance portal, timely resolution of issues, and compensation adequacy, suggesting that these are avenues for improving compliance.ConclusionsWe recommend conducting an initial 2-week pilot to measure trait-like compliance and identify participants at risk of long-term noncompliance, performing oversampling based on participants' individual characteristics to avoid introducing bias in the sample when excluding data based on noncompliance, using an issue tracking portal, and providing special care in troubleshooting to help participants maintain compliance.