Dataset Information

Going Remote-Demonstration and Evaluation of Remote Technology Delivery and Usability Assessment With Older Adults: Survey Study.

ABSTRACT:

Background

The COVID-19 pandemic necessitated "going remote" with the delivery, support, and assessment of a study intervention targeting older adults enrolled in a clinical trial. While remotely delivering and assessing technology is not new, there are few methods available in the literature that are proven to be effective with diverse populations, and none for older adults specifically. Older adults comprise a diverse population, including in terms of their experience with and access to technology, making this a challenging endeavor.

Objective

Our objective was to remotely deliver and conduct usability testing for a mobile health (mHealth) technology intervention for older adult participants enrolled in a clinical trial of the technology. This paper describes the methodology used, its successes, and its limitations.

Methods

We developed a conceptual model for remote operations, called the Framework for Agile and Remote Operations (FAR Ops), that combined the general requirements for spaceflight operations with Agile project management processes to quickly respond to this challenge. Using this framework, we iteratively created care packages that differed in their contents based on participant needs and were sent to study participants to deliver the study intervention-a medication management app-and assess its usability. Usability data were collected using the System Usability Scale (SUS) and a novel usability questionnaire developed to collect more in-depth data.

Results

In the first 6 months of the project, we successfully delivered 21 care packages. We successfully designed and deployed a minimum viable product in less than 6 weeks, generally maintained a 2-week sprint cycle, and achieved a 40% to 50% return rate for both usability assessment instruments. We hypothesize that lack of engagement due to the pandemic and our use of asynchronous communication channels contributed to the return rate of usability assessments being lower than desired. We also provide general recommendations for performing remote usability testing with diverse populations based on the results of our work, including implementing screen sharing capabilities when possible, and determining participant preference for phone or email communications.

Conclusions

The FAR Ops model allowed our team to adopt remote operations for our mHealth trial in response to interruptions from the COVID-19 pandemic. This approach can be useful for other research or practice-based projects under similar circumstances or to improve efficiency, cost, effectiveness, and participant diversity in general. In addition to offering a replicable approach, this paper tells the often-untold story of practical challenges faced by mHealth projects and practical strategies used to address them.

Trial registration

ClinicalTrials.gov NCT04121858; https://clinicaltrials.gov/ct2/show/NCT04121858.

SUBMITTER: Hill JR

PROVIDER: S-EPMC7935399 | biostudies-literature | 2021 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Going Remote-Demonstration and Evaluation of Remote Technology Delivery and Usability Assessment With Older Adults: Survey Study.

Hill Jordan R JR Harrington Addison B AB Adeoye Philip P Campbell Noll L NL Holden Richard J RJ

JMIR mHealth and uHealth 20210304 3

<h4>Background</h4>The COVID-19 pandemic necessitated "going remote" with the delivery, support, and assessment of a study intervention targeting older adults enrolled in a clinical trial. While remotely delivering and assessing technology is not new, there are few methods available in the literature that are proven to be effective with diverse populations, and none for older adults specifically. Older adults comprise a diverse population, including in terms of their experience with and access t ...[more]

PMID: 33606655

Similar Datasets

Project description:BackgroundTele-exercise has emerged as a means for older adults to participate in group exercise during the COVID-19 pandemic. However, little is known about the technology support needs of older adults for accessing tele-exercise.ObjectiveThis study aims to examine the needs of older adults for transition to tele-exercise, identify barriers to and facilitators of tele-exercise uptake and continued participation, and describe technology support challenges and successes encountered by older adults starting tele-exercise.MethodsWe used an exploratory, sequential mixed methods study design. Participants were older adults with symptomatic knee osteoarthritis (N=44) who started participating in a remotely delivered program called Enhance Fitness. Before the start of the classes, a subsample of the participants (n=10) completed semistructured phone interviews about their technology support needs and the barriers to and facilitators for technology adoption. All of the participants completed the surveys including the Senior Technology Acceptance Model scale and a technology needs assessment. The study team recorded the technology challenges encountered and the attendance rates for 48 sessions delivered over 16 weeks.ResultsFour themes emerged from the interviews: participants desire features in a tele-exercise program that foster accountability, direct access to helpful people who can troubleshoot and provide guidance with technology is important, opportunities to participate in high-value activities motivate willingness to persevere through the technology concerns, and belief in the ability to learn new things supersedes technology-related frustration. Among the participants in the tele-exercise classes (mean age 74, SD 6.3 years; 38/44, 86% female; mean 2.5, SD 0.9 chronic conditions), 71% (31/44) had a computer with a webcam, but 41% (18/44) had little or no experience with videoconferencing. The initial technology orientation sessions lasted on average 19.3 (SD 10.3) minutes, and 24% (11/44) required a follow-up assistance call. During the first 2 weeks of tele-exercise, 47% of participants (21/44) required technical assistance, which decreased to 12% (5/44) during weeks 3 to 16. The median attendance was 100% for the first 6 sessions and 93% for the subsequent 42 sessions.ConclusionsWith appropriate support, older adults can successfully participate in tele-exercise. Recommendations include individualized technology orientation sessions, experiential learning, and availability of standby technical assistance, particularly during the first 2 weeks of classes. Continued development of best practices in this area may allow previously hard-to-reach populations of older adults to participate in health-enhancing, evidence-based exercise programs.

Project description:BackgroundThe popularity of yoga and the understanding of its potential health benefits have recently increased. Unfortunately, not everyone can easily engage in in-person yoga classes. Over the past decade, the use of remotely delivered yoga has increased in real-world applications. However, the state of the related scientific literature is unclear.ObjectiveThis scoping review aimed to identify gaps in the literature related to the remote delivery of yoga interventions, including gaps related to the populations studied, the yoga intervention characteristics (delivery methods and intervention components implemented), the safety and feasibility of the interventions, and the preliminary efficacy of the interventions.MethodsThis scoping review was conducted in accordance with the PRISMA-ScR (Preferred Reporting Item for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Scientific databases were searched throughout April 2021 for experimental studies involving yoga delivered through technology. Eligibility was assessed through abstract and title screening and a subsequent full-article review. The included articles were appraised for quality, and data were extracted from each article.ResultsA total of 12 studies of weak to moderate quality were included. Populations varied in physical and mental health status. Of the 12 studies, 10 (83%) implemented asynchronous delivery methods (via prerecorded material), 1 (8%) implemented synchronous delivery methods (through videoconferencing), and 1 (8%) did not clearly describe the delivery method. Yoga interventions were heterogeneous in style and prescribed dose but primarily included yoga intervention components of postures, breathing, and relaxation and meditation. Owing to the heterogeneous nature of the included studies, conclusive findings regarding the preliminary efficacy of the interventions could not be ascertained.ConclusionsSeveral gaps in the literature were identified. Overall, this review showed that more attention needs to be paid to yoga intervention delivery methods while designing studies and developing interventions. Decisions regarding delivery methods should be justified and not made arbitrarily. Studies of high methodological rigor and robust reporting are needed.

Project description:BackgroundSmartwatches enable physicians to monitor symptoms in patients with knee osteoarthritis, their behavior, and their environment. Older adults experience fluctuations in their pain and related symptoms (mood, fatigue, and sleep quality) that smartwatches are ideally suited to capture remotely in a convenient manner.ObjectiveThe aim of this study was to evaluate satisfaction, usability, and compliance using the real-time, online assessment and mobility monitoring (ROAMM) mobile app designed for smartwatches for individuals with knee osteoarthritis.MethodsParticipants (N=28; mean age 73.2, SD 5.5 years; 70% female) with reported knee osteoarthritis were asked to wear a smartwatch with the ROAMM app installed. They were prompted to report their prior night's sleep quality in the morning, followed by ecological momentary assessments (EMAs) of their pain, fatigue, mood, and activity in the morning, afternoon, and evening. Satisfaction, comfort, and usability were evaluated using a standardized questionnaire. Compliance with regard to answering EMAs was calculated after excluding time when the watch was not being worn for technical reasons (eg, while charging).ResultsA majority of participants reported that the text displayed was large enough to read (22/26, 85%), and all participants found it easy to enter ratings using the smartwatch. Approximately half of the participants found the smartwatch to be comfortable (14/26, 54%) and would consider wearing it as their personal watch (11/24, 46%). Most participants were satisfied with its battery charging system (20/26, 77%). A majority of participants (19/26, 73%) expressed their willingness to use the ROAMM app for a 1-year research study. The overall EMA compliance rate was 83% (2505/3036 responses). The compliance rate was lower among those not regularly wearing a wristwatch (10/26, 88% vs 16/26, 71%) and among those who found the text too small to read (4/26, 86% vs 22/26, 60%).ConclusionsOlder adults with knee osteoarthritis positively rated the ROAMM smartwatch app and were generally satisfied with the device. The high compliance rates coupled with the willingness to participate in a long-term study suggest that the ROAMM app is a viable approach to remotely collecting health symptoms and behaviors for both research and clinical endeavors.

Project description:BACKGROUND:Technological communication methods such as telephone calls and video calls can help prevent social isolation and loneliness in frail older adults during confinement. OBJECTIVE:Our objectives were to determine which virtual communication method (ie, telephone call or video call) was preferred by confined older hospital patients and nursing home residents and the variables influencing this preference. METHODS:The TOVID (Telephony Or Videophony for Isolated elDerly) study was a cross-sectional study that was designed to examine the preference between telephone calls and video calls among frail older adults who were either hospitalized in a geriatric acute care unit or institutionalized in a long-term care and nursing home during the COVID-19 confinement period. RESULTS:A total of 132 older people were surveyed between March 25 and May 11, 2020 (mean age 88.2 years, SD 6.2); 79 (59.8%) were women. Patients hospitalized in the geriatric acute care unit were more able to establish communication independently than residents institutionalized in the long-term care and nursing home (P=.03) and were more satisfied with their communication experiences (P=.02). Overall, older people tended to favor telephone calls (73/132, 55.3%) over video calls (59/132, 44.7%); however, their satisfaction degree was similar regardless of the chosen method (P=.1), with no effect of age (P=.97) or gender (P=.2). In the geriatric acute care unit, the satisfaction degrees were similar for telephone calls (40/41, 98%) and video calls (33/38, 87%) in older patients (P=.10). Conversely, in the long-term care and nursing home, residents were more satisfied with the use of video calls to communicate with their relatives (14/15, 93%) versus the use of telephone calls (6/12, 50%; P=.02). CONCLUSIONS:Older people confined to health care settings were able to complete telephone calls more independently than video calls, and they tended to use telephone calls more often than video calls. The satisfaction degrees were similar with both modalities and even greater with video calls among long-term care and nursing home residents when they were given assistance to establish communication. TRIAL REGISTRATION:ClinicalTrials.gov NCT04333849: https://www.clinicaltrials.gov/ct2/show/NCT04333849.

Project description:BackgroundThe assessment of usability is a complex process that involves several steps and procedures. It is important to standardize the evaluation and reporting of usability procedures across studies to guide researchers, facilitate comparisons across studies, and promote high-quality usability studies. The first step to standardizing is to have an overview of how usability study procedures are reported across the literature.ObjectiveThis scoping review of reviews aims to synthesize the procedures reported for the different steps of the process of conducting a user-centered usability assessment of digital solutions relevant for older adults and to identify potential gaps in the present reporting of procedures. The secondary aim is to identify any principles or frameworks guiding this assessment in view of a standardized approach.MethodsThis is a scoping review of reviews. A 5-stage scoping review methodology was used to identify and describe relevant literature published between 2009 and 2020 as follows: identify the research question, identify relevant studies, select studies for review, chart data from selected literature, and summarize and report results. The research was conducted on 5 electronic databases: PubMed, ACM Digital Library, IEEE, Scopus, and Web of Science. Reviews that met the inclusion criteria (reporting on user-centered usability evaluation procedures for any digital solution that could be relevant for older adults and were published in English) were identified, and data were extracted for further analysis regarding study evaluators, study participants, methods and techniques, tasks, and test environment.ResultsA total of 3958 articles were identified. After a detailed screening, 20 reviews matched the eligibility criteria. The characteristics of the study evaluators and participants and task procedures were only briefly and differently reported. The methods and techniques used for the assessment of usability are the topics that were most commonly and comprehensively reported in the reviews, whereas the test environment was seldom and poorly characterized.ConclusionsA lack of a detailed description of several steps of the process of assessing usability and no evidence on good practices of performing it suggests that there is a need for a consensus framework on the assessment of user-centered usability evaluation. Such a consensus would inform researchers and allow standardization of procedures, which are likely to result in improved study quality and reporting, increased sensitivity of the usability assessment, and improved comparability across studies and digital solutions. Our findings also highlight the need to investigate whether different ways of assessing usability are more sensitive than others. These findings need to be considered in light of review limitations.

Project description:BackgroundFalls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.ObjectiveThe aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.MethodsA fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.ResultsThere were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.ConclusionsOur fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.

Dataset Information

Going Remote-Demonstration and Evaluation of Remote Technology Delivery and Usability Assessment With Older Adults: Survey Study.

Background

Objective

Methods

Results

Conclusions

Trial registration

Publications

Going Remote-Demonstration and Evaluation of Remote Technology Delivery and Usability Assessment With Older Adults: Survey Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets