Dataset Information

Effects of User Characteristics on the Usability of a Home-Connected Medical Device (Smart Angel) for Ambulatory Monitoring: Usability Study.

ABSTRACT:

Background

The Smart Angel home medical device allows ambulatory surgery patients to monitor their own health by taking their blood pressure and oxygen levels and answering a health questionnaire from home. Currently, this device is a prototype in the design phase, and no usability evaluation has been performed. This preventive device must be usable by patients with different profiles; however, it is important to select patients carefully to ensure their safety when using the device. As such, it would be interesting to know how to select or exclude patients. However, the links between user characteristics and the usability of this home medical device remain unclear.

Objective

This study aims to better understand the links between certain characteristics of potential patients (ie, age, education, technophilia, and health literacy) and the usability (ie, effectiveness, efficiency, and satisfaction) of Smart Angel, as defined by the ISO 9241-11.

Methods

We conducted an experimental study involving 36 participants investigating the effects of 4 patient characteristics (ie, age, education, technophilia, and health literacy) on usability, measured in terms of effectiveness, efficiency, and satisfaction. A mixed methods approach (subjective vs objective) using a variety of standard instruments was adopted (direct observation, video analysis, and questionnaires). First, to help participants project themselves into the real use of the Smart Angel device, they watched a scenario in a video. Second, the participants completed a set of questionnaires to show the extent of their health literacy level (Newest Vital Sign [NVS] and the Health Literacy Survey [HLS]) and then operated Smart Angel devices. Efficiency (ie, handling time) and effectiveness (ie, number of handling errors) measures were collected by video analysis. Satisfaction measures were collected by a questionnaire (System Usability Scale [SUS]). The qualitative observational data were coded using inductive analysis by 2 independent researchers specialized in cognitive psychology and cognitive ergonomics.

Results

The results show a moderate and positive correlation between age and effectiveness (r=0.359; P=.03) and efficiency (r=0.357; P=.03). There is strong correlation between health literacy scored by the NVS and effectiveness (r=0.417; P=.01), efficiency (r=-0.38; P=.02), and satisfaction (r=0.45; P=.006). However, there is a weak correlation between technophilia and usability and no relationship between education level and usability.

Conclusions

Our results show that literacy level and age are 2 important factors to consider when selecting future users of the Smart Angel device to ensure patient safety. This study also serves as an example promoting mixed methodologies in assessments of medical device usability that cannot be performed under real-world conditions.

SUBMITTER: Chaniaud N

PROVIDER: S-EPMC8080268 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Abstract Aims To investigate the impact of coronavirus disease 2019 lockdown on trajectories of arterial pulse-wave velocity in a large population of users of connected smart scales that provide reliable measurements of pulse-wave velocity. Methods and results Pulse-wave velocity recordings obtained by Withings Heart Health & Body Composition Wi-Fi Smart Scale users before and during lockdown were analysed. We compared two demonstrative countries: France, where strict lockdown rules were enforced (n = 26 196) and Germany, where lockdown was partial (n = 26 847). Subgroup analysis was conducted in users of activity trackers and home blood pressure monitors. Linear growth curve modelling and trajectory clustering analyses were performed. During lockdown, a significant reduction in vascular stiffness, weight, blood pressure, and physical activity was observed in the overall population. Pulse-wave velocity reduction was greater in France than in Germany, corresponding to 5.2 month reduction in vascular age. In the French population, three clusters of stiffness trajectories were identified: decreasing (21.1%), stable (60.6%), and increasing pulse-wave velocity clusters (18.2%). Decreasing and increasing clusters both had higher pulse-wave velocity and vascular age before lockdown compared with the stable cluster. Only the decreasing cluster showed a significant weight reduction (−400 g), whereas living alone was associated with increasing pulse-wave velocity cluster. No clusters were identified in the German population. Conclusions During total lockdown in France, a reduction in pulse-wave velocity in a significant proportion of French users of connected smart bathroom scales occurred. The impact on long-term cardiovascular health remains to be established. Lay Summary Pulse-wave velocity (PWV) measurements from users of connected smart bathroom scales showed that during the first COVID-19 imposed lockdown in France and Germany, arterial stiffness decreased, with greater improvement in France, where three distinct patterns of PWV progression could be identified. Graphical Abstract Graphical abstract During COVID19 total lockdown in 2020 in France, a significant reduction in vascular stiffness, recorded by home smart scales, was observed.

Project description:BackgroundThe Internet of Things (IoT) has become integrated into everyday life, with devices becoming permanent fixtures in many homes. As countries face increasing pressure on their health care systems, smart home technologies have the potential to support population health through continuous behavioral monitoring.ObjectiveThis scoping review aims to provide insight into this evolving field of research by surveying the current technologies and applications for in-home health monitoring.MethodsPeer-reviewed papers from 2008 to 2021 related to smart home technologies for health care were extracted from 4 databases (PubMed, Scopus, ScienceDirect, and CINAHL); 49 papers met the inclusion criteria and were analyzed.ResultsMost of the studies were from Europe and North America. The largest proportion of the studies were proof of concept or pilot studies. Approximately 78% (38/49) of the studies used real human participants, most of whom were older females. Demographic data were often missing. Nearly 60% (29/49) of the studies reported on the health status of the participants. Results were primarily reported in engineering and technology journals. Almost 62% (30/49) of the studies used passive infrared sensors to report on motion detection where data were primarily binary. There were numerous data analysis, management, and machine learning techniques employed. The primary challenges reported by authors were differentiating between multiple participants in a single space, technology interoperability, and data security and privacy.ConclusionsThis scoping review synthesizes the current state of research on smart home technologies for health care. We were able to identify multiple trends and knowledge gaps-in particular, the lack of collaboration across disciplines. Technological development dominates over the human-centric part of the equation. During the preparation of this scoping review, we noted that the health care research papers lacked a concrete definition of a smart home, and based on the available evidence and the identified gaps, we propose a new definition for a smart home for health care. Smart home technology is growing rapidly, and interdisciplinary approaches will be needed to ensure integration into the health sector.

Project description:BackgroundStudies on the usability of health care devices are becoming more common, although usability standards are not necessarily specified and followed. Yet, there is little knowledge about the impact of the context of use on the usability outcome. It is specified in the usability standard (ISO 9241-11, 2018) of a device that it may be affected by its context of use and especially by the characteristics of its users. Among these, prior health knowledge (ie, knowledge about human body functioning) is crucial. However, no study has shown that prior health knowledge influences the usability of medical devices.ObjectiveOur study aimed to fill this gap by analyzing the relationship between the usability of two home medical devices (soon to be used in the context of ambulatory surgery) and prior health knowledge through an experimental approach.MethodsFor assessing the usability of two home medical devices (blood pressure monitor and pulse oximeter), user tests were conducted among 149 students. A mixed-methods approach (subjective vs objective) using a variety of standard instruments was adopted (direct observation, video analysis, and questionnaires). Participants completed a questionnaire to show the extent of their previous health knowledge and then operated both devices randomly. Efficiency (ie, handling time) and effectiveness (ie, number of handling errors) measures were collected by video analysis. Satisfaction measures were collected by a questionnaire (system usability scale [SUS]). The qualitative observational data were coded using inductive analysis by two independent researchers specialized in cognitive psychology and cognitive ergonomics. Correlational analyses and clusters were performed to test how usability relates to sociodemographic characteristics and prior health knowledge.ResultsThe results indicated a lack of usability for both devices. Regarding the blood pressure monitor (137 participants), users made approximately 0.77 errors (SD 1.49), and the mean SUS score was 72.4 (SD 21.07), which is considered "satisfactory." The pulse oximeter (147 participants) appeared easier to use, but participants made more errors (mean 0.99, SD 0.92), and the mean SUS score was 71.52 (SD 17.29), which is considered "satisfactory." The results showed a low negative and significant correlation only between the effectiveness of the two devices and previous knowledge (blood pressure monitor: r=-0.191, P=.03; pulse oximeter: r=-0.263, P=.001). More subtly, we experimentally identified the existence of a threshold level (χ²2,146=10.9, P=.004) for health knowledge to correctly use the pulse oximeter, but this was missing for the blood pressure monitor.ConclusionsThis study has the following two contributions: (1) a theoretical interest highlighting the importance of user characteristics including prior health knowledge on usability outcomes and (2) an applied interest to provide recommendations to designers and medical staff.

Project description:BackgroundThere are many problems with fitness trackers, such as device usability, which limit their large-scale application, and relevant studies are limited in terms of their sample size and evaluation methods. The purpose of the study was to evaluate the perceived usability of various mainstream fitness trackers on the market, and to learn about user feedback on feature preferences for each device.MethodsTrial use of seven mainstream fitness trackers (two smart watches and five smart wristbands) followed by a survey study were applied. The questionnaire was specifically developed for this study, which included two parts (user preferences and device usability in five dimensions). We recruited users to test the devices for at least 30 days and asked experienced users to provide feedback in order to evaluate each device, including the rating and user preference of each device.ResultsWe received 388 valid questionnaires, in which users rated their responses on a five-point Likert scale. (1) User preference: the average user satisfaction was 3.50-3.86 (points), and the rating for willingness to buy averaged between 3.36 and 3.59. More users were willing to wear (58.3-81.3%) and purchase (56.8-83.0%) the devices than were not. The top three general feature preferences were daily activity tracking, heart health monitoring, and professional fitness tracking. The top three health-related feature preferences were heart rate monitoring, daily pedometer, and professional fitness tracking. (2) Usability evaluation: product design was rated from 3.57 to 4.00; durability, 3.63-4.26; ease of use, 3.70-3.90; added features, 3.30-3.83; and user-rated accuracy, 3.44-3.78. A significant difference was observed in the rating of product design and durability among the different devices (p < 0.05) score.ConclusionsUsers generally had positive subjective intent regarding fitness trackers but were less satisfied with their cost effectiveness. The users preferred health related features such as heart health monitoring, and professional fitness tracking. The rating of most of the current mainstream fitness trackers was fair with some significant differences among the devices. Thus, further improvement is needed.