Dataset Information

Investigating sources of inaccuracy in wearable optical heart rate sensors.

ABSTRACT: As wearable technologies are being increasingly used for clinical research and healthcare, it is critical to understand their accuracy and determine how measurement errors may affect research conclusions and impact healthcare decision-making. Accuracy of wearable technologies has been a hotly debated topic in both the research and popular science literature. Currently, wearable technology companies are responsible for assessing and reporting the accuracy of their products, but little information about the evaluation method is made publicly available. Heart rate measurements from wearables are derived from photoplethysmography (PPG), an optical method for measuring changes in blood volume under the skin. Potential inaccuracies in PPG stem from three major areas, includes (1) diverse skin types, (2) motion artifacts, and (3) signal crossover. To date, no study has systematically explored the accuracy of wearables across the full range of skin tones. Here, we explored heart rate and PPG data from consumer- and research-grade wearables under multiple circumstances to test whether and to what extent these inaccuracies exist. We saw no statistically significant difference in accuracy across skin tones, but we saw significant differences between devices, and between activity types, notably, that absolute error during activity was, on average, 30% higher than during rest. Our conclusions indicate that different wearables are all reasonably accurate at resting and prolonged elevated heart rate, but that differences exist between devices in responding to changes in activity. This has implications for researchers, clinicians, and consumers in drawing study conclusions, combining study results, and making health-related decisions using these devices.

SUBMITTER: Bent B

PROVIDER: S-EPMC7010823 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Investigating sources of inaccuracy in wearable optical heart rate sensors.

Bent Brinnae B Goldstein Benjamin A BA Kibbe Warren A WA Dunn Jessilyn P JP

NPJ digital medicine 20200210

As wearable technologies are being increasingly used for clinical research and healthcare, it is critical to understand their accuracy and determine how measurement errors may affect research conclusions and impact healthcare decision-making. Accuracy of wearable technologies has been a hotly debated topic in both the research and popular science literature. Currently, wearable technology companies are responsible for assessing and reporting the accuracy of their products, but little information ...[more]

PMID: 32047863

Similar Datasets

Project description:AimsTo identify the potential sources of inaccuracy in manually measured adult respiratory rate (RR) data and quantify their effects.DesignQuantitative systematic review with meta-analyses where appropriate.Data sourcesMedline, CINAHL, and Cochrane Library (from database inception to 31 July 2019).Review methodsStudies presenting data on individual sources of inaccuracy in the manual measurement of adult RR were analysed, assessed for quality, and grouped according to the source of inaccuracy investigated. Quantitative data were extracted and synthesized and meta-analyses performed where appropriate.ResultsIncluded studies (N = 49) identified five sources of inaccuracy. The awareness effect creates an artefactual reduction in actual RR, and observation methods involving shorter counts cause systematic underscoring. Individual RR measurements can differ substantially in either direction between observations due to inter- or intra-observer variability. Value bias, where particular RRs are over-represented (suggesting estimation), is a widespread problem. Recording omission is also widespread, with higher average rates in inpatient versus triage/admission contexts.ConclusionThis review demonstrates that manually measured RR data are subject to several potential sources of inaccuracy.ImpactRR is an important indicator of clinical deterioration and commonly included in track-and-trigger systems. However, the usefulness of RR data depends on the accuracy of the observations and documentation, which are subject to five potential sources of inaccuracy identified in this review. A single measurement may be affected by several factors. Hence, clinicians should interpret recorded RR data cautiously unless systems are in place to ensure its accuracy. For nurses, this includes counting rather than estimating RRs, employing 60-s counts whenever possible, ensuring patients are unaware that their RR is being measured, and documenting the resulting value. For any given site, interventions to improve measurement should take into account the local organizational and cultural context, available resources, and the specific measurement issues that need to be addressed.

Project description:BACKGROUND:Wearable fitness trackers are devices that can record and enhance physical activity among users. Recently, photoplethysmography (PPG) devices that use optical heart rate sensors to detect heart rate in real time have become popular and help in monitoring and controlling exercise intensity. Although the benefits of using optical heart rate monitors have been highlighted through studies, the accuracy of the readouts these commercial devices generate has not been widely assessed for different age groups, especially for the East Asian population with Fitzpatrick skin type III or IV. OBJECTIVE:This study aimed to examine the accuracy of 2 wearable fitness trackers with PPG to monitor heart rate in real time during moderate exercise in young and older adults. METHODS:A total of 20 young adults and 20 older adults were recruited for this study. All participants were asked to undergo a series of sedentary and moderate physical activities using indoor aerobic exercise equipment. In this study, the Polar H7 chest-strapped heart rate monitor was used as the criterion measure in 2 fitness trackers, namely Xiaomi Mi Band 2 and Garmin Vivosmart HR+. The real-time, second-by-second heart rate data obtained from both devices were recorded using the broadcast heart rate mode. To critically analyze the results, multiple statistical parameters including the mean absolute percentage error (MAPE), Lin concordance correlation coefficient (CCC), intraclass correlation coefficient, the Pearson product moment correlation coefficient, and the Bland-Altman coefficient were determined to examine the performances of the devices. RESULTS:Both test devices exhibited acceptable overall accuracy as heart rate sensors based on several statistical tests. Notably, the MAPE values were below 10% (the designated threshold) in both devices (GarminYoung=3.77%; GarminSenior=4.73%; XiaomiYoung=7.69%; and XiaomiSenior=6.04%). The scores for reliability test of CCC for Garmin were 0.92 (Young) and 0.80 (Senior), whereas those for Xiaomi were 0.76 (Young) and 0.73 (Senior). However, the results obtained using the Bland-Altman analysis indicated that both test optical devices underestimated the average heart rate. More importantly, the study documented some unexpected outlier readings reported by these devices when used on certain participants. CONCLUSIONS:The study reveals that commonly used optical heart rate sensors, such as the ones used herein, generally produce accurate heart rate readings irrespective of the age of the user. However, users should avoid relying entirely on these readings to indicate exercise intensities, as these devices have a tendency to produce erroneous, extreme readings, which might misinterpret the real-time exercise intensity. Future studies should therefore emphasize the occurrence rate of such errors, as this will likely benefit the development of improved models of heart rate sensors.

Dataset Information

Investigating sources of inaccuracy in wearable optical heart rate sensors.

Publications

Investigating sources of inaccuracy in wearable optical heart rate sensors.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets