Dataset Information

Toward Harmonized Treadmill-Based Validation of Step-Counting Wearable Technologies: A Scoping Review.

ABSTRACT:

Background

The authors conducted a scoping review as a first step toward establishing harmonized (ie, consistent and compatible), empirically based best practices for validating step-counting wearable technologies.

Purpose

To catalog studies validating step-counting wearable technologies during treadmill ambulation.

Methods

The authors searched PubMed and SPORTDiscus in August 2019 to identify treadmill-based validation studies that employed the criterion of directly observed (including video recorded) steps and cataloged study sample characteristics, protocol details, and analytical procedures. Where reported, speed- and wear location-specific mean absolute percentage error (MAPE) values were tabulated. Weighted median MAPE values were calculated by wear location and a 0.2-m/s speed increment.

Results

Seventy-seven eligible studies were identified: most had samples averaging 54% (SD = 5%) female and 27 (5) years of age, treadmill protocols consisting of 3 to 5 bouts at speeds of 0.8 (0.1) to 1.6 (0.2) m/s, and reported measures of bias. Eleven studies provided MAPE values at treadmill speeds of 1.1 to 1.8 m/s; their weighted median MAPE values were 7% to 11% for wrist-worn, 1% to 4% for waist-worn, and ≤1% for thigh-worn devices.

Conclusions

Despite divergent study methodologies, the authors identified common practices and summarized MAPE values representing device step-count accuracy during treadmill walking. These initial empirical findings should be further refined to ultimately establish harmonized best practices for validating wearable technologies.

SUBMITTER: Moore CC

PROVIDER: S-EPMC7855895 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundWearable technologies play an important role in measuring physical activity (PA) and promoting health. Standardized validation indices (i.e., accuracy, bias, and precision) compare performance of step counting wearable technologies in young people.PurposeTo produce a catalog of validity indices for step counting wearable technologies assessed during different treadmill speeds (slow [0.8-3.2 km/h], normal [4.0-6.4 km/h], fast [7.2-8.0 km/h]), wear locations (waist, wrist/arm, thigh, and ankle), and age groups (children, 6-12 years; adolescents, 13-17 years; young adults, 18-20 years).MethodsOne hundred seventeen individuals (13.1 ± 4.2 years, 50.4% female) participated in this cross-sectional study and completed 5-min treadmill bouts (0.8 km/h to 8.0 km/h) while wearing eight devices (Waist: Actical, ActiGraph GT3X+, NL-1000, SW-200; Wrist: ActiGraph GT3X+; Arm: SenseWear; Thigh: activPAL; Ankle: StepWatch). Directly observed steps served as the criterion measure. Accuracy (mean absolute percentage error, MAPE), bias (mean percentage error, MPE), and precision (correlation coefficient, r; standard deviation, SD; coefficient of variation, CoV) were computed.ResultsFive of the eight tested wearable technologies (i.e., Actical, waist-worn ActiGraph GT3X+, activPAL, StepWatch, and SW-200) performed at < 5% MAPE over the range of normal speeds. More generally, waist (MAPE = 4%), thigh (4%) and ankle (5%) locations displayed higher accuracy than the wrist location (23%) at normal speeds. On average, all wearable technologies displayed the lowest accuracy across slow speeds (MAPE = 50.1 ± 35.5%), and the highest accuracy across normal speeds (MAPE = 15.9 ± 21.7%). Speed and wear location had a significant effect on accuracy and bias (P < 0.001), but not on precision (P > 0.05). Age did not have any effect (P > 0.05).ConclusionsStandardized validation indices focused on accuracy, bias, and precision were cataloged by speed, wear location, and age group to serve as important reference points when selecting and/or evaluating device performance in young people moving forward. Reduced performance can be expected at very slow walking speeds (0.8 to 3.2 km/h) for all devices. Ankle-worn and thigh-worn devices demonstrated the highest accuracy. Speed and wear location had a significant effect on accuracy and bias, but not precision.Trial registrationClinicaltrials.gov NCT01989104 . Registered November 14, 2013.

Project description:BackgroundWearable devices hold great promise, particularly for data generation for cutting-edge health research, and their demand has risen substantially in recent years. However, there is a shortage of aggregated insights into how wearables have been used in health research.ObjectiveIn this review, we aim to broadly overview and categorize the current research conducted with affordable wearable devices for health research.MethodsWe performed a scoping review to understand the use of affordable, consumer-grade wearables for health research from a population health perspective using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) framework. A total of 7499 articles were found in 4 medical databases (PubMed, Ovid, Web of Science, and CINAHL). Studies were eligible if they used noninvasive wearables: worn on the wrist, arm, hip, and chest; measured vital signs; and analyzed the collected data quantitatively. We excluded studies that did not use wearables for outcome assessment and prototype studies, devices that cost >€500 (US $570), or obtrusive smart clothing.ResultsWe included 179 studies using 189 wearable devices covering 10,835,733 participants. Most studies were observational (128/179, 71.5%), conducted in 2020 (56/179, 31.3%) and in North America (94/179, 52.5%), and 93% (10,104,217/10,835,733) of the participants were part of global health studies. The most popular wearables were fitness trackers (86/189, 45.5%) and accelerometer wearables, which primarily measure movement (49/189, 25.9%). Typical measurements included steps (95/179, 53.1%), heart rate (HR; 55/179, 30.7%), and sleep duration (51/179, 28.5%). Other devices measured blood pressure (3/179, 1.7%), skin temperature (3/179, 1.7%), oximetry (3/179, 1.7%), or respiratory rate (2/179, 1.1%). The wearables were mostly worn on the wrist (138/189, 73%) and cost <€200 (US $228; 120/189, 63.5%). The aims and approaches of all 179 studies revealed six prominent uses for wearables, comprising correlations-wearable and other physiological data (40/179, 22.3%), method evaluations (with subgroups; 40/179, 22.3%), population-based research (31/179, 17.3%), experimental outcome assessment (30/179, 16.8%), prognostic forecasting (28/179, 15.6%), and explorative analysis of big data sets (10/179, 5.6%). The most frequent strengths of affordable wearables were validation, accuracy, and clinical certification (104/179, 58.1%).ConclusionsWearables showed an increasingly diverse field of application such as COVID-19 prediction, fertility tracking, heat-related illness, drug effects, and psychological interventions; they also included underrepresented populations, such as individuals with rare diseases. There is a lack of research on wearable devices in low-resource contexts. Fueled by the COVID-19 pandemic, we see a shift toward more large-sized, web-based studies where wearables increased insights into the developing pandemic, including forecasting models and the effects of the pandemic. Some studies have indicated that big data extracted from wearables may potentially transform the understanding of population health dynamics and the ability to forecast health trends.

Project description:BACKGROUND:Space technology has an impact on many domains of activity on earth, including in the field of global health. With the recent adoption of the United Nations' Sustainable Development Goals that highlight the need for strengthening partnerships in different domains, it is useful to better characterize the relationship between space technology and global health. OBJECTIVE:The aim of this study was to identify the applications of space technologies to global health, the key stakeholders in the field, as well as gaps and challenges. METHODS:We used a scoping review methodology, including a literature review and the involvement of stakeholders, via a brief self-administered, open-response questionnaire. A distinct search on several search engines was conducted for each of the four key technological domains that were previously identified by the UN Office for Outer Space Affairs' Expert Group on Space and Global Health (Domain A: remote sensing; Domain B: global navigation satellite systems; Domain C: satellite communication; and Domain D: human space flight). Themes in which space technologies are of benefit to global health were extracted. Key stakeholders, as well as gaps, challenges, and perspectives were identified. RESULTS:A total of 222 sources were included for Domain A, 82 sources for Domain B, 144 sources for Domain C, and 31 sources for Domain D. A total of 3 questionnaires out of 16 sent were answered. Global navigation satellite systems and geographic information systems are used for the study and forecasting of communicable and noncommunicable diseases; satellite communication and global navigation satellite systems for disaster response; satellite communication for telemedicine and tele-education; and global navigation satellite systems for autonomy improvement, access to health care, as well as for safe and efficient transportation. Various health research and technologies developed for inhabited space flights have been adapted for terrestrial use. CONCLUSIONS:Although numerous examples of space technology applications to global health exist, improved awareness, training, and collaboration of the research community is needed.

Project description:Accurate measurement devices are required to objectively quantify physical activity. Wearable activity monitors, such as pedometers, may serve as affordable and feasible instruments for measuring physical activity levels in older adults during their normal activities of daily living. Currently few available accelerometer-based steps counting devices have been shown to be accurate at slow walking speeds, therefore there is still lacking appropriate devices tailored for slow speed ambulation, typical of older adults. This study aimed to assess the validity of step counting using the pedometer function of the ADAMO Care Watch, containing an embedded algorithm for measuring physical activity in older adults.Twenty older adults aged ? 65 years (mean ± SD, 75±7 years; range, 68-91) and 20 young adults (25±5 years, range 20-40), wore a care watch on each wrist and performed a number of randomly ordered tasks: walking at slow, normal and fast self-paced speeds; a Timed Up and Go test (TUG); a step test and ascending/descending stairs. The criterion measure was the actual number of steps observed, counted with a manual tally counter. Absolute percentage error scores, Intraclass Correlation Coefficients (ICC), and Bland-Altman plots were used to assess validity.ADAMO Care Watch demonstrated high validity during slow and normal speeds (range 0.5-1.5 m/s) showing an absolute error from 1.3% to 1.9% in the older adult group and from 0.7% to 2.7% in the young adult group. The percentage error for the 30-metre walking tasks increased with faster pace in both young adult (17%) and older adult groups (6%). In the TUG test, there was less error in the steps recorded for older adults (1.3% to 2.2%) than the young adults (6.6% to 7.2%). For the total sample, the ICCs for the ADAMO Care Watch for the 30-metre walking tasks at each speed and for the TUG test were ranged between 0.931 to 0.985.These findings provide evidence that the ADAMO Care Watch demonstrated highly accurate measurements of the steps count in all activities, particularly walking at normal and slow speeds. Therefore, these data support the inclusion of the ADAMO Care Watch in clinical applications for measuring the number of steps taken by older adults at normal, slow walking speeds.

Project description:BackgroundDue to growing pressure on the health care system, a shift in rehabilitation to home settings is essential. However, efficient support for home-based rehabilitation is lacking. The COVID-19 pandemic has further exacerbated these challenges and has affected individuals and health care professionals during rehabilitation. Digital rehabilitation (DR) could support home-based rehabilitation. To develop and implement DR solutions that meet clients' needs and ease the growing pressure on the health care system, it is necessary to provide an overview of existing, relevant, and future solutions shaping the constantly evolving market of technologies for home-based DR.ObjectiveIn this scoping review, we aimed to identify digital technologies for home-based DR, predict new or emerging DR trends, and report on the influences of the COVID-19 pandemic on DR.MethodsThe scoping review followed the framework of Arksey and O'Malley, with improvements made by Levac et al. A literature search was performed in PubMed, Embase, CINAHL, PsycINFO, and the Cochrane Library. The search spanned January 2015 to January 2022. A bibliometric analysis was performed to provide an overview of the included references, and a co-occurrence analysis identified the technologies for home-based DR. A full-text analysis of all included reviews filtered the trends for home-based DR. A gray literature search supplemented the results of the review analysis and revealed the influences of the COVID-19 pandemic on the development of DR.ResultsA total of 2437 records were included in the bibliometric analysis and 95 in the full-text analysis, and 40 records were included as a result of the gray literature search. Sensors, robotic devices, gamification, virtual and augmented reality, and digital and mobile apps are already used in home-based DR; however, artificial intelligence and machine learning, exoskeletons, and digital and mobile apps represent new and emerging trends. Advantages and disadvantages were displayed for all technologies. The COVID-19 pandemic has led to an increased use of digital technologies as remote approaches but has not led to the development of new technologies.ConclusionsMultiple tools are available and implemented for home-based DR; however, some technologies face limitations in the application of home-based rehabilitation. However, artificial intelligence and machine learning could be instrumental in redesigning rehabilitation and addressing future challenges of the health care system, and the rehabilitation sector in particular. The results show the need for feasible and effective approaches to implement DR that meet clients' needs and adhere to framework conditions, regardless of exceptional situations such as the COVID-19 pandemic.

Project description:BackgroundThe Internet of Things (IoT) has become integrated into everyday life, with devices becoming permanent fixtures in many homes. As countries face increasing pressure on their health care systems, smart home technologies have the potential to support population health through continuous behavioral monitoring.ObjectiveThis scoping review aims to provide insight into this evolving field of research by surveying the current technologies and applications for in-home health monitoring.MethodsPeer-reviewed papers from 2008 to 2021 related to smart home technologies for health care were extracted from 4 databases (PubMed, Scopus, ScienceDirect, and CINAHL); 49 papers met the inclusion criteria and were analyzed.ResultsMost of the studies were from Europe and North America. The largest proportion of the studies were proof of concept or pilot studies. Approximately 78% (38/49) of the studies used real human participants, most of whom were older females. Demographic data were often missing. Nearly 60% (29/49) of the studies reported on the health status of the participants. Results were primarily reported in engineering and technology journals. Almost 62% (30/49) of the studies used passive infrared sensors to report on motion detection where data were primarily binary. There were numerous data analysis, management, and machine learning techniques employed. The primary challenges reported by authors were differentiating between multiple participants in a single space, technology interoperability, and data security and privacy.ConclusionsThis scoping review synthesizes the current state of research on smart home technologies for health care. We were able to identify multiple trends and knowledge gaps-in particular, the lack of collaboration across disciplines. Technological development dominates over the human-centric part of the equation. During the preparation of this scoping review, we noted that the health care research papers lacked a concrete definition of a smart home, and based on the available evidence and the identified gaps, we propose a new definition for a smart home for health care. Smart home technology is growing rapidly, and interdisciplinary approaches will be needed to ensure integration into the health sector.

Project description:BackgroundStep counts are increasingly used in public health and clinical research to assess wellbeing, lifestyle, and health status. However, estimating step counts using commercial activity trackers has several limitations, including a lack of reproducibility, generalizability, and scalability. Smartphones are a potentially promising alternative, but their step-counting algorithms require robust validation that accounts for temporal sensor body location, individual gait characteristics, and heterogeneous health states.ObjectiveOur goal was to evaluate an open-source step-counting method for smartphones under various measurement conditions against step counts estimated from data collected simultaneously from different body locations ("internal" validation), manually ascertained ground truth ("manual" validation), and step counts from a commercial activity tracker (Fitbit Charge 2) in patients with advanced cancer ("wearable" validation).MethodsWe used eight independent datasets collected in controlled, semi-controlled, and free-living environments with different devices (primarily Android smartphones and wearable accelerometers) carried at typical body locations. Five datasets (N=103) were used for internal validation, two datasets (N=107) for manual validation, and one dataset (N=45) used for wearable validation. In each scenario, step counts were estimated using a previously published step-counting method for smartphones that uses raw sub-second level accelerometer data. We calculated mean bias and limits of agreement (LoA) between step count estimates and validation criteria using Bland-Altman analysis.ResultsIn the internal validation datasets, participants performed 751.7±581.2 (mean±SD) steps, and the mean bias was -7.2 steps (LoA -47.6, 33.3) or -0.5%. In the manual validation datasets, the ground truth step count was 367.4±359.4 steps while the mean bias was -0.4 steps (LoA -75.2, 74.3) or 0.1 %. In the wearable validation dataset, Fitbit devices indicated mean step counts of 1931.2±2338.4, while the calculated bias was equal to -67.1 steps (LoA -603.8, 469.7) or a difference of 0.3 %.ConclusionsThis study demonstrates that our open-source step counting method for smartphone data provides reliable step counts across sensor locations, measurement scenarios, and populations, including healthy adults and patients with cancer.

Project description:Background: As public health strategists and policymakers explore different approaches to lessen the devastating effects of novel coronavirus disease (COVID-19), blockchain technology has emerged as a resource that can be utilized in numerous ways. Many blockchain technologies have been proposed or implemented during the COVID-19 pandemic; however, to the best of our knowledge, no comprehensive reviews have been conducted to uncover and summarise the main feature of these technologies. Objective: This study aims to explore proposed or implemented blockchain technologies used to mitigate the COVID-19 challenges as reported in the literature. Methods: We conducted a scoping review in line with guidelines of PRISMA Extension for Scoping Reviews (PRISMA-ScR). To identify relevant studies, we searched 11 bibliographic databases (e.g., EMBASE and MEDLINE) and conducted backward and forward reference list checking of the included studies and relevant reviews. The study selection and data extraction were conducted by 2 reviewers independently. Data extracted from the included studies was narratively summarised and described. Results: 19 of 225 retrieved studies met eligibility criteria in this review. The included studies reported 10 used cases of blockchain to mitigate COVID-19 challenges; the most prominent use cases were contact tracing and immunity passports. While the blockchain technology was developed in 10 studies, its use was proposed in the remaining 9 studies. The public blockchain technology was the most commonly utilized type in the included studies. All together, 8 different consensus mechanisms were used in the included studies. Out of 10 studies that identified the used platform, 9 studies used Ethereum to run the blockchain. Solidity was the most prominent programming language used in developing blockchain technology in the included studies. The transaction cost was reported in only 4 of the included studies and varied between USD 10-10 and USD 5. The expected latency and expected scalability were not identified in the included studies. Conclusion: Blockchain technologies are expected to play an integral role in the fight against the COVID-19 pandemic. Many possible applications of blockchain were found in this review; however, most of them are not mature enough to reveal their expected impact in the fight against COVID-19. We encourage governments, health authorities, and policymakers to consider all blockchain applications suggested in the current review to combat COVID-19 challenges. There is a pressing need to empirically examine how effective blockchain technologies are in mitigating COVID-19 challenges. Further studies are required to assess the performance of blockchain technologies' fight against COVID-19 in terms of transaction cost, scalability, and/or latency when using different consensus algorithms, platforms, and access types.