Dataset Information

Accuracy of Samsung Gear S Smartwatch for Activity Recognition: Validation Study.

ABSTRACT: BACKGROUND:Wearable accelerometers have greatly improved measurement of physical activity, and the increasing popularity of smartwatches with inherent acceleration data collection suggest their potential use in the physical activity research domain; however, their use needs to be validated. OBJECTIVE:This study aimed to assess the validity of accelerometer data collected from a Samsung Gear S smartwatch (SGS) compared with an ActiGraph GT3X+ (GT3X+) activity monitor. The study aims were to (1) assess SGS validity using a mechanical shaker; (2) assess SGS validity using a treadmill running test; and (3) compare individual activity recognition, location of major body movement detection, activity intensity detection, locomotion recognition, and metabolic equivalent scores (METs) estimation between the SGS and GT3X+. METHODS:To validate and compare the SGS accelerometer data with GT3X+ data, we collected data simultaneously from both devices during highly controlled, mechanically simulated, and less-controlled natural wear conditions. First, SGS and GT3X+ data were simultaneously collected from a mechanical shaker and an individual ambulating on a treadmill. Pearson correlation was calculated for mechanical shaker and treadmill experiments. Finally, SGS and GT3X+ data were simultaneously collected during 15 common daily activities performed by 40 participants (n=12 males, mean age 55.15 [SD 17.8] years). A total of 15 frequency- and time-domain features were extracted from SGS and GT3X+ data. We used these features for training machine learning models on 6 tasks: (1) individual activity recognition, (2) activity intensity detection, (3) locomotion recognition, (4) sedentary activity detection, (5) major body movement location detection, and (6) METs estimation. The classification models included random forest, support vector machines, neural networks, and decision trees. The results were compared between devices. We evaluated the effect of different feature extraction window lengths on model accuracy as defined by the percentage of correct classifications. In addition to these classification tasks, we also used the extracted features for METs estimation. RESULTS:The results were compared between devices. Accelerometer data from SGS were highly correlated with the accelerometer data from GT3X+ for all 3 axes, with a correlation ?.89 for both the shaker test and treadmill test and ?.70 for all daily activities, except for computer work. Our results for the classification of activity intensity levels, locomotion, sedentary, major body movement location, and individual activity recognition showed overall accuracies of 0.87, 1.00, 0.98, 0.85, and 0.64, respectively. The results were not significantly different between the SGS and GT3X+. Random forest model was the best model for METs estimation (root mean squared error of .71 and r-squared value of .50). CONCLUSIONS:Our results suggest that a commercial brand smartwatch can be used in lieu of validated research grade activity monitors for individual activity recognition, major body movement location detection, activity intensity detection, and locomotion detection tasks.

SUBMITTER: Davoudi A

PROVIDER: S-EPMC6386649 | biostudies-literature | 2019 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Accuracy of Samsung Gear S Smartwatch for Activity Recognition: Validation Study.

Davoudi Anis A Wanigatunga Amal Asiri AA Kheirkhahan Matin M Corbett Duane Benjamin DB Mendoza Tonatiuh T Battula Manoj M Ranka Sanjay S Fillingim Roger Benton RB Manini Todd Matthew TM Rashidi Parisa P

JMIR mHealth and uHealth 20190206 2

<h4>Background</h4>Wearable accelerometers have greatly improved measurement of physical activity, and the increasing popularity of smartwatches with inherent acceleration data collection suggest their potential use in the physical activity research domain; however, their use needs to be validated.<h4>Objective</h4>This study aimed to assess the validity of accelerometer data collected from a Samsung Gear S smartwatch (SGS) compared with an ActiGraph GT3X+ (GT3X+) activity monitor. The study aim ...[more]

PMID: 30724739

Similar Datasets

Project description:BackgroundNovel smartwatch-based cuffless blood pressure (BP) measuring devices are coming to market and receive FDA and CE labels. These devices are often insufficiently validated for clinical use. This study aims to investigate a recently CE-cleared smartwatch using cuffless BP measurement in a population with normotensive and hypertensive individuals scheduled for 24-h BP measurement.MethodsPatients that were scheduled for 24-h ambulatory blood pressure monitoring (ABPM) were recruited and received an additional Samsung Galaxy Watch Active 2 smartwatch for simultaneous BP measurement on their opposite arm. After calibration, patients were asked to measure as much as possible in a 24-h period. Manual activation of the smartwatch is necessary to measure the BP. Accuracy was calculated using sensitivity, specificity, positive and negative predictive values and ROC curves. Bland-Altman method and Taffé methods were used for bias and precision assessment. BP variability was calculated using average real variability, standard deviation and coefficient of variation.ResultsForty patients were included. Bland-Altman and Taffé methods demonstrated a proportional bias, in which low systolic BPs are overestimated, and high BPs are underestimated. Diastolic BPs were all overestimated, with increasing bias toward lower BPs. Sensitivity and specificity for detecting systolic and/or diastolic hypertension were 83 and 41%, respectively. ROC curves demonstrate an area under the curve (AUC) of 0.78 for systolic hypertension and of 0.93 for diastolic hypertension. BP variability was systematically higher in the ABPM measurements compared to the smartwatch measurements.ConclusionThis study demonstrates that the BP measurements by the Samsung Galaxy Watch Active 2 show a systematic bias toward a calibration point, overestimating low BPs and underestimating high BPs, when investigated in both normotensive and hypertensive patients. Standards for traditional non-invasive sphygmomanometers are not met, but these standards are not fully applicable to cuffless devices, emphasizing the urgent need for new standards for cuffless devices. The smartwatch-based BP measurement is not yet ready for clinical usage. Future studies are needed to further validate wearable devices, and also to demonstrate new possibilities of non-invasive, high-frequency BP monitoring.

Project description:BackgroundCardiorespiratory fitness plays an important role in coping with hypoxic stress at high altitudes. However, the association of cardiorespiratory fitness with the development of acute mountain sickness (AMS) has not yet been evaluated. Wearable technology devices provide a feasible assessment of cardiorespiratory fitness, which is quantifiable as maximum oxygen consumption (VO2max) and may contribute to AMS prediction.ObjectiveWe aimed to determine the validity of VO2max estimated by the smartwatch test (SWT), which can be self-administered, in order to overcome the limitations of clinical VO2max measurements. We also aimed to evaluate the performance of a VO2max-SWT-based model in predicting susceptibility to AMS.MethodsBoth SWT and cardiopulmonary exercise test (CPET) were performed for VO2max measurements in 46 healthy participants at low altitude (300 m) and in 41 of them at high altitude (3900 m). The characteristics of the red blood cells and hemoglobin levels in all the participants were analyzed by routine blood examination before the exercise tests. The Bland-Altman method was used for bias and precision assessment. Multivariate logistic regression was performed to analyze the correlation between AMS and the candidate variables. A receiver operating characteristic curve was used to evaluate the efficacy of VO2max in predicting AMS.ResultsVO2max decreased after acute high altitude exposure, as measured by CPET (25.20 [SD 6.46] vs 30.17 [SD 5.01] at low altitude; P<.001) and SWT (26.17 [SD 6.71] vs 31.28 [SD 5.17] at low altitude; P<.001). Both at low and high altitudes, VO2max was slightly overestimated by SWT but had considerable accuracy as the mean absolute percentage error (<7%) and mean absolute error (<2 mL·kg-1·min-1), with a relatively small bias compared with VO2max-CPET. Twenty of the 46 participants developed AMS at 3900 m, and their VO2max was significantly lower than that of those without AMS (CPET: 27.80 [SD 4.55] vs 32.00 [SD 4.64], respectively; P=.004; SWT: 28.00 [IQR 25.25-32.00] vs 32.00 [IQR 30.00-37.00], respectively; P=.001). VO2max-CPET, VO2max-SWT, and red blood cell distribution width-coefficient of variation (RDW-CV) were found to be independent predictors of AMS. To increase the prediction accuracy, we used combination models. The combination of VO2max-SWT and RDW-CV showed the largest area under the curve for all parameters and models, which increased the area under the curve from 0.785 for VO2max-SWT alone to 0.839.ConclusionsOur study demonstrates that the smartwatch device can be a feasible approach for estimating VO2max. In both low and high altitudes, VO2max-SWT showed a systematic bias toward a calibration point, slightly overestimating the proper VO2max when investigated in healthy participants. The SWT-based VO2max at low altitude is an effective indicator of AMS and helps to better identify susceptible individuals following acute high-altitude exposure, particularly by combining the RDW-CV at low altitude.Trial registrationChinese Clinical Trial Registry ChiCTR2200059900; https://www.chictr.org.cn/showproj.html?proj=170253.

Project description:BackgroundAtrial fibrillation affects approximately 4% of the world's population and is one of the major causes of stroke, heart failure, sudden death, and cardiovascular morbidity. It can be difficult to diagnose when asymptomatic or in the paroxysmal stage, and its natural history is not well understood. New wearables and connected devices offer an opportunity to improve on this situation.ObjectiveWe aimed to validate an algorithm for the automatic detection of atrial fibrillation from a single-lead electrocardiogram taken with a smartwatch.MethodsEligible patients were recruited from 4 sites in Paris, France. Electrocardiograms (12-lead reference and single lead) were captured simultaneously. The electrocardiograms were reviewed by independent, blinded board-certified cardiologists. The sensitivity and specificity of the algorithm to detect atrial fibrillation and normal sinus rhythm were calculated. The quality of single-lead electrocardiograms (visibility and polarity of waves, interval durations, heart rate) was assessed in comparison with the gold standard (12-lead electrocardiogram).ResultsA total of 262 patients (atrial fibrillation: n=100, age: mean 74.3 years, SD 12.3; normal sinus rhythm: n=113, age: 61.8 years, SD 14.3; other arrhythmia: n=45, 66.9 years, SD 15.2; unreadable electrocardiograms: n=4) were included in the final analysis; 6.9% (18/262) were classified as Noise by the algorithm. Excluding other arrhythmias and Noise, the sensitivity for atrial fibrillation detection was 0.963 (95% CI lower bound 0.894), and the specificity was 1.000 (95% CI lower bound 0.967). Visibility and polarity accuracies were similar (1-lead electrocardiogram: P waves: 96.9%, QRS complexes: 99.2%, T waves: 91.2%; 12-lead electrocardiogram: P waves: 100%, QRS complexes: 98.8%, T waves: 99.5%). P-wave visibility accuracy was 99% (99/100) for patients with atrial fibrillation and 95.7% (155/162) for patients with normal sinus rhythm, other arrhythmias, and unreadable electrocardiograms. The absolute values of the mean differences in PR duration and QRS width were <3 ms, and more than 97% were <40 ms. The mean difference between the heart rates from the 1-lead electrocardiogram calculated by the algorithm and those calculated by cardiologists was 0.55 bpm.ConclusionsThe algorithm demonstrated great diagnostic performance for atrial fibrillation detection. The smartwatch's single-lead electrocardiogram also demonstrated good quality for physician use in daily routine care.Trial registrationClinicalTrials.gov NCT04351386; http://clinicaltrials.gov/ct2/show/NCT04351386.

Dataset Information

Accuracy of Samsung Gear S Smartwatch for Activity Recognition: Validation Study.

Publications

Accuracy of Samsung Gear S Smartwatch for Activity Recognition: Validation Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets