Sleep Parameter Assessment Accuracy of a Consumer Home Sleep Monitoring Ballistocardiograph Beddit Sleep Tracker: A Validation Study.
Ontology highlight
ABSTRACT:
SUBMITTER: Tuominen J
PROVIDER: S-EPMC6411173 | biostudies-literature | 2019 Mar
REPOSITORIES: biostudies-literature
Publications
Sleep Parameter Assessment Accuracy of a Consumer Home Sleep Monitoring Ballistocardiograph Beddit Sleep Tracker: A Validation Study.
Tuominen Jarno J Peltola Karoliina K Saaresranta Tarja T Valli Katja K
Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine 20190315 3
<h4>Study objectives</h4>Growing interest in monitoring sleep and well-being has created a market for consumer home sleep monitoring devices. Additionally, sleep disorder diagnostics, and sleep and dream research would benefit from reliable and valid home sleep monitoring devices. Yet, majority of currently available home sleep monitoring devices lack validation. In this study, the sleep parameter assessment accuracy of Beddit Sleep Tracker (BST), an unobtrusive and non-wearable sleep monitoring ...[more]
Similar Datasets
Project description:BackgroundConsumer sleep trackers (CSTs) have gained significant popularity because they enable individuals to conveniently monitor and analyze their sleep. However, limited studies have comprehensively validated the performance of widely used CSTs. Our study therefore investigated popular CSTs based on various biosignals and algorithms by assessing the agreement with polysomnography.ObjectiveThis study aimed to validate the accuracy of various types of CSTs through a comparison with in-lab polysomnography. Additionally, by including widely used CSTs and conducting a multicenter study with a large sample size, this study seeks to provide comprehensive insights into the performance and applicability of these CSTs for sleep monitoring in a hospital environment.MethodsThe study analyzed 11 commercially available CSTs, including 5 wearables (Google Pixel Watch, Galaxy Watch 5, Fitbit Sense 2, Apple Watch 8, and Oura Ring 3), 3 nearables (Withings Sleep Tracking Mat, Google Nest Hub 2, and Amazon Halo Rise), and 3 airables (SleepRoutine, SleepScore, and Pillow). The 11 CSTs were divided into 2 groups, ensuring maximum inclusion while avoiding interference between the CSTs within each group. Each group (comprising 8 CSTs) was also compared via polysomnography.ResultsThe study enrolled 75 participants from a tertiary hospital and a primary sleep-specialized clinic in Korea. Across the 2 centers, we collected a total of 3890 hours of sleep sessions based on 11 CSTs, along with 543 hours of polysomnography recordings. Each CST sleep recording covered an average of 353 hours. We analyzed a total of 349,114 epochs from the 11 CSTs compared with polysomnography, where epoch-by-epoch agreement in sleep stage classification showed substantial performance variation. More specifically, the highest macro F1 score was 0.69, while the lowest macro F1 score was 0.26. Various sleep trackers exhibited diverse performances across sleep stages, with SleepRoutine excelling in the wake and rapid eye movement stages, and wearables like Google Pixel Watch and Fitbit Sense 2 showing superiority in the deep stage. There was a distinct trend in sleep measure estimation according to the type of device. Wearables showed high proportional bias in sleep efficiency, while nearables exhibited high proportional bias in sleep latency. Subgroup analyses of sleep trackers revealed variations in macro F1 scores based on factors, such as BMI, sleep efficiency, and apnea-hypopnea index, while the differences between male and female subgroups were minimal.ConclusionsOur study showed that among the 11 CSTs examined, specific CSTs showed substantial agreement with polysomnography, indicating their potential application in sleep monitoring, while other CSTs were partially consistent with polysomnography. This study offers insights into the strengths of CSTs within the 3 different classes for individuals interested in wellness who wish to understand and proactively manage their own sleep.
| S-EPMC10654909 | biostudies-literature
Project description:Commercial sleep devices and mobile-phone applications for scoring sleep are gaining ground. In order to provide reliable information about the quantity and/or quality of sleep, their performance needs to be assessed against the current gold standard, i.e., polysomnography (PSG; measuring brain, eye, and muscle activity). Here, we assessed some commercially available sleep trackers, namely an activity tracker; Mi band (Xiaomi, Beijing, China), a scientific actigraph: Motionwatch 8 (CamNTech, Cambridge, UK), and a much-used mobile phone application: Sleep Cycle (Northcube, Gothenburg, Sweden). We recorded 27 nights in healthy sleepers using PSG and these devices and compared the results. Surprisingly, all devices had poor agreement with the PSG gold standard. Sleep parameter comparisons revealed that, specifically, the Mi band and the Sleep Cycle application had difficulties in detecting wake periods which negatively affected their total sleep time and sleep-efficiency estimations. However, all 3 devices were good in detecting the most basic parameter, the actual time in bed. In summary, our results suggest that, to date, the available sleep trackers do not provide meaningful sleep analysis but may be interesting for simply tracking time in bed. A much closer interaction with the scientific field seems necessary if reliable information shall be derived from such devices in the future.
| S-EPMC6806072 | biostudies-literature
Project description:ObjectiveNighttime wakening with asthma symptoms is a key to assessment and therapy decisions, with no gold standard objective measure. The study aims were to (1) determine the feasibility, (2) explore equivalence, and (3) test concordance of a consumer-based accelerometer with standard actigraphy for measurement of sleep patterns in women with asthma as an adjunct to self-report.MethodsPanel study design of women with poorly controlled asthma from a university-affiliated primary care clinic system was used. We assessed sensitivity and specificity, equivalence and concordance of sleep time, sleep efficiency, and wake counts between the consumer-based accelerometer Fitbit Charge™ and Actigraph wGT3X+. We linked data between devices for comparison both automatically by 24-hour period and manually by sleep segment.ResultsAnalysis included 424 938 minutes, 738 nights, and 833 unique sleep segments from 47 women. The fitness tracker demonstrated 97% sensitivity and 40% specificity to identify sleep. Between device equivalence for total sleep time (15 and 42-minute threshold) was demonstrated by sleep segment. Concordance improved for wake counts and sleep efficiency when adjusting for a linear trend.ConclusionsThere were important differences in total sleep time, efficiency, and wake count measures when comparing individual sleep segments versus 24-hour measures of sleep. Fitbit overestimates sleep efficiency and underestimates wake counts in this population compared to actigraphy. Low levels of systematic bias indicate the potential for raw measurements from the devices to achieve equivalence and concordance with additional processing, algorithm modification, and modeling. Fitness trackers offer an accessible and inexpensive method to quantify sleep patterns in the home environment as an adjunct to subjective reports, and require further informatics development.
| S-EPMC6522318 | biostudies-literature
Project description:BACKGROUND:Digital food registration via online platforms that are coupled to large food databases obviates the need for manual processing of dietary data. The reliability of such platforms depends on the quality of the associated food database. OBJECTIVE:In this study, we validate the database of MyFitnessPal versus the Belgian food composition database, Nubel. METHODS:After carefully given instructions, 50 participants used MyFitnessPal to each complete a 4-day dietary record 2 times (T1 and T2), with 1 month in between T1 and T2. Nutrient intake values were calculated either manually, using the food composition database Nubel, or automatically, using the database coupled to MyFitnessPal. First, nutrient values from T1 were used as a training set to develop an algorithm that defined upper limit values for energy intake, carbohydrates, fat, protein, fiber, sugar, cholesterol, and sodium. These limits were applied to the MyFitnessPal dataset extracted at T2 to remove extremely high and likely erroneous values. Original and cleaned T2 values were correlated with the Nubel calculated values. Bias was estimated using Bland-Altman plots. Finally, we simulated the impact of using MyFitnessPal for nutrient analysis instead of Nubel on the power of a study design that correlates nutrient intake to a chosen outcome variable. RESULTS:Per food portion, the following upper limits were defined: 1500 kilocalories for total energy intake, 95 grams (g) for carbohydrates, 92 g for fat, 52 g for protein, 22 g for fiber, 70 g for sugar, 600 mg for cholesterol, and 3600 mg for sodium. Cleaning the dataset extracted at T2 resulted in a 2.8% rejection. Cleaned MyFitnessPal values demonstrated strong correlations with Nubel for energy intake (r=0.96), carbohydrates (r=0.90), fat (r=0.90), protein (r=0.90), fiber (r=0.80), and sugar (r=0.79), but weak correlations for cholesterol (?=0.51) and sodium (?=0.53); all P values were ?.001. No bias was found between both methods, except for a fixed bias for fiber and a proportional bias for cholesterol. A 5-10% power loss should be taken into account when correlating energy intake and macronutrients obtained with MyFitnessPal to an outcome variable, compared to Nubel. CONCLUSIONS:Dietary analysis with MyFitnessPal is accurate and efficient for total energy intake, macronutrients, sugar, and fiber, but not for cholesterol and sodium.
| S-EPMC7641788 | biostudies-literature
Project description:Objectives: Sleep time information is essential for monitoring of obstructive sleep apnea (OSA), as the severity assessment depends on the number of breathing disturbances per hour of sleep. However, clinical procedures for sleep monitoring rely on numerous uncomfortable sensors, which could affect sleeping patterns. Therefore, an automated method to identify sleep intervals from unobtrusive data is required. However, most unobtrusive sensors suffer from data loss and sensitivity to movement artifacts. Thus, current sleep detection methods are inadequate, as these require long intervals of good quality. Moreover, sleep monitoring of OSA patients is often less reliable due to heart rate disturbances, movement and sleep fragmentation. The primary aim was to develop a sleep-wake classifier for sleep time estimation of suspected OSA patients, based on single short-term segments of their cardiac and respiratory signals. The secondary aim was to define metrics to detect OSA patients directly from their predicted sleep-wake pattern and prioritize them for clinical diagnosis. Methods: This study used a dataset of 183 suspected OSA patients, of which 36 test subjects. First, a convolutional neural network was designed for sleep-wake classification based on healthier patients (AHI < 10). It employed single 30 s epochs of electrocardiograms and respiratory inductance plethysmograms. Sleep information and Total Sleep Time (TST) was derived for all patients using the short-term segments. Next, OSA patients were detected based on the average confidence of sleep predictions and the percentage of sleep-wake transitions in the predicted sleep architecture. Results: Sleep-wake classification on healthy, mild and moderate patients resulted in moderate κ scores of 0.51, 0.49, and 0.48, respectively. However, TST estimates decreased in accuracy with increasing AHI. Nevertheless, severe patients were detected with a sensitivity of 78% and specificity of 89%, and prioritized for clinical diagnosis. As such, their inaccurate TST estimate becomes irrelevant. Excluding detected OSA patients resulted in an overall estimated TST with a mean bias error of 21.9 (± 55.7) min and Pearson correlation of 0.74 to the reference. Conclusion: The presented framework offered a realistic tool for unobtrusive sleep monitoring of suspected OSA patients. Moreover, it enabled fast prioritization of severe patients for clinical diagnosis.
| S-EPMC8521961 | biostudies-literature
Project description:BackgroundAlthough alcohol breath testing devices that pair with smartphones are promoted for the prevention of alcohol-impaired driving, their accuracy has not been established.MethodsIn a within-subjects laboratory study, we administered weight-based doses of ethanol to two groups of 10 healthy, moderate drinkers aiming to achieve a target peak blood alcohol concentration (BAC) of 0.10%. We obtained a peak phlebotomy BAC and measured breath alcohol concentration (BrAC) with a police-grade device (Intoxilyzer 240) and two randomly ordered series of 3 consumer smartphone-paired devices (6 total devices) with measurements every 20 min until the BrAC reached <0.02% on the police device. Ten participants tested the first 3 devices, and the other 10 participants tested the other 3 devices. We measured mean paired differences in BrAC with 95% confidence intervals between the police-grade device and consumer devices.ResultsThe enrolled sample (N = 20) included 11 females; 15 white, 3 Asian, and 2 Black participants; with a mean age of 27 and mean BMI of 24.6. Peak BACs ranged from 0.06-0.14%. All 7 devices underestimated BAC by >0.01%, though the BACtrack Mobile Pro and police-grade device were consistently more accurate than the Drinkmate and Evoc. Compared with the police-grade device measurements, the BACtrack Mobile Pro readings were consistently higher, the BACtrack Vio and Alcohoot measurements similar, and the Floome, Drinkmake, and Evoc consistently lower. The BACtrack Mobile Pro and Alcohoot were most sensitive in detecting BAC driving limit thresholds, while the Drinkmate and Evoc devices failed to detect BAC limit thresholds more than 50% of the time relative to the police-grade device.ConclusionsThe accuracy of smartphone-paired devices varied widely in this laboratory study of healthy participants. Although some devices are suitable for clinical and research purposes, others underestimated BAC, creating the potential to mislead intoxicated users into thinking that they are fit to drive.
| S-EPMC9359437 | biostudies-literature
Project description:The gold standard for sleep monitoring is attended in-lab polysomnography; however, this method may be cost-prohibitive and inconvenient for patients and research participants. Home sleep testing has gained momentum in the field of sleep medicine due to its convenience and lower cost, as well as being more naturalistic. The accuracy and quality of home sleep testing, however, may be variable because studies are not monitored by sleep technologists. There has been some success in improving the accuracy of home sleep studies by having trained sleep technicians assist participants inside their homes with putting on the devices, but this can be intrusive and time-consuming for those involved. In this protocol, participants undergo at-home sleep monitoring with multiple devices: 1) a single-channel EEG device; 2) a home sleep test for sleep-disordered breathing and periodic limb movements; 3) actigraphy; and 4) sleep logs. A major challenge of this study is obtaining high-quality sleep monitoring data on the first attempt in order to minimize participant burden. This protocol describes the implementation of educational manuals with step-by-step instructions and photos. The goal is to improve the quality of home sleep testing.
| S-EPMC6377867 | biostudies-literature
Project description:IntroductionA device comprising two generic earpieces with embedded dry electrodes for ear-centered electroencephalography (ear-EEG) was developed. The objective was to provide ear-EEG based sleep monitoring to a wide range of the population without tailoring the device to the individual.MethodsTo validate the device ten healthy subjects were recruited for a 12-night sleep study. The study was divided into two parts; part A comprised two nights with both ear-EEG and polysomnography (PSG), and part B comprised 10 nights using only ear-EEG. In addition to the electrophysiological measurements, subjects filled out a questionnaire after each night of sleep.ResultsThe subjects reported that the ear-EEG system was easy to use, and that the comfort was better in part B. The performance of the system was validated by comparing automatic sleep scoring based on ear-EEG with PSG-based sleep scoring performed by a professional trained sleep scorer. Cohen's kappa was used to assess the agreement between the manual and automatic sleep scorings, and the study showed an average kappa value of 0.71. The majority of the 20 recordings from part A yielded a kappa value above 0.7. The study was compared to a companioned study conducted with individualized earpieces. To compare the sleep across the two studies and two parts, 7 different sleeps metrics were calculated based on the automatic sleep scorings. The ear-EEG nights were validated through linear mixed model analysis in which the effects of equipment (individualized vs. generic earpieces), part (PSG and ear-EEG vs. only ear-EEG) and subject were investigated. We found that the subject effect was significant for all computed sleep metrics. Furthermore, the equipment did not show any statistical significant effect on any of the sleep metrics.DiscussionThese results corroborate that generic ear-EEG is a promising alternative to the gold standard PSG for sleep stage monitoring. This will allow sleep stage monitoring to be performed in a less obtrusive way and over longer periods of time, thereby enabling diagnosis and treatment of diseases with associated sleep disorders.
| S-EPMC9928964 | biostudies-literature
Project description:ObjectiveWorking from home (WFH) has become common place since the Covid-19 pandemic. Early studies observed population-level shifts in sleep patterns (later and longer sleep) and physical activity (reduced PA), during home confinement. Other studies found these changes to depend on the proportion of days that individuals WFH (vs. work from office; WFO). Here, we examined the effects of WFH on sleep and activity patterns in the transition to normality during the later stages of the Covid-19 pandemic (Aug 2021-Jan 2022).MethodsTwo-hundred and twenty-five working adults enrolled in a public health study were followed for 22 weeks. Sleep and activity data were collected with a consumer fitness tracker (Fitbit Versa 2). Over three 2-week periods (Phase 1/week 1-2: August 16-29, 2021; Phase 2/week 11-12: October 25-November 7, 2021; Phase 3/week 21-22: January 3-16, 2022), participants provided daily Fitbit sleep and activity records. Additionally, they completed daily phone-based ecological momentary assessment (EMA), providing ratings of sleep quality, wellbeing (mood, stress, motivation), and information on daily work arrangements (WFH, WFO, no work). Work arrangement data were used to examine the effects of WFH vs. WFO on sleep, activity, and wellbeing.ResultsThe proportion of WFH vs. WFO days fluctuated over the three measurement periods, mirroring evolving Covid restrictions. Across all three measurement periods WFH days were robustly associated with later bedtimes (+14.7 min), later wake times (+42.3 min), and longer Total Sleep Time (+20.2 min), compared to WFO days. Sleep efficiency was not affected. WFH was further associated with lower daily step count than WFO (-2,471 steps/day). WFH was associated with higher wellbeing ratings compared to WFO for those participants who had no children. However, for participants with children, these differences were not present.ConclusionPandemic-initiated changes in sleep and physical activity were sustained during the later stage of the pandemic. These changes could have longer term effects, and conscious effort is encouraged to harness the benefits (i.e., longer sleep), and mitigate the pitfalls (i.e., less physical activity). These findings are relevant for public health as hybrid WHF is likely to persist in a post-pandemic world.
| S-EPMC10196619 | biostudies-literature
Project description:ObjectivesConsumer-grade smart devices are now commonly used by the public to measure waking activity and sleep. However, the ability of these devices to accurately measure sleep in clinical populations warrants more examination. The aim of the present study was to assess the accuracy of three consumer-grade sleep monitors compared with gold standard polysomnography (PSG).DesignA prospective cohort study was performed.SettingAdults undergoing PSG for investigation of a suspected sleep disorder.Participants54 sleep-clinic patients were assessed using three consumer-grade sleep monitors (Jawbone UP3, ResMed S+ and Beddit) in addition to PSG.OutcomesJawbone UP3, ResMed S+ and Beddit were compared with gold standard in-laboratory PSG on four major sleep parameters-total sleep time (TST), sleep onset latency (SOL), wake after sleep onset (WASO) and sleep efficiency (SE).ResultsThe accelerometer Jawbone UP3 was found to overestimate TST by 28 min (limits of agreement, LOA=-100.23 to 157.37), with reasonable agreement compared with gold standard for TST, WASO and SE. The doppler radar ResMed S+ device underestimated TST by 34 min (LOA=-257.06 to 188.34) and had poor absolute agreement compared with PSG for TST, SOL and SE. The mattress device, Beddit underestimated TST by 53 min (LOA=-238.79 to 132) on average and poor reliability compared with PSG for all measures except TST. High device synchronisation failure occurred, with 20% of recordings incomplete due to Bluetooth drop out and recording loss.ConclusionPoor to moderate agreement was found between PSG and each of the tested devices, however, Jawbone UP3 had relatively better absolute agreement than other devices in sleep measurements compared with PSG. Consumer grade devices assessed do not have strong enough agreement with gold standard measurement to replace clinical evaluation and PSG sleep testing. The models tested here have been superseded and newer models may have increase accuracy and thus potentially powerful patient engagement tools for long-term sleep measurement.
| S-EPMC8578969 | biostudies-literature