Dataset Information

Validation of Fitbit Charge 2 Sleep and Heart Rate Estimates Against Polysomnographic Measures in Shift Workers: Naturalistic Study.

ABSTRACT:

Background

Multisensor fitness trackers offer the ability to longitudinally estimate sleep quality in a home environment with the potential to outperform traditional actigraphy. To benefit from these new tools for objectively assessing sleep for clinical and research purposes, multisensor wearable devices require careful validation against the gold standard of sleep polysomnography (PSG). Naturalistic studies favor validation.

Objective

This study aims to validate the Fitbit Charge 2 against portable home PSG in a shift-work population composed of 59 first responder police officers and paramedics undergoing shift work.

Methods

A reliable comparison between the two measurements was ensured through the data-driven alignment of a PSG and Fitbit time series that was recorded at night. Epoch-by-epoch analyses and Bland-Altman plots were used to assess sensitivity, specificity, accuracy, the Matthews correlation coefficient, bias, and limits of agreement.

Results

Sleep onset and offset, total sleep time, and the durations of rapid eye movement (REM) sleep and non-rapid-eye movement sleep stages N1+N2 and N3 displayed unbiased estimates with nonnegligible limits of agreement. In contrast, the proprietary Fitbit algorithm overestimated REM sleep latency by 29.4 minutes and wakefulness after sleep onset (WASO) by 37.1 minutes. Epoch-by-epoch analyses indicated better specificity than sensitivity, with higher accuracies for WASO (0.82) and REM sleep (0.86) than those for N1+N2 (0.55) and N3 (0.78) sleep. Fitbit heart rate (HR) displayed a small underestimation of 0.9 beats per minute (bpm) and a limited capability to capture sudden HR changes because of the lower time resolution compared to that of PSG. The underestimation was smaller in N2, N3, and REM sleep (0.6-0.7 bpm) than in N1 sleep (1.2 bpm) and wakefulness (1.9 bpm), indicating a state-specific bias. Finally, Fitbit suggested a distribution of all sleep episode durations that was different from that derived from PSG and showed nonbiological discontinuities, indicating the potential limitations of the staging algorithm.

Conclusions

We conclude that by following careful data processing processes, the Fitbit Charge 2 can provide reasonably accurate mean values of sleep and HR estimates in shift workers under naturalistic conditions. Nevertheless, the generally wide limits of agreement hamper the precision of quantifying individual sleep episodes. The value of this consumer-grade multisensor wearable in terms of tackling clinical and research questions could be enhanced with open-source algorithms, raw data access, and the ability to blind participants to their own sleep data.

SUBMITTER: Stucky B

PROVIDER: S-EPMC8527385 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:We evaluated the performance of Fitbit Charge 3™ (FC3), a multi-sensor commercial sleep-tracker, for measuring sleep in adolescents against gold-standard laboratory polysomnography (PSG). Single-night PSG and FC3 sleep outcomes were compared in thirty-nine adolescents (22 girls; 16-19 years), 12 of whom presented with clinical/subclinical DSM-5 insomnia symptoms (7 girls). Discrepancy analysis, Bland-Altman plots, and epoch-by-epoch analyses were used to evaluate FC3 performance. The influence of several factors potentially affecting FC3 performance (e.g., sex, age, body mass index, firmware version, and magnitude of heart rate changes between consecutive PSG epochs) was also tested. In the sample of healthy adolescents, FC3 systematically underestimated PSG total sleep time by about 11 min and sleep efficiency by 2.5%, and overestimated wake after sleep onset by 9 min. Proportional biases were detected for "light" and "deep" sleep duration, resulting in significant underestimation of these parameters for those participants having longer PSG N1+ N2 and N3 durations, respectively. No significant systematic bias was detected for sleep efficiency and sleep onset latency. Epoch-by-epoch analysis showed sleep-stage sensitivity (average proportion of PSG epochs correctly classified by the device for a given sleep stage) of 68% for wake, 78% for "light" sleep, 59% for "deep" sleep, and 69% for rapid eye movement (REM) sleep in healthy sleepers. Similar results were found in the sample of adolescents with insomnia symptoms. Body mass index was positively associated with FC3-PSG discrepancies in wake after sleep onset (R2 = .16, p = .048). The magnitude of the heart rate acceleration/deceleration between consecutive PSG epochs was an important factor affecting FC3 classifications of sleep stages. Our results are in line with a general trend in the literature, suggesting better performance for the recently introduced multi-sensor devices compared to motion-only devices, although further developments are needed to improve accuracy in sleep stage classification and wake detection. Further insight is needed to determine factors potentially affecting device performance, such as accuracy and reliability (consistency of performance over time), in different samples and conditions.

Project description:Excessive fatigue and insomnia are common among shift workers and can lead to negative effects such as reduced work performance, processing errors, accidents at work, absenteeism, reduced quality of life, and symptoms of depression. Moreover, work in rotating shifts can be a risk factor for different somatic and psychiatric diseases and may contribute to poor health, especially in elder adults and women. This review aims to show non-pharmacological preventive measures against fatigue and insomnia in shift workers.Computerized literature searches in MedLine and in the Cochrane Library were performed with the following key words: shift work disorder, fatigue, insomnia, shift work, measures, treatment, therapy, strategies and coping. The search was limited to non-pharmacological studies that were conducted on human subjects and published as English-language articles in peer-reviewed journals since 1970. Additional studies were identified through the reference sections of relevant articles. Eighteen articles on fatigue in shift workers, including six original research articles with a total sample size of 3504 probands consisting of industrial workers, office employees, aircraft maintenance engineers, and non-shift workers working in simulated shifts, were analyzed, as well as seven articles on insomnia, including an original research article with a sample size of 26 media workers. Also, 4 reviews on shift work disorder were analyzed.The occurrence of fatigue and insomnia in shift workers associated with a working period is described as shift work disorder. Estimations on the prevalence of shift work disorder in shift workers vary between 5 % and about 20 %; about one in three shift workers is affected by insomnia and up to 90 % of shift workers report regular fatigue and sleepiness at the workplace. We concluded that there is a necessity for treatments to improve the sleep quality of the shift working population. The most common non-pharmacological recommendations to improve sleep quality and to reduce insomnia and fatigue were scheduling, bright light exposure, napping, psychoeducation for sleep hygiene, and cognitive-behavioral measures.Some important preventive coping strategies for fatigue associated with shift work such as napping and exposure to bright light have already been investigated and are generally approved. A few studies also provide good evidence for the efficacy of cognitive-behavioral techniques in the treatment of chronic primary and comorbid insomnia. These coping strategies summarized in this paper should be considered in the workplace health promotion programs of each work environment to improve working conditions for shift workers and to save money.