Dataset Information

Factors Affecting the Quality of Person-Generated Wearable Device Data and Associated Challenges: Rapid Systematic Review.

ABSTRACT:

Background

There is increasing interest in reusing person-generated wearable device data for research purposes, which raises concerns about data quality. However, the amount of literature on data quality challenges, specifically those for person-generated wearable device data, is sparse.

Objective

This study aims to systematically review the literature on factors affecting the quality of person-generated wearable device data and their associated intrinsic data quality challenges for research.

Methods

The literature was searched in the PubMed, Association for Computing Machinery, Institute of Electrical and Electronics Engineers, and Google Scholar databases by using search terms related to wearable devices and data quality. By using PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, studies were reviewed to identify factors affecting the quality of wearable device data. Studies were eligible if they included content on the data quality of wearable devices, such as fitness trackers and sleep monitors. Both research-grade and consumer-grade wearable devices were included in the review. Relevant content was annotated and iteratively categorized into semantically similar factors until a consensus was reached. If any data quality challenges were mentioned in the study, those contents were extracted and categorized as well.

Results

A total of 19 papers were included in this review. We identified three high-level factors that affect data quality-device- and technical-related factors, user-related factors, and data governance-related factors. Device- and technical-related factors include problems with hardware, software, and the connectivity of the device; user-related factors include device nonwear and user error; and data governance-related factors include a lack of standardization. The identified factors can potentially lead to intrinsic data quality challenges, such as incomplete, incorrect, and heterogeneous data. Although missing and incorrect data are widely known data quality challenges for wearable devices, the heterogeneity of data is another aspect of data quality that should be considered for wearable devices. Heterogeneity in wearable device data exists at three levels: heterogeneity in data generated by a single person using a single device (within-person heterogeneity); heterogeneity in data generated by multiple people who use the same brand, model, and version of a device (between-person heterogeneity); and heterogeneity in data generated from multiple people using different devices (between-person heterogeneity), which would apply especially to data collected under a bring-your-own-device policy.

Conclusions

Our study identifies potential intrinsic data quality challenges that could occur when analyzing wearable device data for research and three major contributing factors for these challenges. As poor data quality can compromise the reliability and accuracy of research results, further investigation is needed on how to address the data quality challenges of wearable devices.

SUBMITTER: Cho S

PROVIDER: S-EPMC8294465 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThere is a growing interest in using person-generated wearable device data for biomedical research, but there are also concerns regarding the quality of data such as missing or incorrect data. This emphasizes the importance of assessing data quality before conducting research. In order to perform data quality assessments, it is essential to define what data quality means for person-generated wearable device data by identifying the data quality dimensions.ObjectiveThis study aims to identify data quality dimensions for person-generated wearable device data for research purposes.MethodsThis study was conducted in 3 phases: literature review, survey, and focus group discussion. The literature review was conducted following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guideline to identify factors affecting data quality and its associated data quality challenges. In addition, we conducted a survey to confirm and complement results from the literature review and to understand researchers' perceptions on data quality dimensions that were previously identified as dimensions for the secondary use of electronic health record (EHR) data. We sent the survey to researchers with experience in analyzing wearable device data. Focus group discussion sessions were conducted with domain experts to derive data quality dimensions for person-generated wearable device data. On the basis of the results from the literature review and survey, a facilitator proposed potential data quality dimensions relevant to person-generated wearable device data, and the domain experts accepted or rejected the suggested dimensions.ResultsIn total, 19 studies were included in the literature review, and 3 major themes emerged: device- and technical-related, user-related, and data governance-related factors. The associated data quality problems were incomplete data, incorrect data, and heterogeneous data. A total of 20 respondents answered the survey. The major data quality challenges faced by researchers were completeness, accuracy, and plausibility. The importance ratings on data quality dimensions in an existing framework showed that the dimensions for secondary use of EHR data are applicable to person-generated wearable device data. There were 3 focus group sessions with domain experts in data quality and wearable device research. The experts concluded that intrinsic data quality features, such as conformance, completeness, and plausibility, and contextual and fitness-for-use data quality features, such as completeness (breadth and density) and temporal data granularity, are important data quality dimensions for assessing person-generated wearable device data for research purposes.ConclusionsIn this study, intrinsic and contextual and fitness-for-use data quality dimensions for person-generated wearable device data were identified. The dimensions were adapted from data quality terminologies and frameworks for the secondary use of EHR data with a few modifications. Further research on how data quality can be assessed with respect to each dimension is needed.

Project description:BACKGROUND:Person- or patient-generated health data (PGHD) are health, wellness, and clinical data that people generate, record, and analyze for themselves. There is potential for PGHD to improve the efficiency and effectiveness of simulated rehabilitation technologies for stroke. Simulated rehabilitation is a type of telerehabilitation that uses computer technologies and interfaces to allow the real-time simulation of rehabilitation activities or a rehabilitation environment. A leading technology for simulated rehabilitation is Microsoft's Kinect, a video-based technology that uses infrared to track a user's body movements. OBJECTIVE:This review attempts to understand to what extent Kinect-based stroke rehabilitation systems (K-SRS) have used PGHD and to what benefit. METHODS:The review is conducted in two parts. In part 1, aspects of relevance for PGHD were searched for in existing systematic reviews on K-SRS. The following databases were searched: IEEE Xplore, Association of Computing Machinery Digital Library, PubMed, Biomed Central, Cochrane Library, and Campbell Collaboration. In part 2, original research papers that presented or used K-SRS were reviewed in terms of (1) types of PGHD, (2) patient access to PGHD, (3) PGHD use, and (4) effects of PGHD use. The search was conducted in the same databases as part 1 except Cochrane and Campbell Collaboration. Reference lists on K-SRS of the reviews found in part 1 were also included in the search for part 2. There was no date restriction. The search was closed in June 2017. The quality of the papers was not assessed, as it was not deemed critical to understanding PGHD access and use in studies that used K-SRS. RESULTS:In part 1, 192 papers were identified, and after assessment only 3 papers were included. Part 1 showed that previous reviews focused on technical effectiveness of K-SRS with some attention on clinical effectiveness. None of those reviews reported on home-based implementation or PGHD use. In part 2, 163 papers were identified and after assessment, 41 papers were included. Part 2 showed that there is a gap in understanding how PGHD use may affect patients using K-SRS and a lack of patient participation in the design of such systems. CONCLUSIONS:This paper calls specifically for further studies of K-SRS-and for studies of technologies that allow patients to generate their own health data in general-to pay more attention to how patients' own use of their data may influence their care processes and outcomes. Future studies that trial the effectiveness of K-SRS outside the clinic should also explore how patients and carers use PGHD in home rehabilitation programs.