Dataset Information

Quality assessment of real-world data repositories across the data life cycle: A literature review.

ABSTRACT:

Objective

Data quality (DQ) must be consistently defined in context. The attributes, metadata, and context of longitudinal real-world data (RWD) have not been formalized for quality improvement across the data production and curation life cycle. We sought to complete a literature review on DQ assessment frameworks, indicators and tools for research, public health, service, and quality improvement across the data life cycle.

Materials and methods

The review followed PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Databases from health, physical and social sciences were used: Cinahl, Embase, Scopus, ProQuest, Emcare, PsycINFO, Compendex, and Inspec. Embase was used instead of PubMed (an interface to search MEDLINE) because it includes all MeSH (Medical Subject Headings) terms used and journals in MEDLINE as well as additional unique journals and conference abstracts. A combined data life cycle and quality framework guided the search of published and gray literature for DQ frameworks, indicators, and tools. At least 2 authors independently identified articles for inclusion and extracted and categorized DQ concepts and constructs. All authors discussed findings iteratively until consensus was reached.

Results

The 120 included articles yielded concepts related to contextual (data source, custodian, and user) and technical (interoperability) factors across the data life cycle. Contextual DQ subcategories included relevance, usability, accessibility, timeliness, and trust. Well-tested computable DQ indicators and assessment tools were also found.

Conclusions

A DQ assessment framework that covers intrinsic, technical, and contextual categories across the data life cycle enables assessment and management of RWD repositories to ensure fitness for purpose. Balancing security, privacy, and FAIR principles requires trust and reciprocity, transparent governance, and organizational cultures that value good documentation.

SUBMITTER: Liaw ST

PROVIDER: S-EPMC8475229 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundDigital technologies are transforming the health care system. A large part of information is generated as real-world data (RWD). Data from electronic health records and digital biomarkers have the potential to reveal associations between the benefits and adverse events of medicines, establish new patient-stratification principles, expose unknown disease correlations, and inform on preventive measures. The impact for health care payers and providers, the biopharmaceutical industry, and governments is massive in terms of health outcomes, quality of care, and cost. However, a framework to assess the preliminary quality of RWD is missing, thus hindering the conduct of population-based observational studies to support regulatory decision-making and real-world evidence.ObjectiveTo address the need to qualify RWD, we aimed to build a web application as a tool to translate characterization of some quality parameters of RWD into a metric and propose a standard framework for evaluating the quality of the RWD.MethodsThe RWD-Cockpit systematically scores data sets based on proposed quality metrics and customizable variables chosen by the user. Sleep RWD generated de novo and publicly available data sets were used to validate the usability and applicability of the web application. The RWD quality score is based on the evaluation of 7 variables: manageability specifies access and publication status; complexity defines univariate, multivariate, and longitudinal data; sample size indicates the size of the sample or samples; privacy and liability stipulates privacy rules; accessibility specifies how the data set can be accessed and to what granularity; periodicity specifies how often the data set is updated; and standardization specifies whether the data set adheres to any specific technical or metadata standard. These variables are associated with several descriptors that define specific characteristics of the data set.ResultsTo address the need to qualify RWD, we built the RWD-Cockpit web application, which proposes a framework and applies a common standard for a preliminary evaluation of RWD quality across data sets-molecular, phenotypical, and social-and proposes a standard that can be further personalized by the community retaining an internal standard. Applied to 2 different case studies-de novo-generated sleep data and publicly available data sets-the RWD-Cockpit could identify and provide researchers with variables that might increase quality.ConclusionsThe results from the application of the framework of RWD metrics implemented in the RWD-Cockpit application suggests that multiple data sets can be preliminarily evaluated in terms of quality using the proposed metrics. The output scores-quality identifiers-provide a first quality assessment for the use of RWD. Although extensive challenges remain to be addressed to set RWD quality standards, our proposal can serve as an initial blueprint for community efforts in the characterization of RWD quality for regulated settings.

Project description:PurposeTrastuzumab, a humanized anti-human epidermal growth factor receptor 2 (anti-HER2) antibody delivered intravenously, has revolutionized the treatment of patients with breast cancer overexpressing HER2 protein. Recently, a newer subcutaneous formulation was shown to have comparable efficacy to the initial intravenous trastuzumab. In this study, we aimed to evaluate the impact of subcutaneous trastuzumab on the health-related quality of life (HRQoL) of patients diagnosed with early or metastatic HER2-overexpressing breast cancer.MethodsPatients were provided with the EORTC QLQ-C30 (European Organization for the Research and Treatment of Cancer Quality of Life Questionnaire-Core 30) and the BR-23 questionnaires. The scoring of questionnaires and patient's sociodemographic and clinicopathologic characteristics were recorded and analyzed by descriptive and correlation statistics employing t test and 2-way analysis of variance.ResultsA total of 163 patients agreed to participate in the study. About 90 of 163 patients (55.21%) received subcutaneous trastuzumab and 21 patients intravenous trastuzumab (12.88%). A control group of 52 HER2+ patients received chemotherapy without trastuzumab (31.90%). Patients receiving subcutaneous trastuzumab were older and of more advanced disease stage compared with those receiving chemotherapy (58.5 vs 51 years, 39.8% vs 28.8% advanced disease). In univariate analysis, subcutaneous trastuzumab was associated with less nausea and vomiting (P = .002) but worse cognitive function (P = .013) and dyspnea (P = .042). Patients who have received >8 cycles of subcutaneous trastuzumab reported less diarrhea (P = .049) and systemic therapy side effects (P = .015). Multivariate analysis showed that patients without comorbidity receiving subcutaneous trastuzumab had less treatment side effects, less upset by hair loss, and higher emotional functioning. Of note, mastectomy and subcutaneous trastuzumab were associated with improved role functioning (P = .021). In metastatic disease, no negative impact of subcutaneous trastuzumab on HRQoL was found.ConclusionsThe administration of subcutaneous trastuzumab improved certain symptoms and did not adversely affect most of the assessed functional scales. Particularly, in the metastatic setting, subcutaneous trastuzumab had no negative impact on HRQoL.

Project description:PurposeDespite growing access to data, questions of "best fit" data and the appropriate use of results in supporting decision making still plague the life cycle assessment (LCA) community. This discussion paper addresses revisions to assessing data quality captured in a new US Environmental Protection Agency guidance document as well as additional recommendations on data quality creation, management, and use in LCA databases and studies.ApproachExisting data quality systems and approaches in LCA were reviewed and tested. The evaluations resulted in a revision to a commonly used pedigree matrix, for which flow and process level data quality indicators are described, more clarity for scoring criteria, and further guidance on interpretation are given.DiscussionIncreased training for practitioners on data quality application and its limits are recommended. A multi-faceted approach to data quality assessment utilizing the pedigree method alongside uncertainty analysis in result interpretation is recommended. A method of data quality score aggregation is proposed and recommendations for usage of data quality scores in existing data are made to enable improved use of data quality scores in LCA results interpretation. Roles for data generators, data repositories, and data users are described in LCA data quality management. Guidance is provided on using data with data quality scores from other systems alongside data with scores from the new system. The new pedigree matrix and recommended data quality aggregation procedure can now be implemented in openLCA software.Future workAdditional ways in which data quality assessment might be improved and expanded are described. Interoperability efforts in LCA data should focus on descriptors to enable user scoring of data quality rather than translation of existing scores. Developing and using data quality indicators for additional dimensions of LCA data, and automation of data quality scoring through metadata extraction and comparison to goal and scope are needed.

Project description:One of the main challenges for the successful implementation of health-related quality of life (HRQoL) assessments is missing data. The current study examined the feasibility and validity of a sequential multiple imputation (MI) method to deal with missing values in the longitudinal HRQoL data from the Scandinavian Obesity Surgery Registry. All patients in the SOReg who received bariatric surgery between 1 January 2011 and 31 March 2019 (n = 47,653) were included for the descriptive analysis and missingness pattern exploration. The patients who had completed the short-form 36 (SF-36) at baseline (year 0), and one-, two-, and five-year follow-ups were included (n = 3957) for the missingness pattern simulation and the sequential MI analysis. Eleven items of the SF-36 were selected to create the six domains of SF-6D, and the SF-6D utility index of each patient was calculated accordingly. The multiply-imputed variables in previous year were used as input to impute the missing values in later years. The performance of the sequential MI was evaluated by comparing the actual values with the imputed values of the selected SF-36 items and index at all four time points. At the baseline and year 1, where missing proportions were about 20% and 40%, respectively, there were no statistically significant discrepancies between the distributions of the actual and imputed responses (all p-values > 0.05). In year 2, where the missing proportion was about 60%, distributions of the actual and imputed responses were consistent in 9 of the 11 SF-36 items. However, in year 5, where the missing proportion was about 80%, no consistency was found between the actual and imputed responses in any of the SF-36 items. Relatively high missing proportions in HRQoL data are common in clinical registries, which brings a challenge to analyzing the HRQoL of longitudinal cohorts. The experimental sequential multiple imputation method adopted in the current study might be an ideal strategy for handling missing data (even though the follow-up survey had a missing proportion of 60%), avoiding significant information waste in the multivariate analysis. However, the imputations for data with higher missing proportions warrant more research.

Project description:BackgroundAntibacterial-resistant gram-negative infections are a serious risk to global public health. Resistant Enterobacterales and Pseudomonas aeruginosa are highly prevalent, particularly in healthcare settings, and there are limited effective treatment options. Patients with infections caused by resistant pathogens have considerably worse outcomes, and incur significantly higher costs, relative to patients with susceptible infections. Ceftolozane/tazobactam (C/T) has established efficacy in clinical trials. This review aimed to collate data on C/T use in clinical practice.MethodsThis systematic literature review searched online biomedical databases for real-world studies of C/T for gram-negative infections up to June 2020. Relevant study, patient, and treatment characteristics, microbiology, and efficacy outcomes were captured.ResultsThere were 83 studies comprising 3,701 patients were identified. The most common infections were respiratory infections (52.9% of reported infections), urinary tract infections (UTIs; 14.9%), and intra-abdominal infections (IAIs; 10.1%). Most patients included were seriously ill and had multiple comorbidities. The majority of patients had infections caused by P. aeruginosa (90.7%), of which 86.0% were antimicrobial-resistant. C/T was used as both a 1.5 g q8h and 3 g q8h dose, for a median duration of 7-56 days (varying between studies). Outcome rates were comparable between studies: clinical success rates ranged from 45.7 to 100.0%, with 27 studies (69%) reporting clinical success rates of > 70%; microbiological success rates ranged from 31 to 100%, with 14 studies (74%) reporting microbiological success rates of > 70%. Mortality rates ranged from 0 to 50%, with 31 studies (69%) reporting mortality rates of ≤ 20%. In comparative studies, C/T was as effective as aminoglycoside- or polymyxin-based regimens, and in some instances, significantly more effective.ConclusionsThe studies identified in this review demonstrate that C/T is effective in clinical practice, despite the diverse group of seriously ill patients, different levels of resistance of the pathogens treated, and varying dosing regimens used. Furthermore, comparative studies suggest that C/T offers a successful alternative to standard of care (SoC).