Dataset Information

Use of routinely collected health data in randomised clinical trials: comparison of trial-specific death data in the BOSS trial with NHS Digital data.

ABSTRACT:

Background

A promising approach to reduce the increasing costs of clinical trials is the use of routinely collected health data as participant data. However, the quality of this data could limit its usability as trial participant data.

Methods

The BOSS trial is a randomised controlled trial comparing regular endoscopies versus endoscopies at need in patients with Barrett's oesophagus with primary endpoint death. Data on death and cancer collected every 2 years after randomisation (trial-specific data) were compared to data received annually (all patients on one date) from the routinely collected health data source National Health Service (NHS) Digital. We investigated completeness, agreement and timeliness and looked at the implications for the primary trial outcome. Completeness and agreement were assessed by evaluating the number of reported and missing cases and any disparities between reported dates. Timeliness was considered by graphing the year a death was first reported in the trial-specific data against that for NHS Digital data. Implications on the primary trial outcome, overall survival, of using one of the data sources alone were investigated using Kaplan-Meier graphs. To assess the utility of cause of death and cancer diagnoses, oesophageal cancer cases were compared.

Results

NHS Digital datasets included more deaths and often reported them sooner than the trial-specific data. The number reported as being from oesophageal cancer was similar in both datasets. Due to time lag in reporting and missing cases, the event rate appeared higher using the NHS Digital data.

Conclusion

NHS Digital death data is useful for calculating overall survival where trial-specific follow-up is only every 2 years from randomisation and the follow-up requires patient response. The cancer data was not a large enough sample to assess usability. We suggest that this assessment of registry data is done for more phase III RCTs and for more registry data to get a more complete picture of when RCHD would be useful in phase III RCT.

Trial registration

ISRCTN54190466 (BOSS) 1 Oct 2009.

SUBMITTER: Love SB

PROVIDER: S-EPMC8474902 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:OBJECTIVE:The positive deviance approach seeks to identify and learn from exceptional performers. Although a framework exists to apply positive deviance within healthcare organisations, there is limited guidance to support its implementation. The approach has also rarely explored exceptional performance on broad outcomes, been implemented at ward level, or applied within the UK. This study develops and critically appraises a pragmatic method for identifying positively deviant wards using a routinely collected, broad measure of patient safety. DESIGN:A two-phased observational study was conducted. During phase 1, cross-sectional and temporal analyses of Safety Thermometer data were conducted to identify a discrete group of positively deviant wards that consistently demonstrated exceptional levels of safety. A group of matched comparison wards with above average performances were also identified. During phase 2, multidisciplinary staff and patients on the positively deviant and comparison wards completed surveys to explore whether their perceptions of safety supported the identification of positively deviant wards. SETTING:34 elderly medical wards within a northern region of England, UK. PARTICIPANTS:Multidisciplinary staff (n=161) and patients (n=188) clustered within nine positively deviant and comparison wards. RESULTS:Phase 1: A combination of analyses identified five positively deviant wards that performed best in the region, outperformed their organisation and performed consistently well over 12 months. Five above average matched comparator wards were also identified. Phase 2: Staff and patient perceptions of safety generally supported the identification of positively deviant wards using Safety Thermometer data, although patient perceptions of safety were less concordant with the routinely collected data. CONCLUSIONS:This study tentatively supports a pragmatic method of using routinely collected data to identify positively deviant elderly medical wards; however, it also highlights the various challenges that are faced when conducting the first stage of the positive deviance approach. TRIAL REGISTRATION NUMBER:UK Clinical Research Network Portfolio (reference-18050).

Project description:BACKGROUND:Clinical trials generally each collect their own data despite routinely collected health data (RCHD) increasing in quality and breadth. Our aim is to quantify UK-based randomised controlled trials (RCTs) accessing RCHD for participant data, characterise how these data are used and thereby recommend how more trials could use RCHD. METHODS:We conducted a systematic review of RCTs accessing RCHD from at least one registry in the UK between 2013 and 2018 for the purposes of informing or supplementing participant data. A list of all registries holding RCHD in the UK was compiled. In cases where registries published release registers, these were searched for RCTs accessing RCHD. Where no release register was available, registries were contacted to request a list of RCTs. For each identified RCT, information was collected from all publicly available sources (release registers, websites, protocol etc.). The search and data extraction were undertaken between January and May 2019. RESULTS:We identified 160 RCTs accessing RCHD between 2013 and 2018 from a total of 22 registries; this corresponds to only a very small proportion of all UK RCTs (about 3%). RCTs accessing RCHD were generally large (median sample size 1590), commonly evaluating treatments for cancer or cardiovascular disease. Most of the included RCTs accessed RCHD from NHS Digital (68%), and the most frequently accessed datasets were mortality (76%) and hospital visits (55%). RCHD was used to inform the primary trial (82%) and long-term follow-up (57%). There was substantial variation in how RCTs used RCHD to inform participant outcome measures. A limitation was the lack of information and transparency from registries and RCTs with respect to which datasets have been accessed and for what purposes. CONCLUSIONS:In the last five years, only a small minority of UK-based RCTs have accessed RCHD to inform participant data. We ask for improved accessibility, confirmed data quality and joined-up thinking between the registries and the regulatory authorities. TRIAL REGISTRATION:PROSPERO CRD42019123088.

Project description:BackgroundRandomised control trials (RCTs) with strict eligibility criteria can lead to trial populations not commonly seen in clinical practice. We described the proportion of people with chronic obstructive pulmonary disease (COPD) in England eligible for RCTs investigating treatment with triple therapy.MethodsMEDLINE and Clinicaltrials.gov were searched for RCTs investigating triple therapy and eligibility criteria for each trial were extracted. Using routinely collected primary care data from Clinical Practice Research Datalink Aurum linked with Hospital Episode Statistics, we defined a population of COPD patients registered at a general practice in England, who were ≥ 40 years old, and had a history of smoking. Inclusion date was January 1, 2020. Patients who died earlier or left the general practice were excluded. Eligibility criteria for each RCT was applied to the population of COPD patients and the proportion of patients meeting each trial eligibility criteria were described.Results26 RCTs investigating triple therapy were identified from the literature. The most common eligibility criteria were post-bronchodilator FEV1% predicted 30-80%, ≥ 2 moderate/≥ 1 severe exacerbations 12-months prior, no moderate exacerbations one-month prior and no severe exacerbations three-months prior, and the use of maintenance therapy or ICS use prior to inclusion. After applying each RCT eligibility criteria to our population of 79,810 COPD patients, a median of 11.2% [interquartile range (IQR) 1.8-17.4] of patients met eligibility criteria. The most discriminatory criteria included the presence exacerbations of COPD and previous COPD related medication use with a median of 67.6% (IQR 8.5-73.4) and 63% (IQR 69.3-38.4) of COPD patients not meeting these criteria, respectively.ConclusionData from these RCTs may not be generalisable to the wider population of people with COPD seen in everyday clinical practice and real-world evidence studies are needed to supplement trials to understand effectiveness in all people with COPD.