Dataset Information

The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis.

ABSTRACT:

Background

Patient-reported outcomes (PROs) are commonly collected in clinical trials and should provide impactful evidence on the effect of interventions on patient symptoms and quality of life. However, it is unclear how PRO impact is currently realised in practice. In addition, the different types of impact associated with PRO trial results, their barriers and facilitators, and appropriate impact metrics are not well defined. Therefore, our objectives were: i) to determine the range of potential impacts from PRO clinical trial data, ii) identify potential PRO impact metrics and iii) identify barriers/facilitators to maximising PRO impact; and iv) to examine real-world evidence of PRO trial data impact based on Research Excellence Framework (REF) impact case studies.

Methods

Two independent investigators searched MEDLINE, EMBASE, CINAHL+, HMIC databases from inception until December 2018. Articles were eligible if they discussed research impact in the context of PRO clinical trial data. In addition, the REF 2014 database was systematically searched. REF impact case studies were included if they incorporated PRO data in a clinical trial.

Results

Thirty-nine publications of eleven thousand four hundred eighty screened met the inclusion criteria. Nine types of PRO trial impact were identified; the most frequent of which centred around PRO data informing clinical decision-making. The included publications identified several barriers and facilitators around PRO trial design, conduct, analysis and report that can hinder or promote the impact of PRO trial data. Sixty-nine out of two hundred nine screened REF 2014 case studies were included. 12 (17%) REF case studies led to demonstrable impact including changes to international guidelines; national guidelines; influencing cost-effectiveness analysis; and influencing drug approvals.

Conclusions

PRO trial data may potentially lead to a range of benefits for patients and society, which can be measured through appropriate impact metrics. However, in practice there is relatively limited evidence demonstrating directly attributable and indirect real world PRO-related research impact. In part, this is due to the wider challenges of measuring the impact of research and PRO-specific issues around design, conduct, analysis and reporting. Adherence to guidelines and multi-stakeholder collaboration is essential to maximise the use of PRO trial data, facilitate impact and minimise research waste.

Trial registration

Systematic Review registration PROSPERO CRD42017067799.

SUBMITTER: Rivera SC

PROVIDER: S-EPMC6796482 | biostudies-literature | 2019 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis.

Rivera Samantha Cruz SC Kyte Derek G DG Aiyegbusi Olalekan Lee OL Slade Anita L AL McMullan Christel C Calvert Melanie J MJ

Health and quality of life outcomes 20191016 1

<h4>Background</h4>Patient-reported outcomes (PROs) are commonly collected in clinical trials and should provide impactful evidence on the effect of interventions on patient symptoms and quality of life. However, it is unclear how PRO impact is currently realised in practice. In addition, the different types of impact associated with PRO trial results, their barriers and facilitators, and appropriate impact metrics are not well defined. Therefore, our objectives were: i) to determine the range o ...[more]

PMID: 31619266

Similar Datasets

Project description:PURPOSE:The CONSORT extension for patient reported outcomes (PROs) aims to improve reporting, but guidance on the optimal integration with clinical data is lacking. This study examines in detail the reporting of PROs and clinical data from randomized controlled trials (RCTs) in gastro-intestinal cancer to inform design and reporting of combined PRO and clinical data from trials to improve the 'take home' message for clinicians to use in practice. MATERIALS AND METHODS:The case study was undertaken in gastro-intestinal cancer trials. Well-conducted RCTs reporting PROs with validated instruments were identified and categorized into those combining PRO and clinical data in a single paper, or those separating data into linked primary and supplemental papers. Qualitative methods were developed to examine reporting of the critical interpretation of the trial results (trial exegesis) in the papers in relation of the PRO and clinical outcomes and applied to each publication category. Results were used to inform recommendations for practice. RESULTS:From 1917 screened abstracts, 49 high quality RCTs were identified reported in 36 combined and 15 linked primary and supplemental papers. In-depth analysis of manuscript text identified three categories for understanding trial exegesis: where authors reported a "detailed", "general", or absent PRO rationale and integrated interpretation of clinical and PRO results. A total of 11 (30%) and 6 (16%) combined papers reported "detailed" PRO rationale and integrated interpretation of results although only 2 (14%) and 1 (7%) primary papers achieved the same standard respectively. Supplemental papers provide better information with 11 (73%) and 3 (20%) achieving "detailed" rationale and integrated interpretation of results. Supplemental papers, however, were published a median of 20 months after the primary RCT data in lower impact factor journals (median 16.8 versus 5.2). CONCLUSION:It is recommended that single papers, with detailed PRO rationale and integrated PRO and clinical data are published to optimize trial exegesis. Further work to examine whether this improves the use of PRO data to inform practice is needed.

Project description:BackgroundPatient-reported outcomes (PROs) are increasingly collected in clinical trials as they provide unique information on the physical, functional and psychological impact of a treatment from the patient's perspective. Recent research suggests that PRO trial data have the potential to inform shared decision-making, support pharmaceutical labelling claims and influence healthcare policy and practice. However, there remains limited evidence regarding the actual impact associated with PRO trial data and how to maximise PRO impact to benefit patients and society. Thus, our objective was to qualitatively explore international stakeholders' perspectives surrounding: a) the impact of PRO trial data, b) impact measurement metrics, and c) barriers and facilitators to effectively maximise the impact of PRO trial data upon patients and society.MethodsSemi-structured interviews with 24 international stakeholders were conducted between May and October 2018. Data were coded and analysed using reflexive thematic analysis.ResultsInternational stakeholders emphasised the impact of PRO trial data to benefit patients and society. Influence on policy-impact, including changes to clinical healthcare practice and guidelines, drug approval and promotional labelling claims were common types of PRO impact reported by interviewees. Interviewees suggested impact measurement metrics including: number of pharmaceutical labelling claims and interviews with healthcare practitioners to determine whether PRO data were incorporated in clinical decision-making. Key facilitators to PRO impact highlighted by stakeholders included: standardisation of PRO tools; consideration of health utilities when selecting PRO measures; adequate funding to support PRO research; improved reporting and dissemination of PRO trial data by key opinion leaders and patients; and development of legal enforcement of the collection of PRO data.ConclusionsDetermining the impact of PRO trial data is essential to better allocate funds, minimise research waste and to help maximise the impact of these data for patients and society. However, measuring the impact of PRO trial data through metrics is a challenging task, as current measures do not capture the total impact of PRO research. Broader international multi-stakeholder engagement and collaboration is needed to standardise PRO assessment and maximise the impact of PRO trial data to benefit patients and society.

Project description:BackgroundEvidence suggests there are inconsistencies in patient-reported outcome (PRO) assessment and reporting in clinical trials, which may limit the use of these data to inform patient care. For trials with a PRO endpoint, routine inclusion of key PRO information in the protocol may help improve trial conduct and the reporting and appraisal of PRO results; however, it is currently unclear exactly what PRO-specific information should be included. The aim of this review was to summarize the current PRO-specific guidance for clinical trial protocol developers.Methods and findingsWe searched the MEDLINE, EMBASE, CINHAL and Cochrane Library databases (inception to February 2013) for PRO-specific guidance regarding trial protocol development. Further guidance documents were identified via Google, Google scholar, requests to members of the UK Clinical Research Collaboration registered clinical trials units and international experts. Two independent investigators undertook title/abstract screening, full text review and data extraction, with a third involved in the event of disagreement. 21,175 citations were screened and 54 met the inclusion criteria. Guidance documents were difficult to access: electronic database searches identified just 8 documents, with the remaining 46 sourced elsewhere (5 from citation tracking, 27 from hand searching, 7 from the grey literature review and 7 from experts). 162 unique PRO-specific protocol recommendations were extracted from included documents. A further 10 PRO recommendations were identified relating to supporting trial documentation. Only 5/162 (3%) recommendations appeared in ≥50% of guidance documents reviewed, indicating a lack of consistency.ConclusionsPRO-specific protocol guidelines were difficult to access, lacked consistency and may be challenging to implement in practice. There is a need to develop easily accessible consensus-driven PRO protocol guidance. Guidance should be aimed at ensuring key PRO information is routinely included in appropriate trial protocols, in order to facilitate rigorous collection/reporting of PRO data, to effectively inform patient care.

Project description:BackgroundAssessment of patient-reported outcomes (PROs) provides valuable information to inform patient-centered care, but may also reveal 'PRO alerts': psychological distress or physical symptoms that may require an immediate response. Ad-hoc management of PRO alerts in clinical trials may result in suboptimal patient care or potentially bias trial results. To gain greater understanding of current practice in PRO alert management we conducted a national survey of personnel involved in clinical trials with a PRO endpoint.Methods and findingsWe conducted a national cross-sectional survey of 767 UK-based research nurses, data managers/coordinators, trial managers and chief/principal investigators involved in clinical trials using PROs. Respondents were self-selected volunteers from a non-randomised sample of eligible individuals recruited via 55 UK Clinical Research Collaboration Registered Clinical Trials Units and 19 Comprehensive Local Research Networks. Questions centred on the proportion of trial personnel encountering alerts, how staff responded to PRO alerts and whether current guidance was deemed sufficient to support research personnel. We undertook descriptive analyses of the quantitative data and directed thematic analysis of free-text comments. 20% of research nurses did not view completed PRO questionnaires and were not in a position to discover alerts, 39-50% of the remaining respondent group participants reported encountering PRO alerts. Of these, 83% of research nurses and 54% of data managers/trial coordinators reported taking action to assist the trial participant, but less than half were able to record the intervention in the trial documentation. Research personnel reported current PRO alert guidance/training was insufficient.ConclusionsResearch personnel are intermittently exposed to PRO alerts. Some intervene to help trial participants, but are not able to record this intervention in the trial documentation, risking co-intervention bias. Other staff do not check PRO information during the trial, meaning alerts may remain undiscovered, or do not respond to alerts if they are inadvertently encountered; both of which may impact on patient safety. Guidance is needed to support PRO alert management that protects the interests of trial participants whilst avoiding potential bias.

Project description:Qualitative evidence suggests patient-reported outcome (PRO) information is frequently absent from clinical trial protocols, potentially leading to inconsistent PRO data collection and risking bias. Direct evidence regarding PRO trial protocol content is lacking. The aim of this study was to systematically evaluate the PRO-specific content of UK National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme trial protocols.We conducted an electronic search of the NIHR HTA programme database (inception to August 2013) for protocols describing a randomised controlled trial including a primary/secondary PRO. Two investigators independently reviewed the content of each protocol, using a specially constructed PRO-specific protocol checklist, alongside the 'Standard Protocol Items: Recommendations for Interventional Trials' (SPIRIT) checklist. Disagreements were resolved through discussion with a third investigator. 75 trial protocols were included in the analysis. Protocols included a mean of 32/51 (63%) SPIRIT recommendations (range 16-41, SD 5.62) and 11/33 (33%) PRO-specific items (range 4-18, SD 3.56). Over half (61%) of the PRO items were incomplete. Protocols containing a primary PRO included slightly more PRO checklist items (mean 14/33 (43%)). PRO protocol content was not associated with general protocol completeness; thus, protocols judged as relatively 'complete' using SPIRIT were still likely to have omitted a large proportion of PRO checklist items.The PRO components of HTA clinical trial protocols require improvement. Information on the PRO rationale/hypothesis, data collection methods, training and management was often absent. This low compliance is unsurprising; evidence shows existing PRO guidance for protocol developers remains difficult to access and lacks consistency. Study findings suggest there are a number of PRO protocol checklist items that are not fully addressed by the current SPIRIT statement. We therefore advocate the development of consensus-based supplementary guidelines, aimed at improving the completeness and quality of PRO content in clinical trial protocols.

Project description:BackgroundPatient-reported outcomes (PROs) are captured within cancer trials to help future patients and their clinicians make more informed treatment decisions. However, variability in standards of PRO trial design and reporting threaten the validity of these endpoints for application in clinical practice.MethodsWe systematically investigated a cohort of randomized controlled cancer trials that included a primary or secondary PRO. For each trial, an evaluation of protocol and reporting quality was undertaken using standard checklists. General patterns of reporting where also explored.ResultsProtocols (101 sourced, 44.3%) included a mean (SD) of 10 (4) of 33 (range = 2-19) PRO protocol checklist items. Recommended items frequently omitted included the rationale and objectives underpinning PRO collection and approaches to minimize/address missing PRO data. Of 160 trials with published results, 61 (38.1%, 95% confidence interval = 30.6% to 45.7%) failed to include their PRO findings in any publication (mean 6.43-year follow-up); these trials included 49 568 participants. Although two-thirds of included trials published PRO findings, reporting standards were often inadequate according to international guidelines (mean [SD] inclusion of 3 [3] of 14 [range = 0-11]) CONSORT PRO Extension checklist items). More than one-half of trials publishing PRO results in a secondary publication (12 of 22, 54.5%) took 4 or more years to do so following trial closure, with eight (36.4%) taking 5-8 years and one trial publishing after 14 years.ConclusionsPRO protocol content is frequently inadequate, and nonreporting of PRO findings is widespread, meaning patient-important information may not be available to benefit patients, clinicians, and regulators. Even where PRO data are published, there is often considerable delay and reporting quality is suboptimal. This study presents key recommendations to enhance the likelihood of successful delivery of PROs in the future.

Project description:BACKGROUND:Patient-reported outcome measures (PROMs) are tools that enable patients to directly report their own assessments of well-being, or symptoms, in a structured and consistent way. Despite the usefulness of PROMs in optimizing health outcomes, their use in clinical practice is not routine. PROMs are complex to integrate into the clinical setting, with many elements potentially impacting on the success of implementation. For this reason, a protocol has been developed to guide a systematic review to collate information on implementation as presented in the randomized controlled trials (RCTs) to date. OBJECTIVE:The primary objective of this systematic review is to identify and synthesize factors available from RCT data about the fidelity of PROM interventions in clinical practice. The secondary objective will be an assessment of how implementation factors impact fidelity outcomes. METHODS:Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting standards will be followed. MEDLINE, EMBASE, and the Cumulative Index to Nursing and Allied Health Literature via OvidSP will be accessed using a defined search strategy. Grey literature and ClinicalTrials.gov will be reviewed for unpublished studies. Data extraction will be done to identify fidelity and factors impacting implementation, summarized using a narrative synthesis. An evidence-based implementation science framework will assist in identifying potential elements of importance and their effect on the process and outcomes of implementation. A meta-analysis to assess the impact of implementation factors will be attempted. A Cochrane risk of bias tool will be used. RESULTS:This protocol has received funding, and searches of databases will commence at the end of May 2019. It is planned that this systematic review will be finalized for publication in (December) 2019. CONCLUSIONS:Applying an implementation science evidence-based framework to the published literature may identify factors present in the data that impact on the implementation of PROMs into routine clinical care. This systematic review aims to improve understanding of how these factors impact the fidelity of this intervention, so that PROMs can be more effectively used in the care of patients. This systematic review can also offer more detailed information about the process and outcomes of successful implementation of PROMs. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID):PRR1-10.2196/14579.

Project description:ObjectivesTo systematically assess the type of outcomes selected and the prevalence of patient reported outcomes in contemporary cardiovascular trials and to quantify any misuse or underuse of patient reported outcomes using a specially developed tool that would allow estimation of the relevance of such outcomes to clinical decision making.DesignSystematic review.Data sourcesMedline and Embase.Study selectionRandomised controlled trials of the treatment for or prevention of cardiovascular disease published in 10 leading general medical and cardiology journals from January 2005 to December 2008.ResultsPrimary outcomes were patient important (death, morbidity, or patient reported outcomes) in only 93 of 413 trials (23%, SE 2%), whereas another 92 (22%, SE 2%) combined these outcomes with other less important ones into a composite. Sixty five trials (16%; SE 2%) used at least one instrument to measure patient reported outcomes, mostly in trials where such information would have been important or crucial for clinical decision making (52 trials). Patient reported outcomes were judged to be of little incremental value to a large number of, mostly explanatory, cardiovascular trials (152 trials). However, many trials in which patient reported outcomes would have been important or crucial for clinical decision making did not report such outcomes (122 of 174 trials, 70%). These included several trials that primarily aimed to improve symptoms or functional status, trials that tested interventions with a considerable potential for causing harm (mainly bleeding) that were not meaningfully measured, and trials with composite outcomes that were dominated by outcomes of questionable importance to patients.ConclusionsDespite a continued rise in the reporting of patient reported outcomes with no evidence for their misuse in more recent cardiovascular trials, they seem to be still underused once their relevance to clinical decision making has been taken into account. This was largely explained by inappropriate use of composite outcomes and inadequate measurement of harms.

Dataset Information

The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis.

Background

Methods

Results

Conclusions

Trial registration

Publications

The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets