Dataset Information

Systematic review of international Delphi surveys for core outcome set development: representation of international patients.

ABSTRACT:

Objectives

A core outcome set (COS) describes a minimum set of outcomes to be reported by all clinical trials of one healthcare condition. Delphi surveys are frequently used to achieve consensus on core outcomes. International input is important to achieve global COS uptake. We aimed to investigate participant representation in international Delphi surveys, with reference to the inclusion of patients and participants from low and middle income countries as stakeholders (LMICs).

Design

Systematic review.

Data sources

EMBASE, Medline, Web of Science, COMET database and hand-searching.

Eligibility criteria

Protocols and studies describing Delphi surveys used to develop an international COS for trial reporting, published between 1 January 2017 and 6 June 2019.

Data extraction and synthesis

Delphi participants were grouped as patients or healthcare professionals (HCPs). Participants were considered international if their country of origin was different to that of the first or senior author. Data extraction included participant numbers, country of origin, country income group and whether Delphi surveys were translated. We analysed the impact these factors had on outcome prioritisation.

Results

Of 90 included studies, 69% (n=62) were completed and 31% (n=28) were protocols. Studies recruited more HCPs than patients (median 60 (IQR 30-113) vs 30 (IQR 14-66) participants, respectively). A higher percentage of HCPs was international compared with patients (57% (IQR 37-78) vs 20% (IQR 0-68)). Only 31% (n=28) studies recruited participants from LMICs. Regarding recruitment from LMICs, patients were under-represented (16% studies; n=8) compared with HCPs (22%; n=28). Few (7%; n=6) studies translated Delphi surveys. Only 3% studies (n=3) analysed Delphi responses by geographical location; all found differences in outcome prioritisation.

Conclusions

There is a disproportionately lower inclusion of international patients, compared with HCPs, in COS-development Delphi surveys, particularly within LMICs. Future international Delphi surveys should consider exploring for geographical and income-based differences in outcome prioritisation.

Prospero registration number

CRD42019138519.

SUBMITTER: Lee A

PROVIDER: S-EPMC7684826 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Systematic review of international Delphi surveys for core outcome set development: representation of international patients.

Lee Alice A Davies Anna A Young Amber E AE

BMJ open 20201123 11

<h4>Objectives</h4>A core outcome set (COS) describes a minimum set of outcomes to be reported by all clinical trials of one healthcare condition. Delphi surveys are frequently used to achieve consensus on core outcomes. International input is important to achieve global COS uptake. We aimed to investigate participant representation in international Delphi surveys, with reference to the inclusion of patients and participants from low and middle income countries as stakeholders (LMICs).<h4>Design ...[more]

PMID: 33234639

Similar Datasets

Project description:BackgroundCore outcome sets (COS) should be relevant to key stakeholders and widely applicable and usable. Ideally, they are developed for international use to allow optimal data synthesis from trials. Electronic Delphi surveys are commonly used to facilitate global participation; however, this has limitations. It is common for these surveys to be conducted in a single language potentially excluding those not fluent in that tongue. The aim of this study is to summarise current approaches for optimising international participation in Delphi studies and make recommendations for future practice.MethodsA comprehensive literature review of current approaches to translating Delphi surveys for COS development was undertaken. A standardised methodology adapted from international guidance derived from 12 major sets of translation guidelines in the field of outcome reporting was developed. As a case study, this was applied to a COS project for surgical trials in gastric cancer to translate a Delphi survey into 7 target languages from regions active in gastric cancer research.ResultsThree hundred thirty-two abstracts were screened and four studies addressing COS development in rheumatoid and osteoarthritis, vascular malformations and polypharmacy were eligible for inclusion. There was wide variation in methodological approaches to translation, including the number of forward translations, the inclusion of back translation, the employment of cognitive debriefing and how discrepancies and disagreements were handled. Important considerations were identified during the development of the gastric cancer survey including establishing translation groups, timelines, understanding financial implications, strategies to maximise recruitment and regulatory approvals. The methodological approach to translating the Delphi surveys was easily reproducible by local collaborators and resulted in an additional 637 participants to the 315 recruited to complete the source language survey. Ninety-nine per cent of patients and 97% of healthcare professionals from non-English-speaking regions used translated surveys.ConclusionConsideration of the issues described will improve planning by other COS developers and can be used to widen international participation from both patients and healthcare professionals.

Project description:BackgroundA Core Outcome Set (COS) is an agreed list of outcomes that are measured and reported in all clinical trials for a particular health condition. An 'e-Delphi' is an increasingly popular method for developing a COS whereby stakeholders are consulted via a multi-round online survey to reach agreement regarding the most important outcomes. Many COS studies seek diverse, international input that includes professionals and healthcare users. However, the recruitment and retention of participants can be deterred by various factors (e.g. language barriers and iterative, time-consuming rounds). This report evaluates the effectiveness of recruitment and retention methods used in the Core Outcome Measures in Tinnitus International Delphi (COMiT'ID) study using participant feedback from healthcare users, healthcare practitioners, researchers, commercial representatives and funders.MethodsA range of methods were applied to recruit participants to the study and maintain engagement over the three rounds. Feedback on recruitment and retention methods was collected using a twenty-item online questionnaire, with free text comments.ResultsA personalised email invitation was the most frequent recruitment route, and 719 professionals and healthcare users consented to take part. Retention of each stakeholder group ranged from 76 to 91% completing all three e-Delphi rounds. Feedback was given by 379 respondents. A majority of respondents were satisfied with the study methods that were implemented to promote retention. Over 55% indicated that their overall experience closely matched their expectations at the start of the study, and over 90% felt that their contribution was appreciated.ConclusionsThis report highlights study methods that worked well with respect to recruitment and retention, and those that did not. Findings provide a unique contribution to the growing evidence base of good practice in COS development by demonstrating the relative effectiveness of recruitment and retention methods for an e-Delphi survey.Trial registrationThis project was registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative. The protocol is published in Trials (doi:10.1186/s13063-017-2123-0).

Project description:BACKGROUND:There are numerous challenges in including patients in a core outcome set (COS) study, these can vary depending on the patient group. This study describes current efforts to include patients in the development of COS, with the aim of identifying areas for further improvement and study. METHODS:Using the COMET database, corresponding authors of COS projects registered or published from 1 January 2013 to 2 February 2017 were invited via a personalised email to participate in a short online survey. The survey and emails were constructed to maximise the response rate by following the academic literature on enhancing survey responses. Personalised reminder emails were sent to non-responders. This survey explored the frequency of patient input in COS studies, who was involved, what methods were used and whether or not the COS development was international. RESULTS:One hundred and ninety-two COS developers were sent the survey. Responses were collected from 21 February 2017 until 7 May 2017. One hundred and forty-six unique developers responded, yielding a 76% response rate and data in relation to 195 unique COSs (as some developers had worked on multiple COSs). Of focus here are their responses regarding 162 COSs at the published, completed or ongoing stages of development. Inclusion of patient participants was indicated in 87% (141/162) of COSs in the published completed or ongoing stages and over 94% (65/69) of ongoing COS projects. Nearly half (65/135) of COSs included patient participants from two or more countries and 22% (30/135) included patient participants from five or more countries. The Delphi survey was reported as being used singularly or in combination with other methods in 85% (119/140) of projects. Almost a quarter (16/65) of ongoing studies reported using a combination of qualitative interviews, Delphi survey and consensus meeting. CONCLUSIONS:These findings indicated that the Delphi survey is the most popular method of facilitating patient participation, while the combination of qualitative interviews, Delphi survey and consensus meetings is the most popular combination of methods. The increased inclusion of patient participants in the development of COSs is encouraging, as is the international approach to COS development that some developers are adopting.

Project description:IntroductionIn children, open inguinal hernia repair has been the gold standard for treatment, but with recent technical advancements in laparoscopy, laparoscopic hernia repair is gaining popularity. Despite available results from comparative studies, there is still no consensus regarding the superiority of open versus laparoscopic treatment strategy. An important reason for lack of consensus is the large heterogeneity in the trials' reported outcomes and outcome definitions, which limits comparisons between studies and precludes conclusions regarding the superiority of treatment strategies. The development and implementation of a core outcome set (COS) is a solution for this heterogeneity in the selection, measurement and reporting of trial outcome measures across studies. Currently, there is no COS for the treatment of paediatric inguinal hernia.Methods and analysisThe aim of this project is to reach international consensus on a minimal set of outcomes that should be measured and reported in all future clinical trials investigating inguinal hernia repair in children. The development process comprises three phases. First, we identify outcome domains associated with paediatric inguinal hernia repair from a patient perspective and through a systematic review of the literature using EMBASE, MEDLINE and the Cochrane Library databases. Second, we conduct a three-step Delphi study to identify and prioritise 'core' outcomes for the eventual minimal set. In the third phase, an expert meeting is held to establish the final COS and develop implementation strategies with participants from all stakeholder groups: healthcare professionals, parents and patients' representatives. The final COS will be reported in accordance with the COS-Standards for Reporting statement.Ethics and disseminationThe medical research ethics committee of the Amsterdam UMC confirmed that the Dutch Medical Research Involving Human Subjects Act (WMO) does not apply to this study and that full approval by the committee is not required. Electronic informed consent will be obtained from all participants. Results will be presented in peer-reviewed academic journals and at relevant conferences.Prospero registration numberCRD42021281422.

Dataset Information

Systematic review of international Delphi surveys for core outcome set development: representation of international patients.

Objectives

Design

Data sources

Eligibility criteria

Data extraction and synthesis

Results

Conclusions

Prospero registration number

Publications

Systematic review of international Delphi surveys for core outcome set development: representation of international patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets