Dataset Information

Methods for conducting international Delphi surveys to optimise global participation in core outcome set development: a case study in gastric cancer informed by a comprehensive literature review.

ABSTRACT:

Background

Core outcome sets (COS) should be relevant to key stakeholders and widely applicable and usable. Ideally, they are developed for international use to allow optimal data synthesis from trials. Electronic Delphi surveys are commonly used to facilitate global participation; however, this has limitations. It is common for these surveys to be conducted in a single language potentially excluding those not fluent in that tongue. The aim of this study is to summarise current approaches for optimising international participation in Delphi studies and make recommendations for future practice.

Methods

A comprehensive literature review of current approaches to translating Delphi surveys for COS development was undertaken. A standardised methodology adapted from international guidance derived from 12 major sets of translation guidelines in the field of outcome reporting was developed. As a case study, this was applied to a COS project for surgical trials in gastric cancer to translate a Delphi survey into 7 target languages from regions active in gastric cancer research.

Results

Three hundred thirty-two abstracts were screened and four studies addressing COS development in rheumatoid and osteoarthritis, vascular malformations and polypharmacy were eligible for inclusion. There was wide variation in methodological approaches to translation, including the number of forward translations, the inclusion of back translation, the employment of cognitive debriefing and how discrepancies and disagreements were handled. Important considerations were identified during the development of the gastric cancer survey including establishing translation groups, timelines, understanding financial implications, strategies to maximise recruitment and regulatory approvals. The methodological approach to translating the Delphi surveys was easily reproducible by local collaborators and resulted in an additional 637 participants to the 315 recruited to complete the source language survey. Ninety-nine per cent of patients and 97% of healthcare professionals from non-English-speaking regions used translated surveys.

Conclusion

Consideration of the issues described will improve planning by other COS developers and can be used to widen international participation from both patients and healthcare professionals.

SUBMITTER: Alkhaffaf B

PROVIDER: S-EPMC8218463 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesA core outcome set (COS) describes a minimum set of outcomes to be reported by all clinical trials of one healthcare condition. Delphi surveys are frequently used to achieve consensus on core outcomes. International input is important to achieve global COS uptake. We aimed to investigate participant representation in international Delphi surveys, with reference to the inclusion of patients and participants from low and middle income countries as stakeholders (LMICs).DesignSystematic review.Data sourcesEMBASE, Medline, Web of Science, COMET database and hand-searching.Eligibility criteriaProtocols and studies describing Delphi surveys used to develop an international COS for trial reporting, published between 1 January 2017 and 6 June 2019.Data extraction and synthesisDelphi participants were grouped as patients or healthcare professionals (HCPs). Participants were considered international if their country of origin was different to that of the first or senior author. Data extraction included participant numbers, country of origin, country income group and whether Delphi surveys were translated. We analysed the impact these factors had on outcome prioritisation.ResultsOf 90 included studies, 69% (n=62) were completed and 31% (n=28) were protocols. Studies recruited more HCPs than patients (median 60 (IQR 30-113) vs 30 (IQR 14-66) participants, respectively). A higher percentage of HCPs was international compared with patients (57% (IQR 37-78) vs 20% (IQR 0-68)). Only 31% (n=28) studies recruited participants from LMICs. Regarding recruitment from LMICs, patients were under-represented (16% studies; n=8) compared with HCPs (22%; n=28). Few (7%; n=6) studies translated Delphi surveys. Only 3% studies (n=3) analysed Delphi responses by geographical location; all found differences in outcome prioritisation.ConclusionsThere is a disproportionately lower inclusion of international patients, compared with HCPs, in COS-development Delphi surveys, particularly within LMICs. Future international Delphi surveys should consider exploring for geographical and income-based differences in outcome prioritisation.Prospero registration numberCRD42019138519.

Project description:BackgroundMucopolysaccharidoses (MPS) are a group of inherited metabolic diseases characterized by chronic, progressive multi-system manifestations with varying degrees of severity. Disease-modifying therapies exist to treat some types of MPS; however, they are not curative, underscoring the need to identify and evaluate co-interventions that optimize functioning, participation in preferred activities, and quality of life. A Canadian pediatric MPS registry is under development and may serve as a platform to launch randomized controlled trials to evaluate such interventions. To promote the standardized collection of patient/family-reported and clinical outcomes considered important to patients/families, health care providers (HCPs), and policymakers, the choice of outcomes to include in the registry will be informed by a core outcome set (COS). We aim to establish a patient-oriented COS for pediatric MPS using a multi-stakeholder approach.MethodsIn step 1 of the six-step process to develop the COS, we will identify relevant outcomes through a rapid literature review and candidate outcomes survey. A two-phase screening approach will be implemented to identify eligible publications, followed by extraction of outcomes and other pre-specified data elements. Simultaneously, we will conduct a candidate outcomes survey with children with MPS and their families to identify outcomes most important to them. In step 2, HCPs experienced in treating patients with MPS will be invited to review the list of outcomes generated in step 1 and identify additional clinically relevant outcomes. We will then ask patients/families, HCPs, and policymakers to rate the outcomes in a set of Delphi Surveys (step 3), and to participate in a subsequent consensus meeting to finalize the COS (step 4). Step 5 involves establishing a set of outcome measurement instruments for the COS. Finally, we will disseminate the COS to knowledge users (step 6).DiscussionThe proposed COS will inform the choice of outcomes to include in the MPS registry and, more broadly, promote the standardized collection of patient-oriented outcomes for pediatric MPS research. By involving patients/families from the earliest stage of the research, we will ensure that the COS will be relevant to those who will ultimately benefit from the research.Trial registrationPROSPERO CRD42021267531 , COMET.

Project description:BackgroundA Core Outcome Set (COS) is an agreed list of outcomes that are measured and reported in all clinical trials for a particular health condition. An 'e-Delphi' is an increasingly popular method for developing a COS whereby stakeholders are consulted via a multi-round online survey to reach agreement regarding the most important outcomes. Many COS studies seek diverse, international input that includes professionals and healthcare users. However, the recruitment and retention of participants can be deterred by various factors (e.g. language barriers and iterative, time-consuming rounds). This report evaluates the effectiveness of recruitment and retention methods used in the Core Outcome Measures in Tinnitus International Delphi (COMiT'ID) study using participant feedback from healthcare users, healthcare practitioners, researchers, commercial representatives and funders.MethodsA range of methods were applied to recruit participants to the study and maintain engagement over the three rounds. Feedback on recruitment and retention methods was collected using a twenty-item online questionnaire, with free text comments.ResultsA personalised email invitation was the most frequent recruitment route, and 719 professionals and healthcare users consented to take part. Retention of each stakeholder group ranged from 76 to 91% completing all three e-Delphi rounds. Feedback was given by 379 respondents. A majority of respondents were satisfied with the study methods that were implemented to promote retention. Over 55% indicated that their overall experience closely matched their expectations at the start of the study, and over 90% felt that their contribution was appreciated.ConclusionsThis report highlights study methods that worked well with respect to recruitment and retention, and those that did not. Findings provide a unique contribution to the growing evidence base of good practice in COS development by demonstrating the relative effectiveness of recruitment and retention methods for an e-Delphi survey.Trial registrationThis project was registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative. The protocol is published in Trials (doi:10.1186/s13063-017-2123-0).

Project description:BACKGROUND:There are numerous challenges in including patients in a core outcome set (COS) study, these can vary depending on the patient group. This study describes current efforts to include patients in the development of COS, with the aim of identifying areas for further improvement and study. METHODS:Using the COMET database, corresponding authors of COS projects registered or published from 1 January 2013 to 2 February 2017 were invited via a personalised email to participate in a short online survey. The survey and emails were constructed to maximise the response rate by following the academic literature on enhancing survey responses. Personalised reminder emails were sent to non-responders. This survey explored the frequency of patient input in COS studies, who was involved, what methods were used and whether or not the COS development was international. RESULTS:One hundred and ninety-two COS developers were sent the survey. Responses were collected from 21 February 2017 until 7 May 2017. One hundred and forty-six unique developers responded, yielding a 76% response rate and data in relation to 195 unique COSs (as some developers had worked on multiple COSs). Of focus here are their responses regarding 162 COSs at the published, completed or ongoing stages of development. Inclusion of patient participants was indicated in 87% (141/162) of COSs in the published completed or ongoing stages and over 94% (65/69) of ongoing COS projects. Nearly half (65/135) of COSs included patient participants from two or more countries and 22% (30/135) included patient participants from five or more countries. The Delphi survey was reported as being used singularly or in combination with other methods in 85% (119/140) of projects. Almost a quarter (16/65) of ongoing studies reported using a combination of qualitative interviews, Delphi survey and consensus meeting. CONCLUSIONS:These findings indicated that the Delphi survey is the most popular method of facilitating patient participation, while the combination of qualitative interviews, Delphi survey and consensus meetings is the most popular combination of methods. The increased inclusion of patient participants in the development of COSs is encouraging, as is the international approach to COS development that some developers are adopting.