Dataset Information

Participating in core outcome set development via Delphi surveys: qualitative interviews provide pointers to inform guidance.

ABSTRACT: OBJECTIVES:To explore participants' views of Delphi surveys in core outcome set (COS) development. STUDY DESIGN AND SETTING:Patients and health professionals (n=24) from seven recently concluded COS studies that had involved a Delphi survey took part in semistructured qualitative interviews (telephone and email exchange). Interviews explored participants' understanding of COS and their experiences of the Delphi survey. Analysis was thematic. RESULTS:Several interviewees had previously participated in two or more COS or Delphi surveys. Those with multiple experiences of participation generally understood the purpose of COS and were satisfied with the Delphi survey. However, some interviewees who were first-time participants struggled to understand the purpose of COS and aspects of the Delphi survey, which limited their contribution and satisfaction with the study. Interviewees also differed in how they interpreted and subsequently used the written documentation provided to COS participants. Some interviewees wanted guidance regarding whose perspective to take into account when scoring outcomes and on how to use the scoring system. Interviewees reported being motivated to take part by the international and expert consensus aspects of the Delphi survey. A few interviewees reported experiencing either positive or negative emotional impacts arising from when they reviewed outcomes and stakeholder feedback. CONCLUSION:This study identifies important information that should be communicated to COS Delphi study participants. It also indicates the importance of communicating about COS Delphi studies in ways that are accessible and salient to participants, to enhance their experience of participation and make the process more meaningful for all.

SUBMITTER: Biggane AM

PROVIDER: S-EPMC6887093 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesA core outcome set (COS) describes a minimum set of outcomes to be reported by all clinical trials of one healthcare condition. Delphi surveys are frequently used to achieve consensus on core outcomes. International input is important to achieve global COS uptake. We aimed to investigate participant representation in international Delphi surveys, with reference to the inclusion of patients and participants from low and middle income countries as stakeholders (LMICs).DesignSystematic review.Data sourcesEMBASE, Medline, Web of Science, COMET database and hand-searching.Eligibility criteriaProtocols and studies describing Delphi surveys used to develop an international COS for trial reporting, published between 1 January 2017 and 6 June 2019.Data extraction and synthesisDelphi participants were grouped as patients or healthcare professionals (HCPs). Participants were considered international if their country of origin was different to that of the first or senior author. Data extraction included participant numbers, country of origin, country income group and whether Delphi surveys were translated. We analysed the impact these factors had on outcome prioritisation.ResultsOf 90 included studies, 69% (n=62) were completed and 31% (n=28) were protocols. Studies recruited more HCPs than patients (median 60 (IQR 30-113) vs 30 (IQR 14-66) participants, respectively). A higher percentage of HCPs was international compared with patients (57% (IQR 37-78) vs 20% (IQR 0-68)). Only 31% (n=28) studies recruited participants from LMICs. Regarding recruitment from LMICs, patients were under-represented (16% studies; n=8) compared with HCPs (22%; n=28). Few (7%; n=6) studies translated Delphi surveys. Only 3% studies (n=3) analysed Delphi responses by geographical location; all found differences in outcome prioritisation.ConclusionsThere is a disproportionately lower inclusion of international patients, compared with HCPs, in COS-development Delphi surveys, particularly within LMICs. Future international Delphi surveys should consider exploring for geographical and income-based differences in outcome prioritisation.Prospero registration numberCRD42019138519.

Project description:BackgroundA Core Outcome Set (COS) is an agreed list of outcomes that are measured and reported in all clinical trials for a particular health condition. An 'e-Delphi' is an increasingly popular method for developing a COS whereby stakeholders are consulted via a multi-round online survey to reach agreement regarding the most important outcomes. Many COS studies seek diverse, international input that includes professionals and healthcare users. However, the recruitment and retention of participants can be deterred by various factors (e.g. language barriers and iterative, time-consuming rounds). This report evaluates the effectiveness of recruitment and retention methods used in the Core Outcome Measures in Tinnitus International Delphi (COMiT'ID) study using participant feedback from healthcare users, healthcare practitioners, researchers, commercial representatives and funders.MethodsA range of methods were applied to recruit participants to the study and maintain engagement over the three rounds. Feedback on recruitment and retention methods was collected using a twenty-item online questionnaire, with free text comments.ResultsA personalised email invitation was the most frequent recruitment route, and 719 professionals and healthcare users consented to take part. Retention of each stakeholder group ranged from 76 to 91% completing all three e-Delphi rounds. Feedback was given by 379 respondents. A majority of respondents were satisfied with the study methods that were implemented to promote retention. Over 55% indicated that their overall experience closely matched their expectations at the start of the study, and over 90% felt that their contribution was appreciated.ConclusionsThis report highlights study methods that worked well with respect to recruitment and retention, and those that did not. Findings provide a unique contribution to the growing evidence base of good practice in COS development by demonstrating the relative effectiveness of recruitment and retention methods for an e-Delphi survey.Trial registrationThis project was registered (November 2014) in the database of the Core Outcome Measures in Effectiveness Trials (COMET) initiative. The protocol is published in Trials (doi:10.1186/s13063-017-2123-0).

Project description:BACKGROUND:There are numerous challenges in including patients in a core outcome set (COS) study, these can vary depending on the patient group. This study describes current efforts to include patients in the development of COS, with the aim of identifying areas for further improvement and study. METHODS:Using the COMET database, corresponding authors of COS projects registered or published from 1 January 2013 to 2 February 2017 were invited via a personalised email to participate in a short online survey. The survey and emails were constructed to maximise the response rate by following the academic literature on enhancing survey responses. Personalised reminder emails were sent to non-responders. This survey explored the frequency of patient input in COS studies, who was involved, what methods were used and whether or not the COS development was international. RESULTS:One hundred and ninety-two COS developers were sent the survey. Responses were collected from 21 February 2017 until 7 May 2017. One hundred and forty-six unique developers responded, yielding a 76% response rate and data in relation to 195 unique COSs (as some developers had worked on multiple COSs). Of focus here are their responses regarding 162 COSs at the published, completed or ongoing stages of development. Inclusion of patient participants was indicated in 87% (141/162) of COSs in the published completed or ongoing stages and over 94% (65/69) of ongoing COS projects. Nearly half (65/135) of COSs included patient participants from two or more countries and 22% (30/135) included patient participants from five or more countries. The Delphi survey was reported as being used singularly or in combination with other methods in 85% (119/140) of projects. Almost a quarter (16/65) of ongoing studies reported using a combination of qualitative interviews, Delphi survey and consensus meeting. CONCLUSIONS:These findings indicated that the Delphi survey is the most popular method of facilitating patient participation, while the combination of qualitative interviews, Delphi survey and consensus meetings is the most popular combination of methods. The increased inclusion of patient participants in the development of COSs is encouraging, as is the international approach to COS development that some developers are adopting.

Project description:IntroductionThe incidence of anal squamous cell carcinoma (ASCC) has increased threefold in the last 30 years. Initial treatment is chemoradiotherapy, associated with short-term and long-term side effects. Future therapy innovations aim to reduce morbidity in treatment of early tumours while maintaining treatment efficacy, and to escalate treatment intensity in locally advanced tumours with acceptable quality of life (QoL). However, all phase III randomised controlled trials to-date have utilised different primary outcomes, which hinders evidence synthesis and presents challenges to the selection of optimal outcomes in future trials. No trial comprehensively assessed long-term side effects and QoL, suggesting outcomes reflecting issues important to patients are under-represented. This project aims to determine the priority outcomes for all stakeholders and reach agreement on a standardised core set of outcomes to be measured and reported on in all future ASCC trials.Methods and analysisA systematic review will identify all outcomes reported in trials and observational studies of chemoradiotherapy as primary treatment for ASCC. Outcomes of importance to patients will be identified through patient interviews. The long list of outcomes generated from the systematic review and interviews will be used to create a two-round Delphi process, including key stakeholders (patients and healthcare professionals). The results of the Delphi will be discussed at a face-to-face consensus meeting. Discussion will focus on outcomes that did not achieve consensus through the Delphi process and conclude with anonymous voting to ratify the final core outcome set (COS).Ethics and disseminationThe final COS will feed directly into the PersonaLising Anal cancer radioTherapy dOse (PLATO) national anal cancer trials and the Association of coloproctologists of Great Britain and Ireland (ACPGBI) supported national anal cancer database. Utilisation of the COS will increase the relevance of research output to all stakeholders and increase the capacity for data synthesis between trials. This study has ethical approval and is registered with the Core Outcome Measures in Effectiveness Trials (COMET) initiative.Trial registration numberPROSPERO registration ID: CRD42016036540.

Project description:BackgroundMucopolysaccharidoses (MPS) are a group of inherited metabolic diseases characterized by chronic, progressive multi-system manifestations with varying degrees of severity. Disease-modifying therapies exist to treat some types of MPS; however, they are not curative, underscoring the need to identify and evaluate co-interventions that optimize functioning, participation in preferred activities, and quality of life. A Canadian pediatric MPS registry is under development and may serve as a platform to launch randomized controlled trials to evaluate such interventions. To promote the standardized collection of patient/family-reported and clinical outcomes considered important to patients/families, health care providers (HCPs), and policymakers, the choice of outcomes to include in the registry will be informed by a core outcome set (COS). We aim to establish a patient-oriented COS for pediatric MPS using a multi-stakeholder approach.MethodsIn step 1 of the six-step process to develop the COS, we will identify relevant outcomes through a rapid literature review and candidate outcomes survey. A two-phase screening approach will be implemented to identify eligible publications, followed by extraction of outcomes and other pre-specified data elements. Simultaneously, we will conduct a candidate outcomes survey with children with MPS and their families to identify outcomes most important to them. In step 2, HCPs experienced in treating patients with MPS will be invited to review the list of outcomes generated in step 1 and identify additional clinically relevant outcomes. We will then ask patients/families, HCPs, and policymakers to rate the outcomes in a set of Delphi Surveys (step 3), and to participate in a subsequent consensus meeting to finalize the COS (step 4). Step 5 involves establishing a set of outcome measurement instruments for the COS. Finally, we will disseminate the COS to knowledge users (step 6).DiscussionThe proposed COS will inform the choice of outcomes to include in the MPS registry and, more broadly, promote the standardized collection of patient-oriented outcomes for pediatric MPS research. By involving patients/families from the earliest stage of the research, we will ensure that the COS will be relevant to those who will ultimately benefit from the research.Trial registrationPROSPERO CRD42021267531 , COMET.

Project description:BackgroundAs the development of core outcome sets (COS) increases, guidance for developing and reporting high-quality COS continues to evolve; however, a number of methodological uncertainties still remain. The objectives of this study were: (1) to explore the impact of including patient interviews in developing a COS, (2) to examine the impact of using a 5-point versus a 9-point rating scale during Delphi consensus methods on outcome selection and (3) to inform and contribute to COS development methodology by advancing the evidence base on COS development techniques.MethodsSemi-structured patient interviews and a nested randomised controlled parallel group trial as part of the Pelvic Girdle Pain Core Outcome Set project (PGP-COS). Patient interviews, as an adjunct to a systematic review of outcomes reported in previous studies, were undertaken to identify preliminary outcomes for including in a Delphi consensus survey. In the Delphi survey, participants were randomised (1:1) to a 5-point or 9-point rating scale for rating the importance of the list of preliminary outcomes.ResultsFour of the eight patient interview derived outcomes were included in the preliminary COS, however, none of these outcomes were included in the final PGP-COS. The 5-point rating scale resulted in twice as many outcomes reaching consensus after the 3-round Delphi survey compared to the 9-point scale. Consensus on all five outcomes included in the final PGP-COS was achieved by participants allocated the 5-point rating scale, whereas consensus on four of these was achieved by those using the 9-point scale.ConclusionsUsing patient interviews to identify preliminary outcomes as an adjunct to conducting a systematic review of outcomes measured in the literature did not appear to influence outcome selection in developing the COS in this study. The use of different rating scales in a Delphi survey, however, did appear to impact on outcome selection. The 5-point scale demonstrated greater congruency than the 9-point scale with the outcomes included in the final PGP-COS. Future research to substantiate our findings and to explore the impact of other rating scales on outcome selection during COS development, however, is warranted.

Dataset Information

Participating in core outcome set development via Delphi surveys: qualitative interviews provide pointers to inform guidance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets