Dataset Information

Improving Comparative Effectiveness Research of Complex Health Interventions: Standards from the Patient-Centered Outcomes Research Institute (PCORI).

ABSTRACT: INTRODUCTION:Complex health interventions (CHIs) are increasingly studied in comparative effectiveness research (CER), and there is a need for improvements in CHI research practices. The Patient-Centered Outcomes Research Institute (PCORI) Methodology Committee (MC) launched an effort in 2016 to develop formal guidance on this topic. OBJECTIVE:To develop a set of minimal standards for scientifically valid, transparent, and reproducible CER studies of CHIs. The standards are intended to apply to research examining a broad range of healthcare interventions including delivery system, behavior change, and other non-pharmacological interventions. METHODS:We conducted a literature review, reviewed existing methods guidance, and developed standards through an iterative process involving the MC, two panels of external research methods experts, and a 60-day public comment period. The final standards were approved by the PCORI MC and adopted by the PCORI Board of Governors on April 30, 2018. RESULTS:The final standards include the following: (1) fully describe the intervention and comparator and define their core functions, (2) specify the hypothesized causal pathways and their theoretical basis, (3) specify how adaptations to the form of the intervention and comparator will be allowed and recorded, (4) plan and describe a process evaluation, and (5) select patient outcomes informed by the causal pathway. DISCUSSION:The new standards offer three major contributions to research: (1) they provide a simple framework to help investigators address the major methodological features of a CHI study, (2) they emphasize the importance of the causal model and the need to understand how a CHI achieves its effects rather than simply measuring these effects, and (3) they require description of a CHI using the concepts of core functions and forms. While these standards apply formally to PCORI-funded CER studies, they have broad applicability.

SUBMITTER: Esmail LC

PROVIDER: S-EPMC7652976 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Improving Comparative Effectiveness Research of Complex Health Interventions: Standards from the Patient-Centered Outcomes Research Institute (PCORI).

Esmail Laura C LC Barasky Rebecca R Mittman Brian S BS Hickam David H DH

Journal of general internal medicine 20201026 Suppl 2

<h4>Introduction</h4>Complex health interventions (CHIs) are increasingly studied in comparative effectiveness research (CER), and there is a need for improvements in CHI research practices. The Patient-Centered Outcomes Research Institute (PCORI) Methodology Committee (MC) launched an effort in 2016 to develop formal guidance on this topic.<h4>Objective</h4>To develop a set of minimal standards for scientifically valid, transparent, and reproducible CER studies of CHIs. The standards are intend ...[more]

PMID: 33107006

Similar Datasets

Project description:BackgroundWe used various methods for identifying and prioritizing patient-centered outcomes (PCOs) for comparative effectiveness research (CER).MethodsWe considered potential PCOs ("benefits" and "harms") related to (1) gabapentin for neuropathic pain and (2) quetiapine for bipolar depression. Part 1 (April 2014 to March 2015): we searched for PCO research and core outcome sets (COSs). We conducted electronic searches of bibliographic databases and key websites and examined FDA prescribing information and reports of clinical trials and systematic reviews. We asked patient and clinician co-investigators to identify PCOs. Part 2 (not part of our original study protocol): in 2015, we surveyed members of The TMJ Association, Ltd., a patient group associated with temporomandibular disorders (4130 invitations sent). Participants prioritized (1) the importance of six potential benefits and (2) 21 potential harms selected by the investigators in part 1, using stated preference methods. We calculated descriptive statistics.ResultsIn part 1, we identified a COS for pain, the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) recommendations. The COS identified several important benefits, but it lacked specific recommendations about which potential harms to include in CER. We did not identify a COS for bipolar depression. Research reports, prescribing information, and patient co-investigators helped identify but not prioritize outcomes. We abandoned our electronic search for PCO research because we found it would be resource-intensive and yield few relevant reports. In part 2, surveying patients was useful for prioritizing PCOs. Members of The TMJ Association, Ltd., completed the survey (N =?746) and successfully prioritized both benefits and harms. Participants did not identify many benefits other than those we identified in part 1; several participants identified additional harms.ConclusionsThese exploratory results could inform future research about identifying and prioritizing PCOs. We found that stakeholder co-investigators and research reports contributed to identifying PCOs; surveying a patient group contributed to prioritizing PCOs. Prioritizing potential harms was particularly challenging because there are many more potential harms than potential benefits. Methods for identifying and prioritizing potential benefits for CER might not be appropriate for harms. Further research is needed to determine the generalizability of these results.

Project description:This project compared the effectiveness of two evidence-based models of culturally competent diabetes health promotion: The Diabetes Self-Management Support Empowerment Model (DSMS), and The Chronic Care Model (CCM). Our primary outcome was improvement in patient capacity for diabetes self-management as measured by the Diabetes Knowledge Questionnaire (DKQ) and the Patient Activation Measure (PAM). Our secondary outcome was patient success at diabetes self-management as measured by improvement in A1c, depression sores using the PHQ-9, and Body Mass Index (BMI). We also gathered data on the cultural competence of the program using the Consumer Assessment of Healthcare Providers and Systems Cultural Competence Set (CAHPS-CC). We compared patient outcomes in two existing sites in Albuquerque, New Mexico that serve a large population of Latino diabetes patients from low-income households. Participants were enrolled as dyads-a patient participant (n=226) and a social support participant (n=226). Outcomes over time and by program were analyzed using longitudinal linear mixed modeling, adjusted for patient participant demographic characteristics and other potential confounding covariates. Secondary outcomes were also adjusted for potential confounders. Interactions with both time and program helped to assess outcomes. This study did not find a difference between the two sites with respect to the primary outcome measures and only one of the three secondary outcomes showed differential results. The main difference between programs was that depression decreased more for CCM than for DSMS. An exploratory, subgroup analysis revealed that at CCM, patient participants with a very high A1c (>10) demonstrated a clinically meaningful decrease. However, given the higher cultural competence rating for the CCM, statistically significant improvement in depression, and the importance of social support to the patients, results suggest that a culturally and contextually situated diabetes self-management and education program design may deliver benefit for patients, especially for patients with higher A1c levels.

Project description:OBJECTIVE:The peer review of completed Patient-Centered Outcomes Research Institute (PCORI) funded research includes reviews from patient reviewers (patients, caregivers, and patient advocates). Very little is known about how best to support these reviewers in writing helpful comments from a patient-centred perspective. This study aimed to evaluate the effect of a new training in peer review for patient reviewers. DESIGN:Observational study. SETTING:Online. PARTICIPANTS:Adults registered in the PCORI Reviewer Database as a patient stakeholder. INTERVENTION:A new online training in peer review. MAIN OUTCOME MEASURES:Changes in reviewers' knowledge and skills; change in self-efficacy and attitudes, satisfaction with the training and perceived benefits and relevance of the training. RESULTS:Before-after training survey data were analysed for 37 (29.4% of 126) patient reviewers invited to participate in an online training as part of a quality improvement effort or as part of a PCORI peer review. The reviewers improved their answers to the knowledge questions (p<0.001, median number of answers improved 4 (95% CI 3 to 5), large effect size (ES) Cohen's w=0.94) after the training, particularly in the questions targeting the specifics of PCORI peer review. Reviewers improved their skills in recognising helpful review comments, but those without peer-review background improved proportionally more (p=0.008, median number of answers improved 2 (95% CI 1 to 3), medium ES w=0.60). The use of training modestly increased reviewers' confidence in completing a high-quality peer review (p=0.005, mean increase in 5-point Likert rating 0.51 (95% CI 0.17 to 0.86), small-to-medium ES Cliff's delta=0.32) and their excitement about providing a review slightly increased (p=0.019, mean increase in 5-point Likert rating 0.35 (95% CI 0.03 to 0.68), small ES delta=0.19). All reviewers were satisfied with the training and would recommend it to other reviewers. CONCLUSIONS:Training improved knowledge, skills and self-efficacy and slightly increased enthusiasm for completing a PCORI peer review.

Dataset Information

Improving Comparative Effectiveness Research of Complex Health Interventions: Standards from the Patient-Centered Outcomes Research Institute (PCORI).

Publications

Improving Comparative Effectiveness Research of Complex Health Interventions: Standards from the Patient-Centered Outcomes Research Institute (PCORI).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets