Dataset Information

Training patients to review scientific reports for the Patient-Centered Outcomes Research Institute: an observational study.

ABSTRACT: OBJECTIVE:The peer review of completed Patient-Centered Outcomes Research Institute (PCORI) funded research includes reviews from patient reviewers (patients, caregivers, and patient advocates). Very little is known about how best to support these reviewers in writing helpful comments from a patient-centred perspective. This study aimed to evaluate the effect of a new training in peer review for patient reviewers. DESIGN:Observational study. SETTING:Online. PARTICIPANTS:Adults registered in the PCORI Reviewer Database as a patient stakeholder. INTERVENTION:A new online training in peer review. MAIN OUTCOME MEASURES:Changes in reviewers' knowledge and skills; change in self-efficacy and attitudes, satisfaction with the training and perceived benefits and relevance of the training. RESULTS:Before-after training survey data were analysed for 37 (29.4% of 126) patient reviewers invited to participate in an online training as part of a quality improvement effort or as part of a PCORI peer review. The reviewers improved their answers to the knowledge questions (p<0.001, median number of answers improved 4 (95% CI 3 to 5), large effect size (ES) Cohen's w=0.94) after the training, particularly in the questions targeting the specifics of PCORI peer review. Reviewers improved their skills in recognising helpful review comments, but those without peer-review background improved proportionally more (p=0.008, median number of answers improved 2 (95% CI 1 to 3), medium ES w=0.60). The use of training modestly increased reviewers' confidence in completing a high-quality peer review (p=0.005, mean increase in 5-point Likert rating 0.51 (95% CI 0.17 to 0.86), small-to-medium ES Cliff's delta=0.32) and their excitement about providing a review slightly increased (p=0.019, mean increase in 5-point Likert rating 0.35 (95% CI 0.03 to 0.68), small ES delta=0.19). All reviewers were satisfied with the training and would recommend it to other reviewers. CONCLUSIONS:Training improved knowledge, skills and self-efficacy and slightly increased enthusiasm for completing a PCORI peer review.

SUBMITTER: Ivlev I

PROVIDER: S-EPMC6756350 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Training patients to review scientific reports for the Patient-Centered Outcomes Research Institute: an observational study.

Ivlev Ilya I Vander Ley Kelly J KJ Wiedrick Jack J Lesley Kira K Forester Amy A Webb Rebekah R Broitman Marina M Eden Karen B KB

BMJ open 20190920 9

<h4>Objective</h4>The peer review of completed Patient-Centered Outcomes Research Institute (PCORI) funded research includes reviews from patient reviewers (patients, caregivers, and patient advocates). Very little is known about how best to support these reviewers in writing helpful comments from a patient-centred perspective. This study aimed to evaluate the effect of a new training in peer review for patient reviewers.<h4>Design</h4>Observational study.<h4>Setting</h4>Online.<h4>Participants< ...[more]

PMID: 31542741

Similar Datasets

Project description:International experts have recommended actions that funders can take to improve the value of research investments. They state that self-assessment and public sharing are the basis for accountability and improvement. We examined our policies and practice to determine the extent to which the Patient-Centered Outcomes Research Institute's (PCORI) policies and practices as a research funder align with international best practice recommendations. A self-audit of current policies and practice against 17 recommendations and 35 sub-recommendations representing five major stages of research production, based on adapted methods used for self-assessment by another funder, was performed. Fit of existing PCORI policies and practices with 35 sub-recommendations, qualitative assessment of adequacy (area of strength; area of partial strength; area of growth; not applicable) for 17 recommendations for five stages of research production was assessed. Of the 17 recommendations, 15 were applicable to PCORI's research mission and focus. PCORI has policies and practices in place for all elements of six recommendations ("area of strength") and policies that address each element but with some still in active development for three ("area of partial strength"). PCORI is partially addressing six of the 15 relevant recommendations ("area of growth"). Areas for growth include making study protocols publicly available, improving policies on data sharing, and enhancing collaboration with other funders to reduce redundant funding. A voluntary consortium of international funders is underway to encourage further progress, including additional self-assessment and public sharing for accountability. These findings indicate PCORI has undertaken efforts to align its funding practices with international recommendations to ensure the value of public dollars invested in research. Further efforts will likely require additional coordination and collaboration between funders and stakeholders.

Project description:BackgroundPatient-centered outcomes research (PCOR) emphasizes patient-generated research priorities and outcomes, and engages patients throughout every stage of the research process. In the cystic fibrosis (CF) community, patients frequently provide input into research studies, but rarely are integrated onto research teams. Therefore, we developed and evaluated a virtual pilot PCOR training program to build PCOR capacity in the CF community (patients, caregivers, researchers, nonprofit stakeholders and providers). We aimed to show changes among participants' perceived PCOR knowledge (a.k.a PCOR knowledge), confidence in engaging stakeholders, and post-training session satisfaction.MethodsGuided by a prior CF community educational needs assessment, our researcher and patient-partner team co-developed a four-part virtual online training program. We structured the program towards two learner groups: patients/caregivers and researchers/providers. We evaluated participants' PCOR knowledge, confidence in engaging stakeholders, and session satisfaction by administering 5-point Likert participant surveys. We tested for significant differences between median ratings pre- and post-training.ResultsA total of 28 patients/caregivers, and 31 researchers/providers participated. For both learner groups, we found the training resulted in significantly higher PCOR knowledge scores regarding "levels of engagement" (p = .008). For the patient/caregiver group, training significantly increased their PCOR knowledge about the barriers/enablers to doing PCOR (p = .017), effective PCOR team elements (p = .039), active participation (p = .012), and identifying solutions for successful PCOR teams (p = .021). For the researcher/healthcare provider group, training significantly increased participants' ability to describe PCOR core principles (p = .016), identify patient-partners (p = .039), formulate research from patient-driven priorities (p = .039), and describe engagement in research grants (p = .006). No learner group had significant changes in their confidence score. Most participants were either "satisfied" or "very satisfied" with the training program.ConclusionsOverall, our virtual pilot PCOR training program was well received by patients, caregivers, researchers and providers in the CF community. Participants significantly improved their perceived knowledge with core PCOR learning items. Trial registration Retrospectively registered at clinicaltrials.gov (NCT04999865).

Dataset Information

Training patients to review scientific reports for the Patient-Centered Outcomes Research Institute: an observational study.

Publications

Training patients to review scientific reports for the Patient-Centered Outcomes Research Institute: an observational study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets