Dataset Information

Patient and public engagement in research and health system decision making: A systematic review of evaluation tools.

ABSTRACT: BACKGROUND:Patient and public engagement is growing, but evaluative efforts remain limited. Reviews looking at evaluation tools for patient engagement in individual decision making do exist, but no similar articles in research and health systems have been published. OBJECTIVE:Systematically review and appraise evaluation tools for patient and public engagement in research and health system decision making. METHODS:We searched literature published between January 1980 and February 2016. Electronic databases (Ovid MEDLINE, Embase, Cochrane Database of Systematic Reviews, CINAHL and PsycINFO) were consulted, as well as grey literature obtained through Google, subject-matter experts, social media and engagement organization websites. Two independent reviewers appraised the evaluation tools based on 4 assessment criteria: scientific rigour, patient and public perspective, comprehensiveness and usability. RESULTS:In total, 10 663 unique references were identified, 27 were included. Most of these tools were developed in the last decade and were designed to support improvement of engagement activities. Only 11% of tools were explicitly based on a literature review, and just 7% were tested for reliability. Patients and members of the public were involved in designing 56% of the tools, mainly in the piloting stage, and 18.5% of tools were designed to report evaluation results to patients and the public. CONCLUSION:A growing number of evaluation tools are available to support patient and public engagement in research and health system decision making. However, the scientific rigour with which such evaluation tools are developed could be improved, as well as the level of patient and public engagement in their design and reporting.

SUBMITTER: Boivin A

PROVIDER: S-EPMC6250878 | biostudies-other | 2018 Dec

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Patient and public engagement in research and health system decision making: A systematic review of evaluation tools.

Boivin Antoine A L'Espérance Audrey A Gauvin François-Pierre FP Dumez Vincent V Macaulay Ann C AC Lehoux Pascale P Abelson Julia J

Health expectations : an international journal of public participation in health care and health policy 20180730 6

<h4>Background</h4>Patient and public engagement is growing, but evaluative efforts remain limited. Reviews looking at evaluation tools for patient engagement in individual decision making do exist, but no similar articles in research and health systems have been published.<h4>Objective</h4>Systematically review and appraise evaluation tools for patient and public engagement in research and health system decision making.<h4>Methods</h4>We searched literature published between January 1980 and Fe ...[more]

PMID: 30062858

Similar Datasets

Project description:BackgroundPatient, public, consumer, and community (P2C2) engagement in organization-, community-, and systemlevel healthcare decision-making is increasing globally, but its formal evaluation remains challenging. To define a taxonomy of possible P2C2 engagement metrics and compare existing evaluation tools against this taxonomy, we conducted a systematic review.MethodsA broad search strategy was developed for English language publications available from January 1962 through April 2015 in PubMed, Embase, Sociological Abstracts, PsycINFO, EconLit, and the gray literature. A publication was excluded if: (1) the setting was not healthcare delivery (ie, we excluded non-health sectors, such as urban planning; research settings; and public health settings not involving clinical care delivery); (2) the P2C2 engagement was episodic; or (3) the concept of evaluation or possible evaluation metrics were absent. To be included as an evaluation tool, publications had to contain an evaluative instrument that could be employed with minimal modification by a healthcare organization.ResultsA total of 199 out of 3953 publications met exclusion and inclusion criteria. These were qualitatively analyzed using inductive content analysis to create a comprehensive taxonomy of 116 possible metrics for evaluating P2C2 engagement. 44 outcome metrics were grouped into three domains (internal, external, and aggregate outcomes) that included six subdomains: impact on engagement participants, impact on services provided by the healthcare organization, impact on the organization itself, influence on the broader public, influence on population health, and engagement cost-effectiveness. The 72 process metrics formed four domains (direct process metrics; surrogate process metrics; aggregate process metrics; and preconditions for engagement) that comprised sixteen subdomains. We identified 23 potential tools for evaluating P2C2 engagement. The identified tools were published between 1973-2015 and varied in their coverage of the taxonomy, methodology used (qualitative, quantitative, or mixed), and intended evaluators (organizational leaders, P2C2 participants, external evaluators, or some combination). Parts of the metric taxonomy were absent from all tools.ConclusionBy comprehensively mapping potential outcome and process metrics as well as existing P2C2 engagement tools, this review supports high-quality P2C2 engagement globally by informing the selection of existing evaluation tools and identifying gaps where new tools are needed.

Project description:BackgroundWith healthcare striving to shift to a more person-centered delivery model, patient and family involvement must have a bigger role in shaping this. While many initiatives involving patients and family members focus on self-care, a broader understanding of patient participation is necessary. Ensuring a viable and sustainable critical number of qualified patients and family members to support this shift will be of utmost importance. The purpose of this study was to understand how health systems are intentionally investing in the training and skill development of patients and family members.MethodsPatient co-investigators and researchers conducted a scoping review of the existing literature on methods adopted by healthcare systems to build the skills and capacity of patients to participate in healthcare decision-making using a recognized methodological framework. Six electronic databases were searched to identify studies. Two independent reviewers screened titles and abstracts and full-text papers for inclusion. The research team independently extracted data. Any disagreements were resolved by achieving consensus through discussion. Quantitative and qualitative content synthesis, as well as a quality assessment, was conducted.ResultsAfter eliminating duplicates, the search resulted in 9428 abstracts. Four hundred fifty-eight articles were reviewed and 15 articles were included. Four themes emerged: forums (33%), patient instructors (20%), workshops (33%), and co-design (13%). Four of the identified studies measured the impact and overall effectiveness of the respective programs. Examples of how patient and family members were supported (invested in) included advocacy training to support future involvement in engagement activities, a training program to conduct patient-led research, involvement in an immersive experience-based co-design initiative, and involvement in training pharmacy students. Overall, these studies found positive outcomes when patients and family members were recipients of these opportunities.ConclusionsThe results of this scoping review demonstrate that an evidence base around programs to advance patient engagement is largely absent. An opportunity exists for further research to identify strategies and measures to support patient engagement in healthcare decision-making.

Project description:BackgroundPublic health professionals are increasingly expected to engage in evidence-informed decision making to inform practice and policy decisions. Evidence-informed decision making involves the use of research evidence along with expertise, existing public health resources, knowledge about community health issues, the local context and community, and the political climate. The National Collaborating Centre for Methods and Tools has identified a seven step process for evidence-informed decision making. Tools have been developed to support public health professionals as they work through each of these steps. This paper provides an overview of tools used in three Canadian public health departments involved in a study to develop capacity for evidence-informed decision making.MethodsAs part of a knowledge translation and exchange intervention, a Knowledge Broker worked with public health professionals to identify and apply tools for use with each of the steps of evidence-informed decision making. The Knowledge Broker maintained a reflective journal and interviews were conducted with a purposive sample of decision makers and public health professionals. This paper presents qualitative analysis of the perceived usefulness and usability of the tools.ResultsTools were used in the health departments to assist in: question identification and clarification; searching for the best available research evidence; assessing the research evidence for quality through critical appraisal; deciphering the 'actionable message(s)' from the research evidence; tailoring messages to the local context to ensure their relevance and suitability; deciding whether and planning how to implement research evidence in the local context; and evaluating the effectiveness of implementation efforts. Decision makers provided descriptions of how the tools were used within the health departments and made suggestions for improvement. Overall, the tools were perceived as valuable for advancing and sustaining evidence-informed decision making.ConclusionTools are available to support the process of evidence-informed decision making among public health professionals. The usability and usefulness of these tools for advancing and sustaining evidence-informed decision making are discussed, including recommendations for the tools' application in other public health settings beyond this study. Knowledge and awareness of these tools may assist other health professionals in their efforts to implement evidence-informed practice.

Project description:BackgroundThe use of research evidence to underpin public health policy is strongly promoted. However, its implementation has not been straightforward. The objectives of this systematic review were to synthesise empirical evidence on the use of research evidence by public health decision makers in settings with universal health care systems.MethodsTo locate eligible studies, 13 bibliographic databases were screened, organisational websites were scanned, key informants were contacted and bibliographies of included studies were scrutinised. Two reviewers independently assessed studies for inclusion, extracted data and assessed methodological quality. Data were synthesised as a narrative review.Findings18 studies were included: 15 qualitative studies, and three surveys. Their methodological quality was mixed. They were set in a range of country and decision making settings. Study participants included 1063 public health decision makers, 72 researchers, and 174 with overlapping roles. Decision making processes varied widely between settings, and were viewed differently by key players. A range of research evidence was accessed. However, there was no reliable evidence on the extent of its use. Its impact was often indirect, competing with other influences. Barriers to the use of research evidence included: decision makers' perceptions of research evidence; the gulf between researchers and decision makers; the culture of decision making; competing influences on decision making; and practical constraints. Suggested (but largely untested) ways of overcoming these barriers included: research targeted at the needs of decision makers; research clearly highlighting key messages; and capacity building. There was little evidence on the role of research evidence in decision making to reduce inequalities.ConclusionsTo more effectively implement research informed public health policy, action is required by decision makers and researchers to address the barriers identified in this systematic review. There is an urgent need for evidence to support the use of research evidence to inform public health decision making to reduce inequalities.

Project description:BACKGROUND: A compelling ethical rationale supports patient engagement in healthcare research. It is also assumed that patient engagement will lead to research findings that are more pertinent to patients' concerns and dilemmas. However; it is unclear how to best conduct this process. In this systematic review we aimed to answer 4 key questions: what are the best ways to identify patient representatives? How to engage them in designing and conducting research? What are the observed benefits of patient engagement? What are the harms and barriers of patient engagement? METHODS: We searched MEDLINE, EMBASE, PsycInfo, Cochrane, EBSCO, CINAHL, SCOPUS, Web of Science, Business Search Premier, Academic Search Premier and Google Scholar. Included studies were published in English, of any size or design that described engaging patients or their surrogates in research design. We conducted an environmental scan of the grey literature and consulted with experts and patients. Data were analyzed using a non-quantitative, meta-narrative approach. RESULTS: We included 142 studies that described a spectrum of engagement. In general, engagement was feasible in most settings and most commonly done in the beginning of research (agenda setting and protocol development) and less commonly during the execution and translation of research. We found no comparative analytic studies to recommend a particular method. Patient engagement increased study enrollment rates and aided researchers in securing funding, designing study protocols and choosing relevant outcomes. The most commonly cited challenges were related to logistics (extra time and funding needed for engagement) and to an overarching worry of a tokenistic engagement. CONCLUSIONS: Patient engagement in healthcare research is likely feasible in many settings. However, this engagement comes at a cost and can become tokenistic. Research dedicated to identifying the best methods to achieve engagement is lacking and clearly needed.

Project description:BackgroundTherapeutic decision-making in oncology is a complex process because physicians must consider many forms of medical data and protocols. Another challenge for physicians is to clearly communicate their decision-making process to patients to ensure informed consent. Computer-based decision tools have the potential to play a valuable role in supporting this process.ObjectiveThis systematic review aims to investigate the extent to which computer-based decision tools have been successfully adopted in oncology consultations to improve patient-physician joint therapeutic decision-making.MethodsThis review was conducted in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 checklist and guidelines. A literature search was conducted on February 4, 2021, across the Cochrane Database of Systematic Reviews (from 2005 to January 28, 2021), the Cochrane Central Register of Controlled Trials (December 2020), MEDLINE (from 1946 to February 4, 2021), Embase (from 1947 to February 4, 2021), Web of Science (from 1900 to 2021), Scopus (from 1969 to 2021), and PubMed (from 1991 to 2021). We used a snowball approach to identify additional studies by searching the reference lists of the studies included for full-text review. Additional supplementary searches of relevant journals and gray literature websites were conducted. The reviewers screened the articles eligible for review for quality and inclusion before data extraction.ResultsThere are relatively few studies looking at the use of computer-based decision tools in oncology consultations. Of the 4431 unique articles obtained from the searches, only 10 (0.22%) satisfied the selection criteria. From the 10 selected studies, 8 computer-based decision tools were identified. Of the 10 studies, 6 (60%) were conducted in the United States. Communication and information-sharing were improved between physicians and patients. However, physicians did not change their habits to take advantage of computer-assisted decision-making tools or the information they provide. On average, the use of these computer-based decision tools added approximately 5 minutes to the total length of consultations. In addition, some physicians felt that the technology increased patients' anxiety.ConclusionsOf the 10 selected studies, 6 (60%) demonstrated positive outcomes, 1 (10%) showed negative results, and 3 (30%) were neutral. Adoption of computer-based decision tools during oncology consultations continues to be low. This review shows that information-sharing and communication between physicians and patients can be improved with the assistance of technology. However, the lack of integration with electronic health records is a barrier. This review provides key requirements for enhancing the chance of success of future computer-based decision tools. However, it does not show the effects of health care policies, regulations, or business administration on physicians' propensity to adopt the technology. Nevertheless, it is important that future research address the influence of these higher-level factors as well.Trial registrationPROSPERO International Prospective Register of Systematic Reviews CRD42021226087; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021226087.

Dataset Information

Patient and public engagement in research and health system decision making: A systematic review of evaluation tools.

Publications

Patient and public engagement in research and health system decision making: A systematic review of evaluation tools.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets