Dataset Information

Supporting the evaluation of public and patient engagement in health system organizations: Results from an implementation research study.

ABSTRACT:

Background

As citizens, patients and family members are participating in numerous and expanding roles in health system organizations, attention has turned to evaluating these efforts. The context-specific nature of engagement requires evaluation tools to be carefully designed for optimal use. We sought to address this need by assessing the appropriateness and feasibility of a generic tool across a range of health system organizations, engagement activities and patient groups.

Methods

We used a mixed-methods implementation research design to study the implementation of an engagement evaluation tool in seven health system organizations in Ontario, Canada focusing on two key implementation outcome variables: appropriateness and feasibility. Data were collected through respondent feedback questions (binary and open-ended) at the end of the tool's three questionnaires as well as interviews and debriefing discussions with engagement professionals and patient partners from collaborating organizations.

Results

The three questionnaires comprising the evaluation tool were collectively administered 29 times to 405 respondents yielding a 52% response rate (90% and 53% of respondents respectively assessed the survey's appropriateness and feasibility [quantitatively or qualitatively]). The questionnaires' basic properties were rated highly by all respondents. Concrete suggestions were provided for improving the appropriateness and feasibility of the questionnaires (or components within) for different engagement activity and organization types, and for enhancing the timing of implementation.

Discussion and conclusions

Our study findings offer guidance for health system organizations and evaluators to support the optimal use of engagement evaluation tools across a variety of health system settings, engagement activities and respondent groups.

SUBMITTER: Abelson J

PROVIDER: S-EPMC6803403 | biostudies-literature | 2019 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Supporting the evaluation of public and patient engagement in health system organizations: Results from an implementation research study.

Abelson Julia J Tripp Laura L Kandasamy Sujane S Burrows Kristen K

Health expectations : an international journal of public participation in health care and health policy 20190802 5

<h4>Background</h4>As citizens, patients and family members are participating in numerous and expanding roles in health system organizations, attention has turned to evaluating these efforts. The context-specific nature of engagement requires evaluation tools to be carefully designed for optimal use. We sought to address this need by assessing the appropriateness and feasibility of a generic tool across a range of health system organizations, engagement activities and patient groups.<h4>Methods< ...[more]

PMID: 31373754

Similar Datasets

Project description:BackgroundPatient-physician communication during clinical encounters is essential to ensure quality of care. Many studies have attempted to improve patient-physician communication. Incorporating patient priorities into agenda setting and medical decision-making are fundamental to patient-centered communication. Efficient and scalable approaches are needed to empower patients to speak up and prepare physicians to respond. Leveraging electronic health records (EHRs) in engaging patients and health care teams has the potential to enhance the integration of patient priorities in clinical encounters. A systematic approach to eliciting and documenting patient priorities before encounters could facilitate effective communication in such encounters.ObjectiveIn this paper, we report the design and implementation of a set of EHR tools built into clinical workflows for facilitating patient-physician joint agenda setting and the documentation of patient concerns in the EHRs for ambulatory encounters.MethodsWe engaged health information technology leaders and users in three health care systems for developing and implementing a set of EHR tools. The goal of these tools is to standardize the elicitation of patient priorities by using a previsit "patient important issue" questionnaire distributed through the patient portal to the EHR. We built additional EHR documentation tools to facilitate patient-staff communication when the staff records the vital signs and the reason for the visit in the EHR while in the examination room, with a simple transmission method for physicians to incorporate patient concerns in EHR notes.ResultsThe study is ongoing. The anticipated completion date for survey data collection is November 2021. A total of 34,037 primary care patients from three health systems (n=26,441; n=5136; and n=2460 separately recruited from each system) used the previsit patient important issue questionnaire in 2020. The adoption of the digital previsit questionnaire during the COVID-19 pandemic was much higher in one health care system because it expanded the use of the questionnaire from physicians participating in trials to all primary care providers midway through the year. It also required the use of this previsit questionnaire for eCheck-ins, which are required for telehealth encounters. Physicians and staff suggested anecdotally that this questionnaire helped patient-clinician communication, particularly during the COVID-19 pandemic.ConclusionsEHR tools have the potential to facilitate the integration of patient priorities into agenda setting and documentation in real-world primary care practices. Early results suggest the feasibility and acceptability of such digital tools in three health systems. EHR tools can support patient engagement and clinicians' work during in-person and telehealth visits. They could potentially exert a sustained influence on patient and clinician communication behaviors in contrast to prior ad hoc educational efforts targeting patients or clinicians.Trial registrationClinicalTrials.gov NCT03385512; https://clinicaltrials.gov/ct2/show/NCT03385512.International registered report identifier (irrid)DERR1-10.2196/30431.

Project description:Background:High quality public engagement and involvement (PEI) in data-intensive health research is seen as one way of ensuring that social legitimacy, i.e. a social license, is conferred through public acceptance of the need for research use of their data. This is a complex research area, and portfolios of involvement have been suggested, but not yet evaluated, to support the role of public contributors. The study aim was to evaluate if and how membership of a data-intensive research public forum can act as a mechanism for enhancing members' personal development. Our objective was to understand the circumstances and mechanisms that help to explain how, why and for whom involvement with a public forum enhanced those members' personal development. Method:Qualitative data were collected from 15 current and previous members, via semi-structured interviews, notes from meetings, and consultations with and feedback from members. Data were critically compared, contrasted and reviewed until no new themes could be discerned and then condensed into context-mechanism-outcome (CMO) configurations. Realist evaluation was used to generate a theoretical and empirical appreciation of the contextual circumstances and mechanisms which help to explain the extent to which involvement with a public forum would enhance members' personal development and, if so, how, why, and for whom. Results:Three CMO configurations were identified. All of them showed that using the portfolio facilitated growth in forum members' personal development, but only where the members valued using the portfolio. This was particularly so for female members. Members valued the portfolio in one or more of three ways: as a tool to record and evidence activities, to facilitate reflective practice or as a guiding framework. Conclusions:Data analysis and consideration of the three CMO configurations suggests a refined middle range theory that 'The use of a portfolio as a framework for learning in a public forum will facilitate members' personal development if they value its use as a framework for learning'. Further work is needed to confirm these findings both elsewhere in data-intensive health research and in other complex research areas using public forums for PEI. Plain English summary:Public engagement and involvement in health research is now well established and makes a valuable contribution to the research process. However, little is known about its impact on participants. This article investigates how involvement in a data-intensive health research public forum impacts on public forum members, rather than the research process. Personal involvement portfolios were used to support their involvement work and help evaluate if and how involvement in research activities enhanced members' personal development. Taking a realist evaluation approach, 'Context-Mechanism-Outcome' configurations were used to explore how membership of a public forum might enhance public forum members' personal development. The Context-Mechanism-Outcome configuration refers to an exploration of what influences the extent to which an intervention is successful or unsuccessful in producing positive outcomes and tries to identify the reasons why it is successful for some and unsuccessful for others. However, evidence from this realist evaluation recommends that engagement and involvement should always be underpinned by procedures which ensure that public contributors receive ongoing and tailored guidance and support throughout the process.

Project description:BACKGROUND:In 2010, the Patient Centered Outcomes Research Institute (PCORI) was created to fund patient-centered research that meaningfully engages stakeholders impacted by that research. As a result, investigators became interested in understanding who are appropriate stakeholders and what meaningful engagement in research looks like (6, 8-10). OBJECTIVE:To understand how and when stakeholder engagement worked well and identify areas for enhancing engagement in a PCORI-funded research study of peer-to-peer support of older adults in three communities across the USA. DESIGN:Qualitative interview study. PARTICIPANTS:Twelve members of the inter-disciplinary research team. APPROACH:Interviews were conducted via phone, recorded, and transcribed. Transcripts were analyzed using a constant comparative method to identify themes. Transcripts were independently coded; coded themes were discussed by a small group of the research team to check interpretation and clarify meaning. Once initial themes were identified, the interviews and codes were shared with an external consultant who recoded all 12 transcripts and conducted further analysis and interpretation. Documentation from research meetings was used to validate our findings. KEY RESULTS:Strategies for facilitating meaningful engagement in the partnership, proposal, study design, and planning phase were very similar to community-based participatory research and include the use of community to identify research needs, equitable compensation and leadership, and budgeting for engagement activities. Strategies in the data collection phase include the use of cultural brokers, weekly data calls between the academic PI and imbedded research assistants, and maintaining joint ownership for research. CONCLUSIONS:Major funding institutions (e.g., NIH, PCORI) recognize that community engagement leads to higher quality, more meaningful research (7, 21). Our results support that assumption and in addition, suggest an investment in engagement strategies at the onset of a research project and the use of cultural brokers can greatly contribute to the success of implementing a large, multi-site research project.

Project description:BackgroundSmartphones are being increasingly used for research owing to their multifunctionality and flexibility, and crowdsourced research using smartphone applications (apps) is effective in the early detection and management of chronic diseases. We developed the AllerSearch app to gather real-world data on individual subjective symptoms and lifestyle factors related to hay fever. This study established a foundation for interactive research by adopting novel, diverse perspectives accrued through implementing the principles of patient and public involvement (PPI) in the development of our app.MethodsPatients and members of the public with a history or family history of hay fever were recruited from November 2019 to December 2021 through a dedicated website, social networking services, and web briefing according to the PPI Guidebook 2019 by the Japan Agency for Medical Research and Development. Nine opinion exchange meetings were held from February 2020 to December 2021 to collect opinions and suggestions for updating the app. After each meeting, interactive evaluations from PPI contributors and researchers were collected. The compiled suggestions were then incorporated into the app, establishing an active feedback loop fed by the consistently interactive infrastructure.ResultsFour PPI contributors (one man and three women) were recruited, and 93 items were added/changed in the in-app survey questionnaire in accordance with discussions from the exchange meetings. The exchange meetings emphasized an atmosphere and opportunity for participants to speak up, ensuring frequent opportunities for them to contribute to the research. In March 2020, a public website was created to display real-time outcomes of the number of participants and users' hay-fever-preventative behaviors. In August 2020, a new PPI-implemented AllerSearch app was released.ConclusionsThis study marks the first research on clinical smartphone apps for hay fever in Japan that implements PPI throughout its timeline from research and development to the publication of research results. Taking advantage of the distinct perspectives offered by PPI contributors, a step was taken toward actualizing a foundation for an interactive research environment. These results should promote future PPI research and foster the establishment of a social construct that enables PPI efforts in various fields.

Project description:BackgroundPatient engagement in research is a dominant discourse in clinical research settings as it is seen as a move toward sustainable and equitable health care systems. In Canada, a key driver is the Strategy for Patient-Oriented Research of the Canadian Institutes of Health Research, which asserts that meaningful patient engagement can only be fostered when stakeholders understand its value. This study assessed researchers' perceptions of the meaning and value of patient engagement in research within a Canadian cardiovascular research network. In doing so, the secondary aim was to inform the development of a structured patient engagement initiative by identifying potential challenges and related mitigation strategies.MethodsWe employed a multi-method strategy involving electronic surveys and semi-structured telephone interviews with network research scientists across Canada. Interview data were analyzed using thematic and content analysis. Survey data were analyzed using descriptive statistics.ResultsThirty-eight electronic surveys (response rate =33%) and 16 interviews were completed with network members. Some participants were uncertain about the meaning and value of patient engagement. While voicing guarded support, four challenges relating to patient engagement were identified from the interviews: 1) identification of representative and appropriate patients, 2) uncertainty about the scope of patients' roles given concerns about knowledge discrepancies, 3) a perceived lack of evidence of the impact of patient engagement, and 4) the need for education and culture change as a prerequisite for patient engagement. Research scientists were largely concerned that patients untrained in science and tasked with conveying an authentic patient experience and being a conduit for the voices of others might unsettle a traditional model of conducting research.ConclusionConcerns about patient involvement in research were related to a lack of clarity about the meaning, process, and impact of involvement. This study highlights the need for education on the meaning of patient engagement, evidence of its impact, and guidance on practical aspects of implementation within this research community.

Dataset Information

Supporting the evaluation of public and patient engagement in health system organizations: Results from an implementation research study.

Background

Methods

Results

Discussion and conclusions

Publications

Supporting the evaluation of public and patient engagement in health system organizations: Results from an implementation research study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets