Dataset Information

Monitoring and Evaluation of Patient Engagement in Health Product Research and Development: Co-Creating a Framework for Community Advisory Boards

ABSTRACT:

Purpose

While patient engagement is becoming more customary in developing health products, its monitoring and evaluation to understand processes and enhance impact are challenging. This article describes a patient engagement monitoring and evaluation (PEME) framework, co-created and tailored to the context of community advisory boards (CABs) for rare diseases in Europe. It can be used to stimulate learning and evaluate impacts of engagement activities.

Methods

A participatory approach was used in which data collection and analysis were iterative. The process was based on the principles of interactive learning and action and guided by the PEME framework. Data were collected via document analysis, reflection sessions, a questionnaire, and a workshop.

Results

The tailored framework consists of a theory of change model with metrics explaining how CABs can reach their objectives. Of 61 identified metrics, 17 metrics for monitoring the patient engagement process and short-term outcomes were selected, and a “menu” for evaluating long-term impacts was created. Example metrics include “Industry representatives’ understanding of patients’ unmet needs;” “Feeling of trust between stakeholders;” and “Feeling of preparedness.” “Alignment of research programs with patients’ needs” was the highest-ranked metric for long-term impact.

Conclusions

Findings suggest that process and short-term outcome metrics could be standardized across CABs, whereas long-term impact metrics may need to be tailored to the collaboration from a proposed menu. Accordingly, we recommend that others adapt and refine the PEME framework as appropriate. The next steps include implementing and testing the evaluation framework to stimulate learning and share impacts.

SUBMITTER: Fruytier S

PROVIDER: S-EPMC8772604 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe inclusion of stakeholders throughout the research process has been gaining recognition as an approach that can improve the quality and impact of research. Stakeholder engagement for dementia care research has been identified as a national priority, though evaluation of engagement strategies and their impact has been limited. In dementia care research, stakeholders can include individuals living with dementia, family care partners, and health and social care professionals in dementia care. A Stakeholder Advisory Council (SAC) was established to identify priorities for dementia care research that are most important to stakeholders. Strategies to build capacity for research and facilitate engagement among the SAC were used to identify the research priorities. This study describes the experiences of SAC members engaged in the research process.MethodsTo evaluate stakeholder engagement, semi-structured interviews were conducted with members of the SAC to understand their experiences and perspectives on the strategies used to facilitate engagement and build capacity for research. Interviews were recorded, transcribed, and thematically analyzed using a mixed inductive and deductive approach. Findings were presented to members of the SAC to determine whether they felt their perspectives and experiences were accurately represented. Final domains and themes presented here were approved by the SAC.ResultsInterviews (N = 11) were conducted with members of the SAC representing each stakeholder group; persons living with dementia (n = 2); family care partners (n = 4), and health and social care professionals in dementia care (n = 5). Ten themes were categorized into four overarching domains: accessibility, council infrastructure, values and environment, and benefits of involvement.ConclusionsFindings from this qualitative study are a resource for researchers seeking to collaborate with diverse stakeholder groups to represent their perspectives in research, including individuals living with dementia. The domains and themes identified here support the inclusion of diverse stakeholders in the research process, centering engagement and capacity building strategies around individuals living with dementia.

Project description:Breast cancer (BC) has overtaken lung cancer as the most common cancer in the world and the projected incidence rates show a further increase. Early detection through population screening remains the cornerstone of BC control, but a progressive change from early diagnosis only-based to a personalized preventive and risk-reducing approach is widely debated. Risk-stratification models, which also include personal lifestyle risk factors, are under evaluation, although the documentation burden to gather population-based data is relevant and traditional data collection methods show some limitations. This paper provides the preliminary results from the analysis of clinical data provided by radiologists and lifestyle data collected using self-administered questionnaires from 5601 post-menopausal women. The weight of the combinations of women's personal features and lifestyle habits on the BC risk were estimated by combining a model-driven and a data-driven approach to analysis. The weight of each factor on cancer occurrence was assessed using a logistic model. Additionally, communities of women sharing common features were identified and combined in risk profiles using social network analysis techniques. Our results suggest that preventive programs focused on increasing physical activity should be widely promoted, in particular among the oldest women. Additionally, current findings suggest that pregnancy, breast-feeding, salt limitation, and oral contraception use could have different effects on cancer risk, based on the overall woman's risk profile. To overcome the limitations of our data, this work also introduces a mobile health tool, the Dress-PINK, designed to collect real patients' data in an innovative way for improving women's response rate, data accuracy, and completeness as well as the timeliness of data availability. Finally, the tool provides tailored prevention messages to promote critical consciousness, critical thinking, and increased health literacy among the general population.

Project description:ObjectiveThis study employed the Consolidated Framework for Implementation Research (CFIR) to assess factors that enhanced or impeded the implementation of community engagement strategies using the Nigerian polio programme as a point of reference.DesignThis study was a part of a larger descriptive cross-sectional survey. The CFIR was used to design the instrument which was administered through face-to-face and phone interviews as well as a web-based data collection platform, Qualtrics.SettingThe study took place in at least one State from each of the six geopolitical zones in Nigeria (Nasarawa, Borno, Kano, Sokoto, Anambra, Bayelsa, Lagos, Ondo and Oyo States as well as the Federal Capital Territory).ParticipantsThe respondents included programme managers, policy-makers, researchers and frontline field implementers affiliated with the Global Polio Eradication Initiative (PEI) core partner organisations, the three tiers of the government health parastatals (local, state and federal levels) and academic/research institutions.ResultsData for this study were obtained from 364 respondents who reported participation in community engagement activities in Nigeria's PEI. Majority (68.4%) had less than 10 years' experience in PEI, 57.4% were involved at the local government level and 46.9% were team supervisors. Almost half (45.0%) of the participants identified the process of conducting the PEI program and social environment (56.0%) as the most important internal and external contributor to implementing community engagement activities in the community, respectively. The economic environment (35.7%) was the most frequently reported challenge among the external challenges to implementing community engagement activities.ConclusionCommunity engagement strategies were largely affected by the factors relating to the process of conducting the polio programme, the economic environment and the social context. Therefore, community engagement implementers should focus on these key areas and channel resources to reduce obstacles to achieve community engagement goals.