Dataset Information

A Protocol for a Comprehensive Monitoring and Evaluation Framework With a Compendium of Tools to Assess Quality of Project ECHO (Extension for Community Healthcare Outcomes) Implementation Using Mixed Methods, Developmental Evaluation Design.

ABSTRACT: Introduction: The United States Centers for Disease Control and Prevention (CDC), through U.S. President's Emergency Plan for AIDS Relief (PEPFAR), supports a third of all people receiving HIV care globally. CDC works with local partners to improve methods to find, treat, and prevent HIV and tuberculosis. However, a shortage of trained medical professionals has impeded efforts to control the HIV epidemic in Sub-Saharan Africa and Asia. The Project Extension for Community Healthcare Outcomes (ECHO^TM) model expands capacity to manage complex diseases, share knowledge, disseminate best practices, and build communities of practice. This manuscript describes a practical protocol for an evaluation framework and toolkit to assess ECHO implementation. Methods and Analysis: This mixed methods, developmental evaluation design uses an appreciative inquiry approach, and includes a survey, focus group discussion, semi-structured key informant interviews, and readiness assessments. In addition, ECHO session content will be objectively reviewed for accuracy, content validity, delivery, appropriateness, and consistency with current guidelines. Finally, we offer a mechanism to triangulate data sources to assess acceptability and feasibility of the evaluation framework and compendium of monitoring and evaluation tools. Expected impact of the study on public health: This protocol offers a unique approach to engage diverse group of stakeholders using an appreciative inquiry process to co-create a comprehensive evaluation framework and a compendium of assessment tools. This evaluation framework utilizes mixed methods (quantitative and qualitative data collection tools), was pilot tested in Tanzania, and has the potential for contextualized use in other countries who plan to evaluate their Project ECHO implementation.

SUBMITTER: Ghosh S

PROVIDER: S-EPMC8491604 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:One of the major debates in implementation research turns around fidelity and adaptation. Fidelity is the degree to which an intervention is implemented as intended by its developers. It is meant to ensure that the intervention maintains its intended effects. Adaptation is the process of implementers or users bringing changes to the original design of an intervention. Depending on the nature of the modifications brought, adaptation could either be potentially positive or could carry the risk of threatening the theoretical basis of the intervention, resulting in a negative effect on expected outcomes. Adaptive interventions are those for which adaptation is allowed or even encouraged. Classical fidelity dimensions and conceptual frameworks do not address the issue of how to adapt an intervention while still maintaining its effectiveness.We support the idea that fidelity and adaptation co-exist and that adaptations can impact either positively or negatively on the intervention's effectiveness. For adaptive interventions, research should answer the question how an adequate fidelity-adaptation balance can be reached. One way to address this issue is by looking systematically at the aspects of an intervention that are being adapted. We conducted fidelity research on the implementation of an empowerment strategy for dengue prevention in Cuba. In view of the adaptive nature of the strategy, we anticipated that the classical fidelity dimensions would be of limited use for assessing adaptations. The typology we used in the assessment-implemented, not-implemented, modified, or added components of the strategy-also had limitations. It did not allow us to answer the question which of the modifications introduced in the strategy contributed to or distracted from outcomes. We confronted our empirical research with existing literature on fidelity, and as a result, considered that the framework for implementation fidelity proposed by Carroll et al. in 2007 could potentially meet our concerns. We propose modifications to the framework to assess both fidelity and adaptation. The modified Carroll et al.'s framework we propose may permit a comprehensive assessment of the implementation fidelity-adaptation balance required when implementing adaptive interventions, but more empirical research is needed to validate it.

Project description:Project ECHO (Extension for Community Healthcare Outcomes) was developed in 2003 as an innovative model to facilitate continuing education and professional development. ECHO emphasizes 'moving knowledge, not people.' To accomplish this, ECHO programs use virtual collaboration and case-based learning to allow practitioners, including those in rural and underserved areas, to receive specialist training. The ECHO model has expanded rapidly and is now used in 44 countries. Preliminary research on ECHO's efficacy and effectiveness has shown promising results, but evidence remains limited and appropriate research outcomes have not been clearly defined. To improve the evidence basis for ECHO, this study of 5 ECHO programs (cancer prevention/survivorship, integrated pain management, hepatitis C, HIV, and LGBTQ+ health care elucidated actionable insights about the ECHO programs and directions in which future evaluations and research might progress. This was a qualitative study following COREQ standards. A trained interviewer conducted 10 interviews and 5 focus groups with 25 unique, purposively sampled ECHO attendees (2 interviews and 1 focus group for each of the 5 programs). Data were transcribed verbatim and analyzed using the general inductive approach, then reviewed for reliability. We identified four major categories (reasons to join ECHO, value of participating in ECHO, ways to improve ECHO, and barriers to participation) composed of 23 primary codes. We suggest that thematic saturation was achieved, and a coherent narrative about ECHO emerged for discussion. Participants frequently indicated they received valuable learning experiences and thereby changed their practice; rigorous trials of learning and patient-level outcomes are warranted. This study also found support for the idea that the ECHO model should be studied for its role in convening communities of practice and reducing provider isolation as an outcome in itself. Additional implications, including for interprofessional education and model evolution, were also identified and discussed.

Project description:BackgroundPediatric pain is a complex health challenge requiring a multi-modal management approach. It is critical that healthcare providers (HCPs) have access to ongoing, flexible education and mentorship specific to pediatric pain. However, there are significant gaps in available pain education and a need for more opportunities to support interprofessional training. Project Extension for Community Healthcare Outcomes (Project ECHO®) is a model for delivering online HCP education and cultivating a virtual community of practice. Within the pediatric pain setting, ECHO® has potential to improve local access to specialized pain knowledge, particularly among the physicians, nurses, and allied health providers who primarily manage these cases in community and hospital settings across rural and urban environments. The purpose of this study was three-fold. First, to evaluate the feasibility (participation levels, acceptability) of implementing Project ECHO® in the context of pediatric pain. Second, to measure preliminary program impacts on HCP knowledge, self-efficacy, and clinical practice. Third, to characterize HCP program engagement levels before and after onset of the COVID-19 pandemic.MethodsA needs assessment was conducted to identify interprofessional education gaps and inform the program curriculum. The no-cost Pediatric ECHO® for Pain program offered TeleECHO sessions (didactic and case-based learning) as well as foundational education. Surveys were distributed at baseline and 6 months to assess outcomes using 7-point Likert scales. Participant engagement was assessed for periods prior to and during the COVID-19 pandemic. Descriptive and inferential statistical analyses were conducted.ResultsEighty-five TeleECHO sessions were hosted, with a mean attendance of 34.1 ± 23.4 HCPs. Acceptability scores at 6 months (n = 33) ranged from 5.0 ± 1.4 to 6.5 ± 0.5. Participants reported statistically significant (p < 0.05) improvements in knowledge (7 out of 7 topics) and self-efficacy (8 out of 9 skills). Most participants reported positive practice impacts, including improved satisfaction with managing children with pain. Exploratory analyses showed a trend of greater engagement from ECHO® learners after onset of the COVID-19 pandemic.ConclusionsProject ECHO® is a feasible and impactful model for virtual education of interprofessional HCPs in managing pediatric pain.

Dataset Information

A Protocol for a Comprehensive Monitoring and Evaluation Framework With a Compendium of Tools to Assess Quality of Project ECHO (Extension for Community Healthcare Outcomes) Implementation Using Mixed Methods, Developmental Evaluation Design.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets