Dataset Information

Implementation fidelity of a self-management course for epilepsy: method and assessment.

ABSTRACT:

Background

Complex interventions such as self-management courses are difficult to evaluate due to the many interacting components. The way complex interventions are delivered can influence the effect they have for patients, and can impact the interpretation of outcomes of clinical trials. Implementation fidelity evaluates whether complex interventions are delivered according to protocol. Such assessments have been used for one-to-one psychological interventions; however, the science is still developing for group interventions.

Methods

We developed and tested an instrument to measure implementation fidelity of a two-day self-management course for people with epilepsy, SMILE(UK). Using audio recordings, we looked at adherence and competence of course facilitators. Adherence was assessed by checklists. Competence was measured by scoring group interaction, an overall impression score and facilitator "didacticism". To measure "didacticism", we developed a novel way to calculate facilitator speech using computer software. Using this new instrument, implementation fidelity of SMILE(UK) was assessed on three modules of the course, for 28% of all courses delivered.

Results

Using the instrument for adherence, scores from two independent raters showed substantial agreement with weighted Kappa of 0.67 and high percent agreement of 81.2%. For didacticism, the results from both raters were highly correlated with an intraclass coefficient of 0.97 (p < 0.0001). We found that the courses were delivered with a good level of adherence (> 50% of scored items received the maximum of 2 points) and high competence. Groups were interactive (mean score: 1.9-2.0 out of 2) and the overall impression was on average assessed as "good". Didacticism varied from 42% to 93% of total module time and was not associated with the other competence scores.

Conclusion

The instrument devised to measure implementation fidelity was reproducible and easy to use. The courses for the SMILE(UK) study were delivered with a good level of adherence to protocol while not compromising facilitator competence.

Trial registration

ISRCTN57937389 .

SUBMITTER: Wojewodka G

PROVIDER: S-EPMC5504680 | biostudies-literature | 2017 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Implementation fidelity of a self-management course for epilepsy: method and assessment.

Wojewodka G G Hurley S S Taylor S J C SJC Noble A J AJ Ridsdale L L Goldstein L H LH

BMC medical research methodology 20170711 1

<h4>Background</h4>Complex interventions such as self-management courses are difficult to evaluate due to the many interacting components. The way complex interventions are delivered can influence the effect they have for patients, and can impact the interpretation of outcomes of clinical trials. Implementation fidelity evaluates whether complex interventions are delivered according to protocol. Such assessments have been used for one-to-one psychological interventions; however, the science is s ...[more]

PMID: 28697723

Similar Datasets

Project description:Epilepsy, a complex spectrum of disorders, affects about 2.9 million people in the U.S. Similar to other chronic disorders, people with epilepsy face challenges related to management of the disorder, its treatment, co-occurring depression, disability, social disadvantages, and stigma. Two national conferences on public health and epilepsy (1997, 2003) and a 2012 IOM report on the public health dimensions of epilepsy highlighted important knowledge gaps and emphasized the need for evidence-based, scalable epilepsy self-management programs. The Centers for Disease Control and Prevention translated recommendations on self-management research and dissemination into an applied research program through the Prevention Research Centers Managing Epilepsy Well (MEW) Network. MEW Network objectives are to advance epilepsy self-management research by developing effective interventions that can be broadly disseminated for use in people's homes, healthcare providers' offices, or in community settings. The aim of this report is to provide an update on the MEW Network research pipeline, which spans efficacy, effectiveness, and dissemination. Many of the interventions use e-health strategies to eliminate barriers to care (e.g., lack of transportation, functional limitations, and stigma). Strengths of this mature research network are the culture of collaboration, community-based partnerships, e-health methods, and its portfolio of prevention activities, which range from efficacy studies engaging hard-to-reach groups, to initiatives focused on provider training and knowledge translation. The MEW Network works with organizations across the country to expand its capacity, help leverage funding and other resources, and enhance the development, dissemination, and sustainability of MEW Network programs and tools. Guided by national initiatives targeting chronic disease or epilepsy burden since 2007, the MEW Network has been responsible for more than 43 scientific journal articles, two study reports, seven book chapters, and 62 presentations and posters. To date, two programs have been adopted and disseminated by the national Epilepsy Foundation, state Epilepsy Foundation affiliates, and other stakeholders. Recent expansion of the MEW Network membership will help to extend future reach and public health impact.

Project description:BACKGROUND:Epilepsy affects nearly 50 million people worldwide. Self-management is critical for individuals with epilepsy in order to maintain optimal physical, cognitive, and emotional health. Implementing and adopting a self-management program requires considering many factors at the person, program, and systems levels. We conducted a systematic review of qualitative and mixed-methods studies to identify facilitators and barriers that impact implementation and adoption of self-management programs for adults with epilepsy. METHODS:We used established systematic review methodologies for qualitative and mixed-methods studies. We included studies addressing facilitators (i.e., factors that aided) or barriers (i.e., factors that impeded) to implementation and adoption of self-management interventions for adults with epilepsy. We conducted a narrative thematic synthesis to identify facilitators and barriers. RESULTS:The literature search identified 2700 citations; 13 studies met eligibility criteria. Our synthesis identified five themes that categorize facilitators and barriers to successful implementation epilepsy self-management: (1) relevance, intervention content that facilitates acquisition of self-management skills; (2) personalization, intervention components that account for the individual's social, physical, and environmental characteristics; (3) intervention components, components and dosing of the intervention; (4) technology considerations, considerations that account for individual's use, familiarity with, and ownership of technology; and (5) clinician interventionist, role and preparation of the individual who leads intervention. We identified facilitators in 11 of the 13 studies and barriers in 11 of the 13 studies and classified these by social-ecological level (i.e., patient/caregiver, program, site/system). CONCLUSION:Identification of facilitators and barriers at multiple levels provides insight into disease-specific factors that influence implementation and adoption of self-management programs for individuals with epilepsy. Our findings indicate that involving individuals with epilepsy and their caregivers in intervention development, and then tailoring intervention content during the intervention, can help ensure the content is relevant to intervention participants. Our findings also indicate the role of the clinician (i.e., the individual who provides self-management education) is important to intervention implementation, and key issues with clinicians were identified as barriers and opportunities for improvement. Overall, our findings have practical value for those seeking to implement and adopt self-management interventions for epilepsy and other chronic illnesses. SYSTEMATIC REVIEW REGISTRATION:PROSPERO registration number is CRD42018098604.

Project description:ObjectiveEpilepsy is one of the most common neurological conditions affecting about 1% of adults. Up to 40% of people with epilepsy (PWE) report recurring seizures while on medication. And optimal functioning requires good self-management. Our objective was to evaluate a group self-management education courses for people with epilepsy and drug-resistant seizures by means of a multicenter, pragmatic, parallel group, randomized controlled trial.MethodsWe recruited adults with epilepsy, having ?2 seizures in the prior 12 months, from specialist clinics. Consenting participants were randomized 1:1 to a group course or treatment as usual. The primary outcome measure was quality of life 12 months after randomization using Quality of Life 31-P (QOLIE-31-P). Secondary outcome measures were seizure frequency and recency, psychological distress, impact and stigma of epilepsy, self-mastery, medication adherence, and adverse effects. Analysis of outcomes followed the intention-to-treat principle using mixed-effects regression models.ResultsWe enrolled 404 participants (intervention: n = 205, control: n = 199) with 331 (82%) completing 12-month follow-up (intervention: n = 163, control: n = 168). Mean age was 41.7 years, ranging from 16 to 85, 54% were female and 75% were white. From the intervention arm, 73.7% attended all or some of the course. At 12-month follow-up, there were no statistically significant differences between trial arms in QOLIE-31-P (intervention mean: 67.4, standard deviation [SD]: 13.5; control mean: 69.5, SD 14.8) or in secondary outcome measures.SignificanceThis is the first pragmatic trial of group education for people with poorly controlled epilepsy. Recruitment, course attendance, and follow-up rates were higher than expected. The results show that the primary outcome and quality of life did not differ between the trial arms after 12 months. We found a high prevalence of felt-stigma and psychological distress in this group of people with drug-resistant seizures. To address this, social and psychological interventions require evaluation, and may be necessary before or alongside self-management-education courses.

Project description:BACKGROUND:Direct observed treatment (DOT) has been implemented in Bhutan since 1997 and currently, it is offered in various model of delivery including a combination of hospital based, home based DOT and ambulatory DOT. Overall, treatment success rate for tuberculosis cases is higher than the global target; however, it is still need to be improved. Evaluation to the implementation fidelity of DOT is important to identify potential rooms for improvement. This study aimed to assess two major components of the program's implementation fidelity: to assess patient's adherence to DOT and explore factors for adherence; to assess provider's compliance with DOT guideline and explore factors for compliance. METHODS:This research used a sequential explanatory mixed method. The conceptual framework of implementation fidelity was adopted to guide this study design. The cross-sectional study of TB patients was enrolled in two hospitals with highest TB load, between September to November 2017 in Bhutan. Interviewer assisted survey was conducted with 139?TB patients who visited the hospital in continuation phase. In-depth interview was then conducted with nine TB patients and four health staffs to explore the barriers and enablers of DOT. RESULTS:Total of 61.9% (86/139) of patients has received DOT at intensive phase. Proportion was higher among MDR-TB cases (100%), and smear sputum positive TB cases (84.7%). In the continuation phase, 5.8% of patients took medicine at hospital, 48.9% at home and the rest 45.3% no longer practiced DOT. More than 90% of patient received correct dosage and standard regimen of anti-TB drugs according to the guideline. The key factors affecting poor adherence to DOT as perceived by patients were; lack of willingness to visit the clinic on daily basis due to long distance, financial implications and family support. However, patient's satisfaction to the quality of TB treatment service delivery was high (98.6%). Providing incentives to the patient was most agreed enabler felt by both health workers and patients. CONCLUSION:In the selected hospital sites, the patient's adherence to DOT and provider's compliance with DOT guideline is partially implemented; the coverage and the duration of DOT is very low, therefore, need to revise and improve DOT model and structure.

Project description:PurposeDescribe primary care practices' implementation of CommunityRx-H3, a community resource referral intervention that utilized practice facilitators to support cardiovascular disease (CVD) prevention quality improvement.MethodsQualitative focus groups were conducted with practice facilitators to elicit perceptions of practices' experiences with CommunityRx-H3, practice-level factors affecting, and practice facilitator strategies to promote implementation. Qualitative data were analyzed using directed content analysis. The Consolidated Framework for Implementation Research was applied deductively to organize and interpret findings.ResultsFourteen of all 19 practice facilitators participated. Practice facilitators perceived that staff attitudes about connecting patients to community resources for CVD were largely positive. Practices were already using a range of non-systematic strategies to refer to community resources. Practice-level factors that facilitated CommunityRx-H3 implementation included clinician "champions," engaged practice managers, and a practice culture that valued community resources. Implementation barriers included a practice's unwillingness to integrate the intervention into existing workflows, limited staff capacity to complete the resource inventory, and unavailability or cost of materials needed to print the resource referral list ("HealtheRx-H3"). Practice facilitator strategies to promote implementation included supporting ongoing customization of the HealtheRx-H3 and material support. Practice facilitators felt implementation would be improved by integration of CommunityRx-H3 with electronic medical record workflows and alternative methods for engaging practices in the implementation process.ConclusionsPractice facilitators are increasingly being utilized by primary care practices to support quality improvement interventions and, as shown here, can also play an important role in implementation science. This study yields insights to improve implementation of community resource referral solutions to support primary care CVD prevention efforts.

Dataset Information

Implementation fidelity of a self-management course for epilepsy: method and assessment.

Background

Methods

Results

Conclusion

Trial registration

Publications

Implementation fidelity of a self-management course for epilepsy: method and assessment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure