Dataset Information

Evaluation of an interactive web-based programme on relapse management for people with multiple sclerosis (POWER@MS2): study protocol for a process evaluation accompanying a randomised controlled trial.

ABSTRACT:

Introduction

Process evaluations accompanying complex interventions examine the implementation process of the underlying intervention, identify mechanisms of impact and assess contextual factors. This paper presents the protocol for a process evaluation conducted alongside the randomised controlled trial POWER@MS2. The trial comprises the evaluation of a web-based complex intervention on relapse management in 188 people with multiple sclerosis conducted in 20 centres. The web-based intervention programme focuses on relapse treatment decision making and includes a decision aid, a nurse-led webinar and an online chat. With the process evaluation presented here, we aim to assess participants' responses to and interactions with the intervention to understand how and why the intervention produces change.

Methods and analysis

A mixed methods design is used to explore the acceptance of the intervention as well as its use and impact on participants. Participants are people with multiple sclerosis, neurologists, nurses and stakeholders. Quantitative semistandardised evaluation forms will be collected throughout the study. Qualitative semistructured telephone interviews will be conducted at the end of the study with selected participants, especially people with multiple sclerosis and neurologists. Quantitative data will be collected and analysed descriptively. Based on the results, the qualitative interviews will be conducted and analysed thematically, and the results will be merged in a joint display table.

Ethics and dissemination

The process evaluation has received ethical approval from the Ethical Committee of the University of Lübeck (reference 19-024). Findings will be disseminated in peer-reviewed journals, at conferences, meetings and on relevant patient websites.

Trial registration number

NCT04233970.

SUBMITTER: Wenzel L

PROVIDER: S-EPMC8488740 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionMultiple sclerosis is a chronic inflammatory, degenerative disease of the central nervous system manifesting at first with relapses in about 85% of cases. In Germany, intravenous therapy with high-dose corticosteroids is the treatment standard of acute relapses. The treatment leads to a faster reduction of symptoms in about 25 of 100 treated patients but has no proven long-term benefits over placebo treatment. Intravenous treatment is not superior to oral treatment. Therefore, informed decisions on relapse management are required. An earlier randomised controlled trial showed that evidence-based patient information and education on relapse management leads to more informed decisions and more relapses not treated or treated with oral corticosteroids. This study aims to evaluate whether a web-based relapse management programme will positively change relapse management and strengthen autonomy in people with multiple sclerosis.MethodsThe pragmatic double-blind randomised controlled trial is accompanied by a mixed-methods process evaluation and a health economic evaluation and follows the UK Medical Research Council guidance on developing and evaluating complex interventions. A total of 188 people with possible or relapsing-remitting multiple sclerosis with ≥ 1 relapse within the last year and/or ≥ 2 relapses within the last 2 years will be recruited and randomised using blocks. The intervention group receives a web- and dialogue-based decision aid on relapse management, a nurse-led webinar and access to a monitored chat forum. The control group receives standard information, which will be made available via the same online platform as the intervention. The primary endpoint is the proportion of relapses not treated or treated with oral corticosteroids. Key secondary endpoints are the annualised relapse rate, decision-making, empowerment, quality of life and cost-effectiveness. Facilitators and barriers will be assessed by mixed-methods process evaluation measures. The study ends when 81 relapses have been documented or after 24 months of observation per individual patient. Analyses will follow the intention-to-treat principle.DiscussionWe hypothesise that the intervention will enhance patient empowerment and have a positive impact on patients' relapse management.Trial registrationClinicalTrials.gov NCT04233970 . Registered on 18 January 2020.

Project description:BackgroundGirls Active is a physical activity programme, delivered in UK secondary schools, with the aim of increasing moderate-to-vigorous physical activity (MVPA) in girls aged 11-14 years. This study presents the process evaluation as part of a 14-month cluster randomised controlled trial designed to evaluate the effectiveness of the Girls Active programme and which showed no difference in the primary outcome (MVPA at 14 months) between intervention and control arms.MethodsQuantitative and qualitative data were collected from intervention schools over the course of the 14 month trial. Feedback forms and attendance records were completed at the end of all teacher and peer leader training and review days. At 7- and 14-months, semi-structured interviews were conducted with the lead Girls Active teacher in all intervention schools (n = 10) and staff from the intervention provider (n = 4) and hub school (n = 1). At 14 months, separate focus groups with peer leaders (n = 8 schools), girls who participated in the evaluation component of the trial (n = 8 schools), and a sample of boys (n = 6 schools) were conducted. All participants in the intervention schools were asked to complete an exit survey at 14 months. Teachers (intervention and control) completed a school environment questionnaire at baseline, 7- and 14-months.ResultsThe Girls Active programme, i.e., the training and resources, appeared to be well received by teachers and pupils. Factors that may have contributed to the lack of effectiveness include: some initial uncertainty by teachers as to what to do following the initial training, a predominant focus on support activities (e.g., gathering opinions) rather than actual physical activity provision, and school-level constraints that impeded implementation.ConclusionsGirls Active and what it was trying to achieve was valued by schools. The programme could be improved by providing greater guidance to teachers throughout, the setting of timelines, and providing formal training to peer leaders.Trial registrationISRCTN, ISRCTN10688342 . Registered 12 January 2015.

Project description:BackgroundThe Nurses in the Lead (NitL) programme consists of a systematic approach and training to 1) empower community nurses in implementing evidence, targeted at encouraging functional activities of older adults, and 2) train community nurses in enabling team members to change their practice. This article aims to describe the process evaluation of NitL.MethodsA mixed-methods formative process evaluation with a predominantly qualitative approach was conducted. Qualitative data were collected by interviews with community nurses (n = 7), focus groups with team members (n = 31), and reviewing seven implementation plans and 28 patient records. Quantitative data were collected among community nurses and team members (N = 90) using a questionnaire to assess barriers in encouraging functional activities and attendance lists. Data analysis was carried out through descriptive statistics and content analysis.ResultsNitL was largely executed according to plan. Points of attention were the use and value of the background theory within the training, completion of implementation plans, and reporting in patient records by community nurses. Inhibiting factors for showing leadership and encouraging functional activities were a lack of time and a high complexity of care; facilitating factors were structure and clear communication within teams. Nurses considered the systematic approach useful and the training educational for their role. Most team members considered NitL practical and were satisfied with the coaching provided by community nurses. To optimise NitL, community nurses recommended providing the training first and extending the training. The team members recommended continuing clinical lessons, which were an implementation strategy from the community nurses.ConclusionsNitL was largely executed as planned, and appears worthy of further application in community care practice. However, adaptations are recommended to make NitL more promising in practice in empowering community nurse leadership in implementing evidence.

Project description:BackgroundVisual impairment is a global public health problem, with an estimated 285 million affected globally, of which 43% are due to refractive error. A lack of specialist eye care in low and middle-income countries indicates a new model of care would support a task-shifting model and address this urgent need. We describe the features and results of the process evaluation of a national primary eye care (PEC) programme in Rwanda.MethodsWe used the Medical Research Council process evaluation framework to examine the implementation of the PEC programme, and to determine enablers and challenges to implementation. The process evaluation uses a mixed methods approach, drawing on results from several sources including a survey of 574 attendees at 50 PEC clinics, structured clinical observations of 30 PEC nurses, in-depth interviews with 19 key stakeholders, documentary review and a participatory process evaluation workshop with key stakeholders to review collated evidence and contextualize the results.ResultsStructured clinical assessment indicated that the PEC provided is consistent with the PEC curriculum, with over 90% of the clinical examination processes conducted correctly. In 4 years, programme monitoring data showed that nearly a million PEC eye examinations had been conducted in every health centre in Rwanda, with 2707 nurses trained. The development of the eye health system was an important enabler in the implementation of PEC, where political support allowed key developments such as inclusion of eye-drops on the essential medicines list, the inclusion of PEC on insurance benefits, the integration of PEC indicators on the health management information systems and integration of the PEC curriculum into the general nursing school curriculum. Challenges included high turnover of primary care nurses, lack of clarity and communication on the future funding of the programme, competing priorities for the health sector and sustained supervision to assure quality of care.ConclusionsA model of a national primary eye care programme is presented, with service delivery to all areas in Rwanda. Key learning from this evaluation is the importance of strengthening the eye health care system, together with a strong focus on training primary care nurses using a PEC curriculum.

Project description:IntroductionThe Perioperative Quality Improvement Programme (PQIP) is designed to measure complications after major elective surgery and improve these through feedback of data to clinicians. Previous research suggests that despite the significant resources which go into collecting data for national clinical audits, the information they contain is not always used effectively to improve local services.Methods and analysisWe will conduct a formative process evaluation of PQIP comprising a multisited qualitative study to analyse PQIP's programme theory, barriers, facilitators and wider contextual factors that influence implementation. The research will be carried out with the PQIP project team and six National Health Service (NHS) Trusts in England, selected according to geographical location, type of hospital, size and level of engagement with PQIP. We will include one Trust which has not expressed interest in the PQIP for comparison and to explore the role of secular trend in any changes in practice. We will use semi-structured interviews (up to 144 in Trusts and 12 with the project team), non-participant observations (up to 150 ?hours) and documentary analysis. We will track the lifecycle of perioperative data, exploring the transformations it undergoes from creation to use. We will use framework analysis with categories both from our research questions and from themes emerging from the data.Ethics and disseminationEthical approval has been granted from the University College London Research Ethics Committee (ref 10375/001). Permissions to conduct research at NHS Trusts have been granted by local Research and Development offices in coordination with the Health Research Authority. We will follow guidelines for data security, confidentiality and information governance. Findings will be shared at regular time points with the PQIP project team to inform the implementation of the programme, and with participating NHS Trusts to help them reflect on how they currently use data for improvement of perioperative services.

Project description:Evidence is emerging from rigorous evaluations about the effectiveness of nutrition-sensitive agriculture programmes in improving nutritional outcomes. Additional evidence can elucidate how different programme components and pathways contribute and can be optimized for impact. The International Food Policy Research Institute, with Helen Keller International, designed a comprehensive framework to evaluate the delivery, utilization, and impact of Helen Keller International's enhanced homestead food production programme in Burkina Faso. After 18 months of implementation, a process evaluation was conducted to examine programme impact pathways, using key informant and semistructured interviews with implementing agents and beneficiaries, and with residents of control communities. Data were analyzed by International Food Policy Research Institute and reviewed with project managers and partners through multiple workshops to identify opportunities to strengthen implementation. Findings illuminated gaps between intended and actual delivery schemes, including input constraints, knowledge gaps among community agents in agriculture and young child nutrition practices, and lower than expected activity by community volunteers. In response, staff developed measures to overcome water constraints and expand vegetable and poultry production, retrained volunteers in certain techniques of food production and counselling for nutrition behaviour change, added small incentives to motivate volunteers, and shaped both immediate and long-term changes to the programme model. Working closely with International Food Policy Research Institute on the evaluation activities also expanded the repertoire of research methods and skills of Helen Keller International staff. Process evaluation can strengthen programme delivery, utilization, and design. Collaboration between researchers and implementers can improve programme effectiveness, project staff capacity, and advance delivery science.