Dataset Information

Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care.

ABSTRACT: BACKGROUND: Feedback is potentially effective in improving the quality of care. However, merely sending reports is no guarantee that performance data are used as input for systematic quality improvement (QI). Therefore, we developed a multifaceted intervention tailored to prospectively analyzed barriers to using indicators: the Information Feedback on Quality Indicators (InFoQI) program. This program aims to promote the use of performance indicator data as input for local systematic QI. We will conduct a study to assess the impact of the InFoQI program on patient outcome and organizational process measures of care, and to gain insight into barriers and success factors that affected the program's impact. The study will be executed in the context of intensive care. This paper presents the study's protocol. METHODS/DESIGN: We will conduct a cluster randomized controlled trial with intensive care units (ICUs) in the Netherlands. We will include ICUs that submit indicator data to the Dutch National Intensive Care Evaluation (NICE) quality registry and that agree to allocate at least one intensivist and one ICU nurse for implementation of the intervention. Eligible ICUs (clusters) will be randomized to receive basic NICE registry feedback (control arm) or to participate in the InFoQI program (intervention arm). The InFoQI program consists of comprehensive feedback, establishing a local, multidisciplinary QI team, and educational outreach visits. The primary outcome measures will be length of ICU stay and the proportion of shifts with a bed occupancy rate above 80%. We will also conduct a process evaluation involving ICUs in the intervention arm to investigate their actual exposure to and experiences with the InFoQI program. DISCUSSION: The results of this study will inform those involved in providing ICU care on the feasibility of a tailored multifaceted performance feedback intervention and its ability to accelerate systematic and local quality improvement. Although our study will be conducted within the domain of intensive care, we believe our conclusions will be generalizable to other settings that have a quality registry including an indicator set available. TRIAL REGISTRATION: Current Controlled Trials ISRCTN50542146.

SUBMITTER: van der Veer SN

PROVIDER: S-EPMC3217909 | biostudies-other | 2011

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care.

van der Veer Sabine N SN de Vos Maartje L G ML Jager Kitty J KJ van der Voort Peter H J PH Peek Niels N Westert Gert P GP Graafmans Wilco C WC de Keizer Nicolette F NF

Implementation science : IS 20111024

<h4>Background</h4>Feedback is potentially effective in improving the quality of care. However, merely sending reports is no guarantee that performance data are used as input for systematic quality improvement (QI). Therefore, we developed a multifaceted intervention tailored to prospectively analyzed barriers to using indicators: the Information Feedback on Quality Indicators (InFoQI) program. This program aims to promote the use of performance indicator data as input for local systematic QI. W ...[more]

PMID: 22024188

Similar Datasets

Project description:BackgroundThe uptake of evidence-based therapies in the intensive care environment is suboptimal, particularly in limited-resource countries. Checklists, daily goal assessments, and clinician prompts may improve compliance with best practice processes of care and, in turn, improve clinical outcomes. However, the available evidence on the effectiveness of checklists is unreliable and inconclusive, and the mechanisms are poorly understood. We aim to evaluate whether the use of a multifaceted quality improvement intervention, including the use of a checklist and the definition of daily care goals during multidisciplinary daily rounds and clinician prompts, can improve the in-hospital mortality of patients admitted to intensive care units (ICUs). Our secondary objectives are to assess the effects of the study intervention on specific processes of care, clinical outcomes, and the safety culture and to determine which factors (the processes of care and/or safety culture) mediate the effect of the study intervention on mortality.Methods/designThis is a cluster randomized trial involving 118 ICUs in Brazil conducted in two phases. In the observational preparatory phase, we collect baseline data on processes of care and clinical outcomes from 60 consecutive patients with lengths of ICU stay longer than 48 h and apply the Safety Attitudes Questionnaire (SAQ) to 75% or more of the health care staff in each ICU. In the randomized phase, we assign ICUs to the experimental or control arm and repeat data collection. Experimental arm ICUs receive the multifaceted quality improvement intervention, including a checklist and definition of daily care goals during daily multidisciplinary rounds, clinician prompting, and feedback on rates of adherence to selected care processes. Control arm ICUs maintain usual care. The primary outcome is in-hospital mortality, truncated at 60 days. Secondary outcomes include the rates of adherence to appropriate care processes, rates of other clinical outcomes, and scores on the SAQ domains. Analysis follows the intention-to-treat principle, and the primary outcome is analyzed using mixed effects logistic regression.DiscussionThis is a large scale, pragmatic cluster-randomized trial evaluating whether a multifaceted quality improvement intervention, including checklists applied during the multidisciplinary daily rounds and clinician prompting, can improve the adoption of proven therapies and decrease the mortality of critically ill patients. If this study finds that the intervention reduces mortality, it may be widely adopted in intensive care units, even those in limited-resource settings.Trial registrationClinicalTrials.gov NCT01785966.

Project description:BackgroundWhile simple Audit & Feedback (A&F) has shown modest effectiveness in reducing low-value care, there is a knowledge gap on the effectiveness of multifaceted interventions to support de-implementation efforts. Given the need to make rapid decisions in a context of multiple diagnostic and therapeutic options, trauma is a high-risk setting for low-value care. Furthermore, trauma systems are a favorable setting for de-implementation interventions as they have quality improvement teams with medical leadership, routinely collected clinical data, and performance-linked to accreditation. We aim to evaluate the effectiveness of a multifaceted intervention for reducing low-value clinical practices in acute adult trauma care.MethodsWe will conduct a pragmatic cluster randomized controlled trial (cRCT) embedded in a Canadian provincial quality assurance program. Level I-III trauma centers (n = 30) will be randomized (1:1) to receive simple A&F (control) or a multifaceted intervention (intervention). The intervention, developed using extensive background work and UK Medical Research Council guidelines, includes an A&F report, educational meetings, and facilitation visits. The primary outcome will be the use of low-value initial diagnostic imaging, assessed at the patient level using routinely collected trauma registry data. Secondary outcomes will be low-value specialist consultation, low-value repeat imaging after a patient transfer, unintended consequences, determinants for successful implementation, and incremental cost-effectiveness ratios.DiscussionOn completion of the cRCT, if the intervention is effective and cost-effective, the multifaceted intervention will be integrated into trauma systems across Canada. Medium and long-term benefits may include a reduction in adverse events for patients and an increase in resource availability. The proposed intervention targets a problem identified by stakeholders, is based on extensive background work, was developed using a partnership approach, is low-cost, and is linked to accreditation. There will be no attrition, identification, or recruitment bias as the intervention is mandatory in line with trauma center designation requirements, and all outcomes will be assessed with routinely collected data. However, investigators cannot be blinded to group allocation and there is a possibility of contamination bias that will be minimized by conducting intervention refinement only with participants in the intervention arm.Trial registrationThis protocol has been registered on ClinicalTrials.gov (February 24, 2023, # NCT05744154 ).

Project description:Audit and feedback is often used as a strategy to improve quality of care, however, its effects are variable and often marginal. In order to learn how to design and deliver effective feedback, we need to understand their mechanisms of action. This theory-informed study will investigate how electronic audit and feedback affects improvement intentions (i.e. information-intention gap), and whether an action implementation toolbox with suggested actions and materials helps translating those intentions into action (i.e. intention-behaviour gap). The study will be executed in Dutch intensive care units (ICUs) and will be focused on pain management.We will conduct a laboratory experiment with individual ICU professionals to assess the impact of feedback on their intentions to improve practice. Next, we will conduct a cluster randomised controlled trial with ICUs allocated to feedback without or feedback with action implementation toolbox group. Participants will not be told explicitly what aspect of the intervention is randomised; they will only be aware that there are two variations of providing feedback. ICUs are eligible for participation if they submit indicator data to the Dutch National Intensive Care Evaluation (NICE) quality registry and agree to allocate a quality improvement team that spends 4 h per month on the intervention. All participating ICUs will receive access to an online quality dashboard that provides two functionalities: gaining insight into clinical performance on pain management indicators and developing action plans. ICUs with access to the toolbox can develop their action plans guided by a list of potential barriers in the care process, associated suggested actions, and supporting materials to facilitate implementation of the actions. The primary outcome measure for the laboratory experiment is the proportion of improvement intentions set by participants that are consistent with recommendations based on peer comparisons; for the randomised trial it is the proportion of patient shifts during which pain has been adequately managed. We will also conduct a process evaluation to understand how the intervention is implemented and used in clinical practice, and how implementation and use affect the intervention's impact.The results of this study will inform care providers and managers in ICU and other clinical settings how to use indicator-based performance feedback in conjunction with an action implementation toolbox to improve quality of care. Within the ICU context, this study will produce concrete and directly applicable knowledge with respect to what is or is not effective for improving pain management, and under which circumstances. The results will further guide future research that aims to understand the mechanisms behind audit and feedback and contribute to identifying the active ingredients of successful interventions.ClinicalTrials.gov NCT02922101 . Registered 26 September 2016.

Project description:BackgroundIn developing countries referral of severely ill children from primary care to district hospitals is common, but hospital care is often of poor quality. However, strategies to change multiple paediatric care practices in rural hospitals have rarely been evaluated.Methods and findingsThis cluster randomized trial was conducted in eight rural Kenyan district hospitals, four of which were randomly assigned to a full intervention aimed at improving quality of clinical care (evidence-based guidelines, training, job aides, local facilitation, supervision, and face-to-face feedback; n? =? 4) and the remaining four to control intervention (guidelines, didactic training, job aides, and written feedback; n ?=? 4). Prespecified structure, process, and outcome indicators were measured at baseline and during three and five 6-monthly surveys in control and intervention hospitals, respectively. Primary outcomes were process of care measures, assessed at 18 months postbaseline. In both groups performance improved from baseline. Completion of admission assessment tasks was higher in intervention sites at 18 months (mean? =? 0.94 versus 0.65, adjusted difference 0.54 [95% confidence interval 0.05-0.29]). Uptake of guideline recommended therapeutic practices was also higher within intervention hospitals: adoption of once daily gentamicin (89.2% versus 74.4%; 17.1% [8.04%-26.1%]); loading dose quinine (91.9% versus 66.7%, 26.3% [-3.66% to 56.3%]); and adequate prescriptions of intravenous fluids for severe dehydration (67.2% versus 40.6%; 29.9% [10.9%-48.9%]). The proportion of children receiving inappropriate doses of drugs in intervention hospitals was lower (quinine dose >40 mg/kg/day; 1.0% versus 7.5%; -6.5% [-12.9% to 0.20%]), and inadequate gentamicin dose (2.2% versus 9.0%; -6.8% [-11.9% to -1.6%]).ConclusionsSpecific efforts are needed to improve hospital care in developing countries. A full, multifaceted intervention was associated with greater changes in practice spanning multiple, high mortality conditions in rural Kenyan hospitals than a partial intervention, providing one model for bridging the evidence to practice gap and improving admission care in similar settings.

Project description:BackgroundEarly diagnosis of dementia is important because this allows those with dementia and their families to engage support and plan ahead. However, dementia remains underdetected and suboptimally managed in general practice. Our objective was to test the effect of a workplace-based tailored educational intervention developed for general practice on the clinical management of people with dementia.MethodsThe tailored educational intervention was tested in an unblinded cluster randomized controlled trial with a pre/post-intervention design, with two arms: usual/normal care control versus educational intervention. The primary outcome measure was an increase in the proportion of patients with dementia who received at least two documented dementia-specific management reviews per year. Case identification was a secondary outcome measure.Results23 practices in South-East England participated. A total of 1,072 patients with dementia (intervention: 512, control: 560) had information in their medical records showing the number of reviews within 12 months (or a proportion of) before intervention or randomization and within 12 months (or a proportion of) after. The mean total number of dementia management reviews after the educational intervention for people with dementia was 0.89 (SD 1.09; minimum 0; median 1; maximum 8) compared with 0.89 (SD 0.92; minimum 0; median 1; maximum 4) before intervention. In the control group prior to randomization the mean total number of dementia management reviews was 1.66 (SD 1.87; minimum 0; median 1; maximum 12) and in the period after randomization it was 1.56 (SD 1.79; minimum 0; median 1; maximum 11). Case detection rates were unaffected. The estimated incidence rate ratio for intervention versus control group was 1.03 (P = 0.927, 95% CI 0.57 to 1.86).ConclusionsThe trial was timely, coinciding with financial incentives for dementia management in general practice (through the Quality Outcomes Framework); legal imperatives (in the form of the Mental Capacity Act 2005); policy pressure (The National Dementia Strategy 2009); and new resources (such as dementia advisors) that increased the salience of dementia for general practitioners. Despite this the intervention did not alter the documentation of clinical management of patients with dementia in volunteer practices, nor did it increase case identification.Trial registrationNCT00866099/Clinical Trials.

Project description:BackgroundTo improve care for children in district hospitals in Kenya, a multifaceted approach employing guidelines, training, supervision, feedback, and facilitation was developed, for brevity called the Emergency Triage and Treatment Plus (ETAT+) strategy. We assessed the cost effectiveness of the ETAT+ strategy, in Kenyan hospitals. Further, we estimate the costs of scaling up the intervention to Kenya nationally and potential cost effectiveness at scale.Methods and findingsOur cost-effectiveness analysis from the provider's perspective used data from a previously reported cluster randomized trial comparing the full ETAT+ strategy (n?=?4 hospitals) with a partial intervention (n?=?4 hospitals). Effectiveness was measured using 14 process measures that capture improvements in quality of care; their average was used as a summary measure of quality. Economic costs of the development and implementation of the intervention were determined (2009 US$). Incremental cost-effectiveness ratios were defined as the incremental cost per percentage improvement in (average) quality of care. Probabilistic sensitivity analysis was used to assess uncertainty. The cost per child admission was US$50.74 (95% CI 49.26-67.06) in intervention hospitals compared to US$31.1 (95% CI 30.67-47.18) in control hospitals. Each percentage improvement in average quality of care cost an additional US$0.79 (95% CI 0.19-2.31) per admitted child. The estimated annual cost of nationally scaling up the full intervention was US$3.6 million, approximately 0.6% of the annual child health budget in Kenya. A "what-if" analysis assuming conservative reductions in mortality suggests the incremental cost per disability adjusted life year (DALY) averted by scaling up would vary between US$39.8 and US$398.3.ConclusionImproving quality of care at scale nationally with the full ETAT+ strategy may be affordable for low income countries such as Kenya. Resultant plausible reductions in hospital mortality suggest the intervention could be cost-effective when compared to incremental cost-effectiveness ratios of other priority child health interventions.

Project description:BackgroundTailoring is a frequent component of approaches for implementing clinical practice guidelines, although evidence on how to maximise the effectiveness of tailoring is limited. In England, overweight and obesity are common, and national guidelines have been produced by the National Institute for Health and Care Excellence. However, the guidelines are not routinely followed in primary care.MethodsA tailored implementation intervention was developed following an analysis of the determinants of practice influencing the implementation of the guidelines on obesity and the selection of strategies to address the determinants. General practices in the East Midlands of England were invited to take part in a cluster randomised controlled trial of the intervention. The primary outcome measure was the proportion of overweight or obese patients offered a weight loss intervention. Secondary outcomes were the proportions of patients with (1) a BMI or waist circumference recorded, (2) record of lifestyle assessment, (3) referred to weight loss services, and (4) any change in weight during the study period. We also assessed the mean weight change over the study period. Follow-up was for 9 months after the intervention. A process evaluation was undertaken, involving interviews of samples of participating health professionals.ResultsThere were 16 general practices in the control group, and 12 in the intervention group. At follow-up, 15.08 % in the control group and 13.19 % in the intervention group had been offered a weight loss intervention, odds ratio (OR) 1.16, 95 % confidence interval (CI) (0.72, 1.89). BMI/waist circumference measurement 42.71 % control, 39.56 % intervention, OR 1.15 (CI 0.89, 1.48), referral to weight loss services 5.10 % control, 3.67 % intervention, OR 1.45 (CI 0.81, 2.63), weight management in the practice 9.59 % control, 8.73 % intervention, OR 1.09 (CI 0.55, 2.15), lifestyle assessment 23.05 % control, 23.86 % intervention, OR 0.98 (CI 0.76, 1.26), weight loss of at least 1 kg 42.22 % control, 41.65 % intervention, OR 0.98 (CI 0.87, 1.09). Health professionals reported the interventions as increasing their confidence in managing obesity and providing them with practical resources.ConclusionsThe tailored intervention did not improve the implementation of the guidelines on obesity, despite systematic approaches to the identification of the determinants of practice. The methods of tailoring require further development to ensure that interventions target those determinants that most influence implementation.Trial registrationISRCTN07457585.

Project description:ObjectivesThis study sought to assess the effectiveness and return on investment (ROI) of a multifaceted intervention aimed at improving antibiotic prescribing for acute respiratory infections in primary care.DesignLarge-sized, two-arm, open-label, pragmatic, cluster-randomised controlled trial.SettingAll primary care physicians working for the Spanish National Health Service (NHS) in Galicia (region in north-west Spain).ParticipantsThe seven spatial clusters were distributed by unequal randomisation (3:4) of the intervention and control groups. A total of 1217 physicians (1.30 million patients) were recruited from intervention clusters and 1393 physicians (1.46 million patients) from control clusters.InterventionsOne-hour educational outreach visits tailored to training needs identified in a previous study; an online course integrated in practice accreditation; and a clinical decision support system.Main outcome measuresChanges in the ESAC (European Surveillance of Antimicrobial Consumption) quality indicators for outpatient antibiotic use. We used generalised linear mixed and conducted a ROI analysis to ascertain the overall cost savings.ResultsMedian follow-up was 19 months. The adjusted effect on overall antibiotic prescribing attributable to the intervention was - 4.2% (95% CI: - 5.3% to - 3.2%), with this being more pronounced for penicillins - 6.5 (95% CI: - 7.9% to - 5.2%) and for the ratio of consumption of broad- to narrow-spectrum penicillins, cephalosporins, and macrolides - 9.0% (95% CI: - 14.0 to - 4.1%). The cost of the intervention was €87 per physician. Direct savings per physician attributable to the reduction in antibiotic prescriptions was €311 for the NHS and €573 for patient contributions, with an ROI of €2.57 and €5.59 respectively.ConclusionsInterventions designed on the basis of gaps in physicians' knowledge of and attitudes to misprescription can improve antibiotic prescribing and yield important direct cost savings.Trial registrationCurrent Controlled Trials ISRCTN24158380 . Registered 5 February 2009.

Dataset Information

Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care.

Publications

Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets