Dataset Information

Effects on Clinical Outcomes of a 5-Year Surgical Safety Checklist Implementation Experience: A Large-scale Population-Based Difference-in-Differences Study.

ABSTRACT: The adoption of a surgical checklist is strongly recommended worldwide as an effective practice to improve patient safety; however, several studies have reported mixed results and a number of issues are still unresolved. The main objective of this study was to explore the impact of the first 5-year period of a surgical checklist-based intervention in a large regional health care system in Italy (4 500 000 inhabitants). We conducted a retrospective longitudinal study on 1 166 424 patients who underwent surgery in 48 public hospitals between 2006 and 2014. The adherence to the checklist was measured between 2011 and 2013 through a computerized database. The effects of the intervention were explored through multivariable logistic regression and difference-in-differences (DID) approaches, based on current administrative data sources. In-hospital and 30-days mortality, 30-days readmissions and length-of-stay (LOS) ?8?days were the observed outcomes. Adherence to the checklist showed marked variations across hospitals (0%-93.3%). A pre/post analysis detected statistically significant differences between surgical interventions performed in hospitals with higher adherence to the checklist (?75% of the surgeries) and those performed in other hospitals, as for the 30-days readmissions rate (odds ratio [OR]: 0.96; 95% confidence interval [CI]: 0.94-0.98) and LOS ? 8?days rate (OR: 0.88; 95% CI: 0.87-0.89). These findings were confirmed after risk adjustment and DID analysis. No association was observed with mortality outcomes. On the whole, our study attained mixed results. Although a protective effect of the surgical checklist use could not be proved over the first 5?years of this regional implementation experience, our research offers some methodological insights for practical use in the evaluation process of large-scale implementation projects.

SUBMITTER: Rodella S

PROVIDER: S-EPMC6056784 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe WHO Surgical Safety Checklist has a growing evidence base to support its role in improving perioperative safety, although its impact is likely to be directly related to the effectiveness of its implementation. There remains a paucity of documented experience from low-resource settings on Checklist implementation approaches. We report an implementation strategy in a public referral hospital in Addis Ababa, Ethiopia, based on consultation, local leadership, formal introduction, and supported supervision with subsequent audit and feedback.MethodsPlanning, implementation and assessment took place from December 2011 to December 2012. The planning phase, from December 2011 until April 2012, involved a multidisciplinary consultative approach using local leaders, volunteer clinicians, and staff from non-governmental organisations, to draw up a locally agreed and appropriate Checklist. Implementation in April 2012 involved formal teaching and discussion, simulation sessions and role play, with supportive supervision following implementation. Assessment was performed using completed Checklist analysis and staff satisfaction questionnaires at one month and further Checklist analysis combined with semi-structured interviews in December 2012.Results and discussionChecklist compliance rates were 83% for general anaesthetics at one month after implementation, with an overall compliance rate of 65% at eight months. There was a decrease in Checklist compliance over the period of the study to less than 20% by the end of the study period. The 'Sign out' section was reported as being the most difficult section of the Checklist to complete, and was missed completely in 21% of cases. The most commonly missed single item was the team introduction at the start of each case. However, we report high staff satisfaction with the Checklist and enthusiasm for its continued use.ConclusionWe report a detailed implementation strategy for introducing the WHO Surgical Safety Checklist to a low-resource setting. We show that this approach can lead to high completion rates and high staff satisfaction, albeit with a drop in completion rates over time. We argue that maximal benefit of the Surgical Safety Checklist is likely to be when it engenders a conversation around patient safety within a department, and when there is local ownership of this process.

Project description:The 2009 World Health Organisation (WHO) surgical safety checklist significantly reduces surgical mortality and morbidity (up to 47%). Yet in 2016, only 25% of East African anesthetists regularly use the checklist. Nationwide implementation of the checklist is reported in high-income countries, but in low- and middle-income countries (LMICs) reports of successful implementations are sparse, limited to single institutions and require intensive support. Since checklist use leads to the biggest improvements in outcomes in LMICs, methods of wide-scale implementation are needed. We hypothesized that, using a three-day course, successful wide-scale implementation of the checklist could be achieved, as measured by at least 50% compliance with six basic safety processes at three to four months. We also aimed to determine predictors for checklist utilization.Using a blended educational implementation strategy based on prior pilot studies we designed a three-day dynamic educational course to facilitate widespread implementation of the WHO checklist. The course utilized lectures, film, small group breakouts, participant feedback and simulation to teach the knowledge, skills and behavior changes needed to implement the checklist. In collaboration with the Ministry of Health and local hospital leadership, the course was delivered to 427 multi-disciplinary staff at 21 hospitals located in 19 of 22 regions of Madagascar between September 2015 and March 2016. We evaluated implementation at three to four months using questionnaires (with a 5-point Likert scale) and focus groups. Multivariate linear regression was used to test predictors of checklist utilization.At three to four months, 65% of respondents reported always using the checklist, with another 13% using it in part. Participant's years in practice, hospital size, or surgical volume did not predict checklist use. Checklist use was associated with counting instruments (p< 0.05), but not with verifying: patient identity, difficult intubation risk, risk of blood loss, prophylactic antibiotic administration, or counting needles and sponges.Use of a multi-disciplinary three-day course for checklist implementation resulted in 78% of participants using the checklist, at three months; and an increase in counting surgical instruments. Successful checklist implementation was not predicted by participant length of medical service, hospital size or surgical volume. If reproducible in other countries, widespread implementation in LMICs becomes a realistic possibility.

Project description:BackgroundPoor uptake and understanding of critical perioperative information represent a major safety risk for surgical patients. Implementing a patient-driven surgical safety checklist might enhance the way critical information is given and increase patient involvement in their own safety throughout the surgical pathway. The aim of this study was to develop and validate a Surgical Patient Safety Checklist (PASC) for use by surgical patients.MethodThis was a prospective study, involving patient representatives, multidisciplinary healthcare professionals and elective surgical patients to develop and validate PASC using consensus-building techniques in two Norwegian hospitals. A set of items intended for PASC were rated by patients and then submitted to Content Validation Index (CVI) analyses. Items of low CVI went through a Healthcare Failure Mode and Effect Analysis (HFMEA) Hazard Scoring process, as well as a consensus process before they were either kept or discarded. Reliability of patients' PASC ratings was assessed using Intraclass Correlation Coefficient analysis. Lastly, the face validity of PASC was investigated through focus group interviews with postoperative patients.ResultsInitial development of PASC resulted in a checklist consisting of two parts, one before (32 items) and one after surgery (26 items). After achieving consensus on the PASC content, 215 surgical patients from six surgical wards rated the items for the CVI analysis on a 1-4 scale and mostly agreed on the content. Five items were removed from the checklist, and six items were redesigned to improve PASCs' user-friendliness. The total Scale-level index/Average (S-CVI/Ave) before revision was 0.83 and 0.86 for pre- and post-operative PASC items, respectively. Following revision, these increased to 0.86 and 0.93, respectively. The PASC items reliability score was 0.97 (95% confidence interval 0.96 to 0.98). The qualitative assessment identified that patients who used PASC felt more in control of their situation; this was achieved when PASC was given to them at what they felt was the right time and healthcare professionals took part in its usage.ConclusionMultidisciplinary perioperative care staff and surgical patients agreed upon PASC content, the checklist ratings were reliable, and qualitative assessment suggested good face validity. PASC appears to be a usable and valid checklist for elective surgical patients across specialties.

Project description:The surgical Safety Checklist (SSC) was introduced in 2008 to improve teamwork and reduce the mortality and morbidity associated with surgery. Although mandated in many health care institutions around the world, challenges in implementation of the SSC continue. To use Normalisation Process Theory (NPT) to help understand how/why implementation of a complex intervention coined Pass The Baton (PTB) could help explain what facets of the Surgical Safety Checklist use led to its' integration in practice, while others were not.A longitudinal multi-method study using survey and interviews was undertaken. Implementation of PTB involved; change champions, audit and feedback, education and prompts. Following implementation, surgical teams were surveyed using the NOrmalization MeAsure Development (NoMAD) and subsequently interviewed to explore the impact of PTB on their use of the checklist at 6 and 12 months respectively. Respondents' self-reported perceptions of implementation of PTB was explained using the four NPT constructs; coherence, cognitive participation, collective action, and reflexive monitoring. Survey data were analysed using descriptive statistics. Interview data were coded inductively and content analysed using a framework derived from NPT.The NoMAD survey response rate was 59/150 (39.3%). Many (45/59, 77.6%) survey respondents saw the value in PTB, while 50/59 (86.2%) would continue to use it; 45/59 (77.6%) believed that PTB could easily be integrated into existing workflows, and 48/59 (82.8%) thought that feedback could improve PTB in the future. A total of 8 interviews were completed with 26 surgical team members. Nurses and physicians held mixed views towards coherence while buy-in and participation relied on individuals' investment in the implementation process and the ability to modify PTB. Participants generally recognised the benefit and value of using PTB in the ongoing implementation the checklist.Workarounds and flexible co-construction in implementation designed to improve team communications in surgery may facilitate their normalisation in practice.

Dataset Information

Effects on Clinical Outcomes of a 5-Year Surgical Safety Checklist Implementation Experience: A Large-scale Population-Based Difference-in-Differences Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets