Dataset Information

Effects on Clinical Outcomes of a 5-Year Surgical Safety Checklist Implementation Experience: A Large-scale Population-Based Difference-in-Differences Study.

ABSTRACT: The adoption of a surgical checklist is strongly recommended worldwide as an effective practice to improve patient safety; however, several studies have reported mixed results and a number of issues are still unresolved. The main objective of this study was to explore the impact of the first 5-year period of a surgical checklist-based intervention in a large regional health care system in Italy (4 500 000 inhabitants). We conducted a retrospective longitudinal study on 1 166 424 patients who underwent surgery in 48 public hospitals between 2006 and 2014. The adherence to the checklist was measured between 2011 and 2013 through a computerized database. The effects of the intervention were explored through multivariable logistic regression and difference-in-differences (DID) approaches, based on current administrative data sources. In-hospital and 30-days mortality, 30-days readmissions and length-of-stay (LOS) ⩾8 days were the observed outcomes. Adherence to the checklist showed marked variations across hospitals (0%-93.3%). A pre/post analysis detected statistically significant differences between surgical interventions performed in hospitals with higher adherence to the checklist (⩾75% of the surgeries) and those performed in other hospitals, as for the 30-days readmissions rate (odds ratio [OR]: 0.96; 95% confidence interval [CI]: 0.94-0.98) and LOS ⩾ 8 days rate (OR: 0.88; 95% CI: 0.87-0.89). These findings were confirmed after risk adjustment and DID analysis. No association was observed with mortality outcomes. On the whole, our study attained mixed results. Although a protective effect of the surgical checklist use could not be proved over the first 5 years of this regional implementation experience, our research offers some methodological insights for practical use in the evaluation process of large-scale implementation projects.

SUBMITTER: Rodella S

PROVIDER: S-EPMC6056784 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effects on Clinical Outcomes of a 5-Year Surgical Safety Checklist Implementation Experience: A Large-scale Population-Based Difference-in-Differences Study.

Rodella Stefania S Mall Sabine S Marino Massimiliano M Turci Graziella G Gambale Giorgio G Montella Maria Teresa MT Bonilauri Stefano S Gelmini Roberta R Zuin Piera P

Health services insights 20180723

The adoption of a surgical checklist is strongly recommended worldwide as an effective practice to improve patient safety; however, several studies have reported mixed results and a number of issues are still unresolved. The main objective of this study was to explore the impact of the first 5-year period of a surgical checklist-based intervention in a large regional health care system in Italy (4 500 000 inhabitants). We conducted a retrospective longitudinal study on 1 166 424 patients who und ...[more]

PMID: 30046243

Similar Datasets

Project description:BackgroundThe WHO Surgical Safety Checklist has a growing evidence base to support its role in improving perioperative safety, although its impact is likely to be directly related to the effectiveness of its implementation. There remains a paucity of documented experience from low-resource settings on Checklist implementation approaches. We report an implementation strategy in a public referral hospital in Addis Ababa, Ethiopia, based on consultation, local leadership, formal introduction, and supported supervision with subsequent audit and feedback.MethodsPlanning, implementation and assessment took place from December 2011 to December 2012. The planning phase, from December 2011 until April 2012, involved a multidisciplinary consultative approach using local leaders, volunteer clinicians, and staff from non-governmental organisations, to draw up a locally agreed and appropriate Checklist. Implementation in April 2012 involved formal teaching and discussion, simulation sessions and role play, with supportive supervision following implementation. Assessment was performed using completed Checklist analysis and staff satisfaction questionnaires at one month and further Checklist analysis combined with semi-structured interviews in December 2012.Results and discussionChecklist compliance rates were 83% for general anaesthetics at one month after implementation, with an overall compliance rate of 65% at eight months. There was a decrease in Checklist compliance over the period of the study to less than 20% by the end of the study period. The 'Sign out' section was reported as being the most difficult section of the Checklist to complete, and was missed completely in 21% of cases. The most commonly missed single item was the team introduction at the start of each case. However, we report high staff satisfaction with the Checklist and enthusiasm for its continued use.ConclusionWe report a detailed implementation strategy for introducing the WHO Surgical Safety Checklist to a low-resource setting. We show that this approach can lead to high completion rates and high staff satisfaction, albeit with a drop in completion rates over time. We argue that maximal benefit of the Surgical Safety Checklist is likely to be when it engenders a conversation around patient safety within a department, and when there is local ownership of this process.

Project description:BackgroundStrategies selected to implement the WHO's Surgical Safety Checklist (SSC) are key factors in its ability to improve patient safety. Underutilization of implementation frameworks for informing implementation processes hinders our understanding of the checklists' varying effectiveness in different contexts. This study explored the extent to which SSC implementation practices could be assessed through the i-PARIHS framework and examined how it could support development of targeted recommendations to improve SSC implementation in high-income settings.MethodsThis qualitative study utilized interviews with surgical team members and health administrators from five high-income countries to understand the key elements necessary for successful implementation of the SSC. Using thematic analysis, we identified within and across-case themes that were mapped to the i-PARIHS framework constructs. Gaps in current implementation strategies were identified, and the utility of i-PARIHS to guide future efforts was assessed.ResultsFifty-one multi-disciplinary clinicians and health administrators completed interviews. We identified themes that impacted SSC implementation in each of the four i-PARIHS constructs and several that spanned multiple constructs. Within innovation, a disconnect between the clinical outcomes-focused evidence in the literature and interviewees' patient-safety focus on observable results reduced the SSC's perceived relevance. Within recipients, existing surgical team hierarchies impacted checklist engagement, but this could be addressed through a shared leadership model. Within context, organizational priorities resulting in time pressures on surgical teams were at odds with SSC patient safety goals and reduced fidelity. At a health system level, employing surgical team members through the state or health region resulted in significant challenges in enforcing checklist use in private vs public hospitals. Within its facilitation construct, i-PARIHS includes limited definitions of facilitation processes. We identified using multiple interdisciplinary champions; establishing checklist performance feedback mechanisms; and modifying checklist processes, such as implementing a full-team huddle, as facilitators of successful SSC implementation.ConclusionThe i-PARIHS framework enabled a comprehensive assessment of current implementation strategies, identifying key gaps and allowed for recommending targeted improvements. i-PARIHS could serve as a guide for planning future SSC implementation efforts, however, further clarification of facilitation processes would improve the framework's utility.Trial registrationNo health care intervention was performed.

Project description:BackgroundThe 2009 World Health Organisation (WHO) surgical safety checklist significantly reduces surgical mortality and morbidity (up to 47%). Yet in 2016, only 25% of East African anesthetists regularly use the checklist. Nationwide implementation of the checklist is reported in high-income countries, but in low- and middle-income countries (LMICs) reports of successful implementations are sparse, limited to single institutions and require intensive support. Since checklist use leads to the biggest improvements in outcomes in LMICs, methods of wide-scale implementation are needed. We hypothesized that, using a three-day course, successful wide-scale implementation of the checklist could be achieved, as measured by at least 50% compliance with six basic safety processes at three to four months. We also aimed to determine predictors for checklist utilization.Materials and methodsUsing a blended educational implementation strategy based on prior pilot studies we designed a three-day dynamic educational course to facilitate widespread implementation of the WHO checklist. The course utilized lectures, film, small group breakouts, participant feedback and simulation to teach the knowledge, skills and behavior changes needed to implement the checklist. In collaboration with the Ministry of Health and local hospital leadership, the course was delivered to 427 multi-disciplinary staff at 21 hospitals located in 19 of 22 regions of Madagascar between September 2015 and March 2016. We evaluated implementation at three to four months using questionnaires (with a 5-point Likert scale) and focus groups. Multivariate linear regression was used to test predictors of checklist utilization.ResultsAt three to four months, 65% of respondents reported always using the checklist, with another 13% using it in part. Participant's years in practice, hospital size, or surgical volume did not predict checklist use. Checklist use was associated with counting instruments (p< 0.05), but not with verifying: patient identity, difficult intubation risk, risk of blood loss, prophylactic antibiotic administration, or counting needles and sponges.ConclusionUse of a multi-disciplinary three-day course for checklist implementation resulted in 78% of participants using the checklist, at three months; and an increase in counting surgical instruments. Successful checklist implementation was not predicted by participant length of medical service, hospital size or surgical volume. If reproducible in other countries, widespread implementation in LMICs becomes a realistic possibility.

Project description:BackgroundPoor uptake and understanding of critical perioperative information represent a major safety risk for surgical patients. Implementing a patient-driven surgical safety checklist might enhance the way critical information is given and increase patient involvement in their own safety throughout the surgical pathway. The aim of this study was to develop and validate a Surgical Patient Safety Checklist (PASC) for use by surgical patients.MethodThis was a prospective study, involving patient representatives, multidisciplinary healthcare professionals and elective surgical patients to develop and validate PASC using consensus-building techniques in two Norwegian hospitals. A set of items intended for PASC were rated by patients and then submitted to Content Validation Index (CVI) analyses. Items of low CVI went through a Healthcare Failure Mode and Effect Analysis (HFMEA) Hazard Scoring process, as well as a consensus process before they were either kept or discarded. Reliability of patients' PASC ratings was assessed using Intraclass Correlation Coefficient analysis. Lastly, the face validity of PASC was investigated through focus group interviews with postoperative patients.ResultsInitial development of PASC resulted in a checklist consisting of two parts, one before (32 items) and one after surgery (26 items). After achieving consensus on the PASC content, 215 surgical patients from six surgical wards rated the items for the CVI analysis on a 1-4 scale and mostly agreed on the content. Five items were removed from the checklist, and six items were redesigned to improve PASCs' user-friendliness. The total Scale-level index/Average (S-CVI/Ave) before revision was 0.83 and 0.86 for pre- and post-operative PASC items, respectively. Following revision, these increased to 0.86 and 0.93, respectively. The PASC items reliability score was 0.97 (95% confidence interval 0.96 to 0.98). The qualitative assessment identified that patients who used PASC felt more in control of their situation; this was achieved when PASC was given to them at what they felt was the right time and healthcare professionals took part in its usage.ConclusionMultidisciplinary perioperative care staff and surgical patients agreed upon PASC content, the checklist ratings were reliable, and qualitative assessment suggested good face validity. PASC appears to be a usable and valid checklist for elective surgical patients across specialties.

Project description:BackgroundHurricanes Katrina and Sandy were two of the most significant disasters of the 21st century that critically impacted communities and the health of their residents. Despite the assumption that disasters affect access to healthcare, to our knowledge prior studies have not rigorously examined availability of healthcare providers following disasters.ObjectiveThe objective of this study was to examine availability of healthcare providers following large-scale hurricanes.MethodsUsing historical data on healthcare providers from the National Plan and Provider Enumeration System and county-level population characteristics, we conducted a quasi-experimental study to examine the effect of large-scale hurricanes on healthcare provider availability in the short-term and long-term. We separately examined availability of primary care physicians, medical specialists, surgeons, and nurse practitioners. A difference-in-differences analysis was used to control for time variant factors comparing county-level health care provider availability in affected and unaffected counties the year before Hurricanes Katrina and Sandy, to five years after each storm.ResultsCounties affected by Hurricane Katrina compared to unaffected locales experienced a decrease of 3.59 primary care physicians per 10,000 population (95% CI: -6.5, -0.7), medical specialists (decrease of 5.9 providers per 10,000 (95% CI: -11.3, -0.5)), and surgeons (decrease of 2.1 (95% CI: -3.8, -0.37)). However, availability of nurse practitioners did not change appreciably. Counties affected by Hurricane Sandy exhibited less pronounced changes. Changes in availability of primary care physicians, nurse practitioners, medical specialists, and surgeons were not statistically significant.ConclusionLarge-scale hurricanes appear to affect availability of healthcare providers for up to several years following impact of the storm. Effects vary depending on the characteristics of the community. Primary care physicians and medical specialists availability was the most impacted, potentially having long-term implications for population health in the context of disaster recovery.

Dataset Information

Effects on Clinical Outcomes of a 5-Year Surgical Safety Checklist Implementation Experience: A Large-scale Population-Based Difference-in-Differences Study.

Publications

Effects on Clinical Outcomes of a 5-Year Surgical Safety Checklist Implementation Experience: A Large-scale Population-Based Difference-in-Differences Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets