Dataset Information

An automated retrospective VAE-surveillance tool for future quality improvement studies

ABSTRACT: Ventilator-associated pneumonia (VAP) is a frequent complication of mechanical ventilation and is associated with substantial morbidity and mortality. Accurate diagnosis of VAP relies in part on subjective diagnostic criteria. Surveillance according to ventilator-associated event (VAE) criteria may allow quick and objective benchmarking. Our objective was to create an automated surveillance tool for VAE tiers I and II on a large data collection, evaluate its diagnostic accuracy and retrospectively determine the yearly baseline VAE incidence. We included all consecutive intensive care unit admissions of patients with mechanical ventilation at Bern University Hospital, a tertiary referral center, from January 2008 to July 2016. Data was automatically extracted from the patient data management system and automatically processed. We created and implemented an application able to automatically analyze respiratory and relevant medication data according to the Centers for Disease Control protocol for VAE-surveillance. In a subset of patients, we compared the accuracy of automated VAE surveillance according to CDC criteria to a gold standard (a composite of automated and manual evaluation with mediation for discrepancies) and evaluated the evolution of the baseline incidence. The study included 22′442 ventilated admissions with a total of 37′221 ventilator days. 592 ventilator-associated events (tier I) occurred; of these 194 (34%) were of potentially infectious origin (tier II). In our validation sample, automated surveillance had a sensitivity of 98% and specificity of 100% in detecting VAE compared to the gold standard. The yearly VAE incidence rate ranged from 10.1–22.1 per 1000 device days and trend showed a decrease in the yearly incidence rate ratio of 0.96 (95% CI, 0.93–1.00, p = 0.03). This study demonstrated that automated VAE detection is feasible, accurate and reliable and may be applied on a large, retrospective sample and provided insight into long-term institutional VAE incidences. The surveillance tool can be extended to other centres and provides VAE incidences for performing quality control and intervention studies.

SUBMITTER: Wolffers O

PROVIDER: S-EPMC8593155 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveValid, reliable critical appraisal tools advance quality improvement (QI) intervention impacts by helping stakeholders identify higher quality studies. QI approaches are diverse and differ from clinical interventions. Widely used critical appraisal instruments do not take unique QI features into account and existing QI tools (eg, Standards for QI Reporting Excellence) are intended for publication guidance rather than critical appraisal. This study developed and psychometrically tested a critical appraisal instrument, the QI Minimum Quality Criteria Set (QI-MQCS) for assessing QI-specific features of QI publications.MethodsApproaches to developing the tool and ensuring validity included a literature review, in-person and online survey expert panel input, and application to empirical examples. We investigated psychometric properties in a set of diverse QI publications (N=54) by analysing reliability measures and item endorsement rates and explored sources of disagreement between reviewers.ResultsThe QI-MQCS includes 16 content domains to evaluate QI intervention publications: Organisational Motivation, Intervention Rationale, Intervention Description, Organisational Characteristics, Implementation, Study Design, Comparator Description, Data Sources, Timing, Adherence/Fidelity, Health Outcomes, Organisational Readiness, Penetration/Reach, Sustainability, Spread and Limitations. Median inter-rater agreement for QI-MQCS items was κ 0.57 (83% agreement). Item statistics indicated sufficient ability to differentiate between publications (median quality criteria met 67%). Internal consistency measures indicated coherence without excessive conceptual overlap (absolute mean interitem correlation=0.19). The critical appraisal instrument is accompanied by a user manual detailing What to consider, Where to look and How to rate.ConclusionsWe developed a ready-to-use, valid and reliable critical appraisal instrument applicable to healthcare QI intervention publications, but recognise scope for continuing refinement.

Project description:ObjectiveTo codesign an electronic chronic disease quality improvement tool for use in general practice.DesignService design employing codesign strategies.SettingGeneral practice.ParticipantsSeventeen staff (general practitioners, nurses and practice managers) from general practice in metropolitan Melbourne and regional Victoria and five patients from metropolitan Melbourne.InterventionsCodesign sessions with general practice staff, using a service design approach, were conducted to explore key design criteria and functionality of the audit and feedback and clinical decision support tools. Think aloud interviews were conducted in which participants articulated their thoughts of the resulting Future Health Today (FHT) prototype as they used it. One codesign session was held with patients. Using inductive and deductive coding, content and thematic analyses explored the development of a new technological platform and factors influencing implementation of the platform.ResultsParticipants identified that the prototype needed to work within their existing workflow to facilitate automated patient recall and track patients with or at-risk of specific conditions. It needed to be simple, provide visual snapshots of information and easy access to relevant guidelines and facilitate quality improvement activities. Successful implementation may be supported by: accuracy of the algorithms in FHT and data held in the practice; the platform supporting planned and spontaneous interactions with patients; the ability to hide tools; links to Medicare Benefits Schedule; and prefilled management plans. Participating patients supported the use of the platform in general practice. They suggested that use of the platform demonstrates a high level of patient care and could increase patient confidence in health practitioners.ConclusionStudy participants worked together to design a platform that is clear, simple, accurate and useful and that sits within any given general practice setting. The resulting FHT platform is currently being piloted in general practices and will continue to be refined based on user feedback.

Project description:BackgroundQuality improvement (QI) is used in nursing homes (NH) to implement and sustain improvements in patient outcomes. Little is known about how QI strategies are used in NHs. This lack of information is a barrier to replicating successful strategies. Guided by the Framework for Implementation Research, the purpose of this study was to map-out the use, evaluation, and reporting of QI strategies in NHs.MethodsThis scoping review was completed to identify reports published between July 2003 through February 2019. Two reviewers screened articles and included those with (1) the term "quality improvement" to describe their methods, or reported use of a QI model (e.g., Six Sigma) or strategy (e.g., process mapping) (2), findings related to impact on service and/or resident outcomes, and (3) two or more NHs included. Reviewers extracted data on study design, setting, population, problem, solution to address problem, QI strategies, and outcomes (implementation, service, and resident). Vote counting and narrative synthesis were used to describe the use of QI strategies, implementation outcomes, and service and/or resident outcomes.ResultsOf 2302 articles identified, the full text of 77 articles reporting on 59 studies were included. Studies focused on 23 clinical problems, most commonly pressure ulcers, falls, and pain. Studies used an average of 6 to 7 QI strategies. The rate that strategies were used varied substantially, e.g., the rate of in-person training (55%) was more than twice the rate of plan-do-study-act cycles (20%). On average, studies assessed two implementation outcomes; the rate these outcomes were used varied widely, with 37% reporting on staff perceptions (e.g., feasibility) of solutions or QI strategies vs. 8% reporting on fidelity and sustainment. Most studies (n = 49) reported service outcomes and over half (n = 34) reported resident outcomes. In studies with statistical tests of improvement, service outcomes improved more often than resident outcomes.ConclusionsThis study maps-out the scope of published, peer-reviewed studies of QI in NHs. The findings suggest preliminary guidance for future studies designed to promote the replication and synthesis of promising solutions. The findings also suggest strategies to refine procedures for more effective improvement work in NHs.

Project description:BackgroundUndergoing a surgical procedure is anxiety provoking for patients and their caregivers. During the intraoperative period, caregivers seek out informational updates from health care professionals, a situation complicated by COVID-19 health measures that require caregivers to wait outside the hospital. Short messaging service (SMS)-based communication that allows caregivers to follow their loved ones through surgery has shown promise in relieving anxiety and improving satisfaction with overall care. This form of communication is also well accepted by health care professionals and may be effective at relieving staff burden.ObjectiveHere, we describe a quality improvement initiative of a standardized and integrated intraoperative SMS-based system to improve communication between surgical teams and caregivers. The main goal was to improve satisfaction with care, while the secondary goal was to reduce caregiver anxiety.MethodsThe initiative followed the framework of the Model for Improvement. A large tertiary care hospital offered the SMS to caregivers who were waiting for loved ones undergoing surgery. SMS messages were integrated into the clinical information system software and sent at key points during the surgical journey to phone numbers provided by caregivers. A satisfaction survey was sent to caregivers 1 business day after surgery. Data were collected between February 16 and July 14, 2021.ResultsOf the 8129 surgeries scheduled, caregivers waiting for 6149 (75.6%) surgeries agreed to receive SMS messages. A total of 34,129 messages were sent. The satisfaction survey was completed by 2088 (34%) of the 6149 caregivers. Satisfaction with messages was high, with the majority of respondents reporting that the messages received were adequate (1476/2085, 70.8%), clear (1545/2077, 74.4%), informative (1488/2078, 71.6%), and met their needs (1234/2077, 59.4%). The overall satisfaction score was high (4.5 out of 5), and caregivers reported that receiving text messages resulted in a reduction in anxiety (score=8.2 out of 10). Technical errors were reported by 69 (3.3%) caregivers. Suggestions for improvements included having messages sent more often; providing greater patient details, including the patient's health status; and the service being offered in other languages.ConclusionsThis digital health initiative provided SMS messages that were systematically sent to caregivers waiting for their loved ones undergoing surgery, just as COVID-19 restrictions began preventing waiting onsite. The messages were used across 15 surgical specialties and have since been implemented hospital-wide. Digital health care innovations have the capacity to improve family-centered communication; what patients and their families find useful and appreciate will ultimately determine their success.

Dataset Information

An automated retrospective VAE-surveillance tool for future quality improvement studies

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets