Dataset Information

Monitoring intensive care unit performance-impact of a novel individualised performance scorecard in critical care medicine: a mixed-methods study protocol.

ABSTRACT: INTRODUCTION:Patients admitted to a critical care medicine (CCM) environment, including an intensive care unit (ICU), are susceptible to harm and significant resource utilisation. Therefore, a strategy to optimise provider performance is required. Performance scorecards are used by institutions for the purposes of driving quality improvement. There is no widely accepted or standardised scorecard that has been used for overall CCM performance. We aim to improve quality of care, patient safety and patient/family experience in CCM practice through the utilisation of a standardised, repeatable and multidimensional performance scorecard, designed to provide a continuous review of ICU physician and nurse practice, as well as departmental metrics. METHODS AND ANALYSIS:This will be a mixed-methods, controlled before and after study to assess the impact of a CCM-specific quality scorecard. Scorecard metrics were developed through expert consensus and existing literature. The study will include 19 attending CCM physicians and approximately 300 CCM nurses. Patient data for scorecard compilation are collected daily from bedside flow sheets. Preintervention baseline data will be collected for 6 months for each participant. After this, each participant will receive their scorecard measures. Following a 3-month washout period, postintervention data will be collected for 6 months. The primary outcome will be change in performance metrics following the provision of scorecard feedback to subjects. A cost analysis will also be performed, with the purpose of comparing total ICU costs prior to implementation of the scorecard with total ICU costs following implementation of the scorecard. The qualitative portion will include interviews with participants following the intervention phase. Interviews will be analysed in order to identify recurrent themes and subthemes, for the purposes of driving scorecard improvement. ETHICS AND DISSEMINATION:This protocol has been approved by the local research ethics board. Publication of results is anticipated in 2019. If this intervention is found to improve patient- and unit-directed outcomes, with evidence of cost-effectiveness, it would support the utilisation of such a scorecard as a quality standard in CCM.

SUBMITTER: Fernando SM

PROVIDER: S-EPMC5781100 | biostudies-literature | 2018 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Monitoring intensive care unit performance-impact of a novel individualised performance scorecard in critical care medicine: a mixed-methods study protocol.

Fernando Shannon M SM Neilipovitz David D Sarti Aimee J AJ Rosenberg Erin E Ishaq Rabia R Thornton Mary M Kim John J

BMJ open 20180121 1

<h4>Introduction</h4>Patients admitted to a critical care medicine (CCM) environment, including an intensive care unit (ICU), are susceptible to harm and significant resource utilisation. Therefore, a strategy to optimise provider performance is required. Performance scorecards are used by institutions for the purposes of driving quality improvement. There is no widely accepted or standardised scorecard that has been used for overall CCM performance. We aim to improve quality of care, patient sa ...[more]

PMID: 29358441

Similar Datasets

Project description:BackgroundContinuous monitoring of vital signs is critical for ensuring patient safety in intensive care units (ICUs) and is becoming increasingly relevant in general wards. The effectiveness of health information technologies such as patient-monitoring systems is highly determined by usability, the lack of which can ultimately compromise patient safety. Usability problems can be identified and prevented by involving users (ie, clinicians).ObjectiveIn this study, we aim to apply a human-centered design approach to evaluate the usability of a remote patient-monitoring system user interface (UI) in the ICU context and conceptualize and evaluate design changes.MethodsFollowing institutional review board approval (EA1/031/18), a formative evaluation of the monitoring UI was performed. Simulated use tests with think-aloud protocols were conducted with ICU staff (n=5), and the resulting qualitative data were analyzed using a deductive analytic approach. On the basis of the identified usability problems, we conceptualized informed design changes and applied them to develop an improved prototype of the monitoring UI. Comparing the UIs, we evaluated perceived usability using the System Usability Scale, performance efficiency with the normative path deviation, and effectiveness by measuring the task completion rate (n=5). Measures were tested for statistical significance using a 2-sample t test, Poisson regression with a generalized linear mixed-effects model, and the N-1 chi-square test. P<.05 were considered significant.ResultsWe found 37 individual usability problems specific to monitoring UI, which could be assigned to six subcodes: usefulness of the system, response time, responsiveness, meaning of labels, function of UI elements, and navigation. Among user ideas and requirements for the UI were high usability, customizability, and the provision of audible alarm notifications. Changes in graphics and design were proposed to allow for better navigation, information retrieval, and spatial orientation. The UI was revised by creating a prototype with a more responsive design and changes regarding labeling and UI elements. Statistical analysis showed that perceived usability improved significantly (System Usability Scale design A: mean 68.5, SD 11.26, n=5; design B: mean 89, SD 4.87, n=5; P=.003), as did performance efficiency (normative path deviation design A: mean 8.8, SD 5.26, n=5; design B: mean 3.2, SD 3.03, n=5; P=.001), and effectiveness (design A: 18 trials, failed 7, 39% times, passed 11, 61% times; design B: 20 trials, failed 0 times, passed 20 times; P=.002).ConclusionsUsability testing with think-aloud protocols led to a patient-monitoring UI with significantly improved usability, performance, and effectiveness. In the ICU work environment, difficult-to-use technology may result in detrimental outcomes for staff and patients. Technical devices should be designed to support efficient and effective work processes. Our results suggest that this can be achieved by applying basic human-centered design methods and principles.Trial registrationClinicalTrials.gov NCT03514173; https://clinicaltrials.gov/ct2/show/NCT03514173.

Project description:Background:Analgosedation is a cornerstone therapy for mechanically ventilated patients in intensive care units (ICU). To avoid inadequate sedation and its complications, monitoring of analgosedation is of great importance. The aim of this study was to investigate whether monitoring of analgosedative drug concentrations (midazolam and sufentanil) might be beneficial to optimize analgosedation and whether drug serum concentrations correlate with the results of subjective (Richmond Agitation-Sedation Scale [RASS]/Ramsay Sedation Scale) and objective (bispectral (BIS) index) monitoring procedures. Methods:Forty-nine intubated, ventilated, and analgosedated critically ill patients treated in ICU were clinically evaluated concerning the depth of sedation using RASS Score, Ramsay Score, and BIS index twice a day. Serum concentrations of midazolam and sufentanil were determined in blood samples drawn at the same time. Clinical and laboratory data were statistically analyzed for correlations using the Spearman's rank correlation coefficient rho (?). Results:Average age of the population was 57.8?±?16.0 years, 61% of the patients were males. Most frequent causes for ICU treatments were sepsis (22%), pneumonia (22%), or a combination of both (25%). Serum concentrations of midazolam correlated weakly with RASS (??=?-?0.467) and Ramsay Scores (??=?0.476). Serum concentrations of sufentanil correlated weakly with RASS (??=?-?0.312) and Ramsay Scores (??=?0.295). Correlations between BIS index and serum concentrations of midazolam (??=?-?0.252) and sufentanil (??=?-?0.166) were low. Conclusion:Correlations between drug serum concentrations and clinical or neurophysiological monitoring procedures were weak. This might be due to intersubject variability, polypharmacy with drug-drug interactions, and complex metabolism, which can be altered in critically ill patients. Therapeutic drug monitoring is not beneficial to determine depth of sedation in ICU patients.

Dataset Information

Monitoring intensive care unit performance-impact of a novel individualised performance scorecard in critical care medicine: a mixed-methods study protocol.

Publications

Monitoring intensive care unit performance-impact of a novel individualised performance scorecard in critical care medicine: a mixed-methods study protocol.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets