Dataset Information

Development, implementation and preliminary evaluation of clinical dashboards in a department of anesthesia.

ABSTRACT: Clinical dashboards summarize indicators of high-volume patient data in a concise, user-friendly visual format. There are few studies of the use of dashboards to improve professional practice in anesthesiology. The objective of the present study was to describe the user-centered development, implementation and preliminary evaluation of clinical dashboards dealing with anesthesia unit management and quality assessment in a French university medical center. User needs and technical requirements were identified in end user interviews and then synthesized. Several representations were then developed (according to good visualization practice) and submitted to end users for appraisal. Lastly, dashboards were implemented and made accessible for everyday use via the medical center's network. After a period of use, end user feedback on the dashboard platform was collected as a system usability score (range 0 to 100). Seventeen themes (corresponding to 29 questions and 42 indicators) were identified. After prioritization and feasibility assessment, 10 dashboards were ultimately implemented and deployed. The dashboards variously addressed the unit's overall activity, compliance with guidelines on intraoperative hemodynamics, ventilation and monitoring, and documentation of the anesthesia procedure. The mean (standard deviation) system usability score was 82.6 (11.5), which corresponded to excellent usability. We developed clinical dashboards for a university medical center's anesthesia units. The dashboards' deployment was well received by the center's anesthesiologists. The dashboards' impact on activity and practice after several months of use will now have to be assessed.

SUBMITTER: Laurent G

PROVIDER: S-EPMC7229430 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development, implementation and preliminary evaluation of clinical dashboards in a department of anesthesia.

Laurent Géry G Moussa Mouhamed D MD Cirenei Cédric C Tavernier Benoît B Marcilly Romaric R Lamer Antoine A

Journal of clinical monitoring and computing 20200516 3

Clinical dashboards summarize indicators of high-volume patient data in a concise, user-friendly visual format. There are few studies of the use of dashboards to improve professional practice in anesthesiology. The objective of the present study was to describe the user-centered development, implementation and preliminary evaluation of clinical dashboards dealing with anesthesia unit management and quality assessment in a French university medical center. User needs and technical requirements we ...[more]

PMID: 32418147

Similar Datasets

Project description:Controversy surrounds the linkage of prevention counseling with emergency department (ED)-based HIV testing. Further, the effectiveness and feasibility of prevention counseling in the ED setting is unknown. We investigate these issues by conducting a preliminarily exploration of several related aspects of our ED's HIV prevention counseling and testing program.Our urban, academic ED provides formal client-centered prevention counseling in conjunction with HIV testing. Five descriptive, exploratory observations were conducted, involving surveys and analysis of electronic medical records and programmatic data focused on (1) patient perception and feasibility of prevention counseling in the ED, (2) patient perceptions of the need to link prevention counseling with testing, and (3) potential effectiveness of providing prevention counseling in conjunction with ED-based HIV testing.Of 110 ED patients surveyed after prevention counseling and testing, 98% believed privacy was adequate, and 97% reported that their questions were answered. Patients stated that counseling would lead to improved health (80%), behavioral changes (72%), follow-up testing (77%), and discussion with partners (74%). However, 89% would accept testing without counseling, 32% were willing to seek counseling elsewhere, and 26% preferred not to receive the counseling. Correct responses to a 16-question knowledge quiz increased by 1.6 after counseling (95% confidence interval 1.3 to 12.0). The program completed counseling for 97% of patients tested; however, 6% of patients had difficulty recalling the encounter and 13% denied received testing. Among patients undergoing repeated testing, there was no consistent change in self-reported risk behaviors.Participants in the ED prevention counseling and testing program considered counseling acceptable and useful, though not required. Given adequate resources, prevention counseling can be provided in the ED, but it is unlikely that all patients benefit.

Project description:PurposeTo develop statistical dose-volume histogram (DVH)-based metrics and a visualization method to quantify the comparison of treatment plans with historical experience and among different institutions.Methods and materialsThe descriptive statistical summary (ie, median, first and third quartiles, and 95% confidence intervals) of volume-normalized DVH curve sets of past experiences was visualized through the creation of statistical DVH plots. Detailed distribution parameters were calculated and stored in JavaScript Object Notation files to facilitate management, including transfer and potential multi-institutional comparisons. In the treatment plan evaluation, structure DVH curves were scored against computed statistical DVHs and weighted experience scores (WESs). Individual, clinically used, DVH-based metrics were integrated into a generalized evaluation metric (GEM) as a priority-weighted sum of normalized incomplete gamma functions. Historical treatment plans for 351 patients with head and neck cancer, 104 with prostate cancer who were treated with conventional fractionation, and 94 with liver cancer who were treated with stereotactic body radiation therapy were analyzed to demonstrate the usage of statistical DVH, WES, and GEM in a plan evaluation. A shareable dashboard plugin was created to display statistical DVHs and integrate GEM and WES scores into a clinical plan evaluation within the treatment planning system. Benchmarking with normal tissue complication probability scores was carried out to compare the behavior of GEM and WES scores.ResultsDVH curves from historical treatment plans were characterized and presented, with difficult-to-spare structures (ie, frequently compromised organs at risk) identified. Quantitative evaluations by GEM and/or WES compared favorably with the normal tissue complication probability Lyman-Kutcher-Burman model, transforming a set of discrete threshold-priority limits into a continuous model reflecting physician objectives and historical experience.ConclusionsStatistical DVH offers an easy-to-read, detailed, and comprehensive way to visualize the quantitative comparison with historical experiences and among institutions. WES and GEM metrics offer a flexible means of incorporating discrete threshold-prioritizations and historic context into a set of standardized scoring metrics. Together, they provide a practical approach for incorporating big data into clinical practice for treatment plan evaluations.

Project description:BACKGROUND: Clinical governance (CG) is among the different frameworks proposed to improve the quality of healthcare. Iran, like many other countries, has put healthcare quality improvement in its top health policy priorities. In November 2009, implementation of CG became a task for all hospitals across the country. However, it has been a challenge to clarify the notion of CG and the way to implement it in Iran. The purpose of this action research study is to understand how CG can be defined and implemented in a selected teaching emergency department (ED). METHODS/DESIGN: We will use Soft Systems Methodology for both designing the study and inquiring into its content. As we considered a complex problem situation regarding the quality of care in the selected ED, we initially conceptualized CG as a cyclic set of purposeful activities designed to explore the situation and find relevant changes to improve the quality of care. Then, implementation of CG will conceptually be to carry out that set of purposeful activities. The activities will be about: understanding the situation and finding out relevant issues concerning the quality of care; exploring different stakeholders' views and ideas about the situation and how it can be improved; and defining actions to improve the quality of care through structured debates and development of accommodations among stakeholders. We will flexibly use qualitative methods of data collection and analysis in the course of the study. To ensure the study rigor, we will use different strategies. DISCUSSION: Successful implementation of CG, like other quality improvement frameworks, requires special consideration of underlying complexities. We believe that addressing the complex situation and reflections on involvement in this action research will make it possible to understand the concept of CG and its implementation in the selected setting. By describing the context and executed flexible methods of implementation, the results of this study would contribute to the development of implementation science and be employed by boards and executives governing other clinical settings to facilitate CG implementation.

Project description:ObjectiveClinical practice guidelines can improve healthcare processes and patient outcomes; however, the quality of these guidelines varies greatly in China. The aim of this study was to construct a comprehensive instrument for the appraisal of clinical practice guidelines in China (AGREE-CHINA), and to validate its reliability as a tool for helping potential guideline users in assessing guideline quality.MethodsFirst, an interdisciplinary working group was established for developing the methods. They also created a checklist as a tool according to the Appraisal of Guidelines, Research and Evaluation II (AGREE II) standards, considering the particularity of Chinese clinical practice. Next, the first draft of AGREE-China was developed by vote, modification, preliminary trial, and cross-verification. To ensure the objectivity, credibility, and reproducibility of the draft assessment, all of the checklists and standards were cross-reviewed fairly widely. Finally, AGREE-CHINA and AGREE II were used to assess the Chinese guidelines published in the past five years, and the results were compared.ResultsThe presented AGREE-CHINA covered five main checkpoints (science and rigor, effectiveness and safety, economy, usability and feasibility, and conflicts of interest) with each point divided into several more specific checkpoints. Definitions and rationales for each main checkpoint appear in the Appendix. The quality ratings based on the total scores of AGREE-China and AGREE II were consistent (r = 0.508, P = 0.020). Compared with AGREE II, the study showed a higher level of interrater-reliability for AGREE-CHINA overall (ICC = 0.957, P < 0.001). The mean time required for AGREE-CHINA was less than that for AGREE II; this was approximately 30 minutes for every assessment. User satisfaction was generally high.ConclusionsThis paper has presented the first edition of the AGREE-CHINA appraisal tool for clinical guidelines. It is quick and easy to use; it assesses and performs well in comparison to AGREE II. This first version of AGREE-CHINA will require further development and validation.

Project description:BackgroundThe mini-CEX is a valid and reliable method to assess the clinical competencies of trainees. Its data could be useful for educators to redesign curriculum as a process of quality improvement. The aim of this study was to evaluate a mini-CEX assessment program in our internal medicine residency training. We investigated the impact of mini-CEX workshops as a faculty development program on the acquisition of cognitive knowledge and the difference of practice behaviors among faculty members used the mini-CEX to assess residents' performance at work.MethodsWe designed an observational, two-phase study. In the faculty development program, we started a mini-CEX workshop for trainers in 2010, and the short-term outcome of the program was evaluated by comparing the pretest and posttest results to demonstrate the improvement in cognitive knowledge on mini-CEX. From September 2010 to August 2011, we implemented a monthly mini-CEX assessment program in our internal medicine residency training. The data of these mini-CEX assessment forms were collected and analyzed.ResultsIn the group of 49 mini-CEX workshop attendees, there was a statistically significant improvement in cognitive knowledge by comparing the pretest and posttest results (67.35 ± 15.25 versus 81.22 ± 10.34, p < 0.001). Among the 863 clinical encounters of mini-CEX, which involved 97 residents and 139 evaluators, 229 (26.5%), 326 (37.8%), and 308 (35.7%) evaluations were completed by the first-year, second-year, and third- year residents separately. We found a statistically significant interaction between level of training and score in dimensions of mini-CEX. The scores in all dimensions measured were better for senior residents. Participation in mini-CEX workshops as a faculty development program strengthened the adherence of trainers to the principles of mini-CEX as a formative assessment in regard to provision of feedback. However, a deficiency in engaging residents' reflection was found.ConclusionsFaculty development is a prerequisite to train evaluators in order to implement a successful mini-CEX assessment program. We demonstrated the effectiveness of our mini-CEX workshops in terms of knowledge acquisition and enhancement of giving feedback when the faculty members used the tool. Further programs on providing effective feedback should be conducted to increase the impact of the mini-CEX as a formative assessment.

Dataset Information

Development, implementation and preliminary evaluation of clinical dashboards in a department of anesthesia.

Publications

Development, implementation and preliminary evaluation of clinical dashboards in a department of anesthesia.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets