Dataset Information

Development and usability testing of an audit and feedback tool for anesthesiologists.

ABSTRACT: Background:We describe the creation and evaluation of a personal audit and feedback (A&F) tool for anesthesiologists. Methods:A survey aimed at capturing barriers for personal improvement efforts and feedback preferences was administered to attending anesthesiologists. The results informed the design and implementation of 4 dashboards that display information on individual practice characteristics as well as comparative performance on several quality metrics. The dashboards' usability was then tested using the human-centered design framework. Results:Anesthesiologists listed lack of information on current practice as the main barrier for improvement. Regarding usability, participants gave the dashboards an average score of 3.8 (scale 1-5) on consistency, learnability, and information organization, and performed the assigned tasks well, with an average score of 89% (range 79-100%). Conclusions:We describe the design, implementation, and usability testing of an innovative tool that utilizes data derived from the electronic health record (EHR) system to provide A&F to anesthesiology providers.

SUBMITTER: Barbeito A

PROVIDER: S-EPMC6951966 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and usability testing of an audit and feedback tool for anesthesiologists.

Barbeito Atilio A Segall Noa N

JAMIA open 20190204 1

<h4>Background</h4>We describe the creation and evaluation of a personal audit and feedback (A&F) tool for anesthesiologists.<h4>Methods</h4>A survey aimed at capturing barriers for personal improvement efforts and feedback preferences was administered to attending anesthesiologists. The results informed the design and implementation of 4 dashboards that display information on individual practice characteristics as well as comparative performance on several quality metrics. The dashboards' usabi ...[more]

PMID: 31984342

Similar Datasets

Project description:BackgroundAudit and Feedback (A&F) is a widely used quality improvement technique that measures clinicians' clinical performance and reports it back to them. Computerised A&F (e-A&F) system interfaces may consist of four key components: (1) Summaries of clinical performance; (2) Patient lists; (3) Patient-level data; (4) Recommended actions. There is a lack of evidence regarding how to best design e-A&F interfaces; establishing such evidence is key to maximising usability, and in turn improving patient safety.AimTo evaluate the usability of a novel theoretically-informed and research-led e-A&F system for primary care (the Performance Improvement plaN GeneratoR: PINGR).Objectives(1) Describe PINGR's design, rationale and theoretical basis; (2) Identify usability issues with PINGR; (3) Understand how these issues may interfere with the cognitive goals of end-users; (4) Translate the issues into recommendations for the user-centred design of e-A&F systems.MethodsEight experienced health system evaluators performed a usability inspection using an innovative hybrid approach consisting of five stages: (1) Development of representative user tasks, Goals, and Actions; (2) Combining Heuristic Evaluation and Cognitive Walkthrough methods into a single protocol to identify usability issues; (3) Consolidation of issues; (4) Severity rating of consolidated issues; (5) Analysis of issues according to usability heuristics, interface components, and Goal-Action structure.ResultsA final list of 47 issues were categorised into 8 heuristic themes. The most error-prone heuristics were 'Consistency and standards' (13 usability issues; 28% of the total) and 'Match between system and real world' (n=10, 21%). The recommended actions component of the PINGR interface had the most usability issues (n=21, 45%), followed by patient-level data (n=5, 11%), patient lists (n=4, 9%), and summaries of clinical performance (n=4, 9%). The most error-prone Actions across all user Goals were: (1) Patient selection from a list; (2) Data identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation.ConclusionsBy contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system.

Project description:BackgroundAwareness of lung cancer screening remains low in the screening-eligible population, and when patients visit their clinician never having heard of lung cancer screening, engaging in shared decision making to arrive at an informed decision can be a challenge. Therefore, methods to effectively support both patients and clinicians to engage in these important discussions are essential. To facilitate shared decision making about lung cancer screening, effective methods to prepare patients to have these important discussions with their clinician are needed.ObjectiveOur objective is to develop a computer-tailored decision support tool that meets the certification criteria of the International Patient Decision Aid Standards instrument version 4.0 that will support shared decision making in lung cancer screening decisions.MethodsUsing a 3-phase process, we will develop and test a prototype of a computer-tailored decision support tool in a sample of lung cancer screening-eligible individuals. In phase I, we assembled a community advisory board comprising 10 screening-eligible individuals to develop the prototype. In phase II, we recruited a sample of 13 screening-eligible individuals to test the prototype for usability, acceptability, and satisfaction. In phase III, we are conducting a pilot randomized controlled trial (RCT) with 60 screening-eligible participants who have never been screened for lung cancer. Outcomes tested include lung cancer and screening knowledge, lung cancer screening health beliefs (perceived risk, perceived benefits, perceived barriers, and self-efficacy), perception of being prepared to engage in a patient-clinician discussion about lung cancer screening, occurrence of a patient-clinician discussion about lung cancer screening, and stage of adoption for lung cancer screening.ResultsPhases I and II are complete. Phase III is underway. As of July 15, 2017, 60 participants have been enrolled into the study, and have completed the baseline survey, intervention, and first follow-up survey. We expect to have results by December 31, 2017 and to have data analysis completed by March 1, 2018.ConclusionsResults from usability testing indicate that the computer-tailored decision support tool is easy to use, is helpful, and provides a satisfactory experience for the user. At the conclusion of phase III (pilot RCT), we will have preliminary effect sizes to inform a future fully powered RCT on changes in (1) knowledge about lung cancer and screening, (2) perceived risk of lung cancer, (3) perceived benefits of lung cancer screening, (4) perceived barriers to lung cancer screening, (5) self-efficacy for lung cancer screening, and (6) perceptions of being adequately prepared to engage in a discussion with their clinician about lung cancer screening.

Project description:BackgroundSurrogate decision makers of stroke patients are often unprepared to make critical decisions on life-sustaining treatments. We describe the development process and key features for the Understanding Stroke web-based decision support tool.MethodsWe used multiple strategies to develop a patient-centered, tailored decision aid. We began by forming a Patient and Family Advisory Council to provide continuous input to our multidisciplinary team on the development of the tool. Additionally, focus groups consisting of nurses, therapists, social workers, physicians, stroke survivors, and family members reviewed key elements of the tool, including prognostic information, graphical displays, and values clarification exercise. To design the values clarification exercise, we asked focus groups to provide feedback on a list of important activities of daily living. An ordinal prognostic model was developed for ischemic stroke and intracerebral hemorrhage using data taken from the Virtual International Stroke Trials Archive Plus, and incorporated into the tool.ResultsFocus group participants recommended making numeric prognostic information optional due to possible emotional distress. Pie charts were generally favored by participants for graphical presentation of prognostic information, though a horizontal stacked bar chart was also added due to its prevalence in stroke literature. Plain language descriptions of the modified Rankin Scale were created to accompany the prognostic information. A values clarification exercise was developed consisting of a list of 13 situations that may make an individual consider comfort measures only. The final version of the web based tool (which can be viewed on tablets) included the following sections: general introduction to stroke, outcomes (prognostic information and recovery), in-hospital and life-sustaining treatments, decision making and values clarification, post-hospital care, tips for talking to the health care team, and a summary report. Preliminary usability testing received generally favorable feedback.ConclusionWe developed Understanding Stroke, a tailored decision support tool for surrogate decision makers of stroke patients. The tool was well received and will be formally pilot tested in a group of stroke surrogate decision makers.Trial registrationClinicalTrials.gov ( NCT03427645 ).

Project description:BackgroundA Childhood Obesity Risk Estimation tool (SLOPE CORE) has been developed based on prediction models using routinely available maternity and early childhood data to estimate risk of childhood obesity at 4-5 years. This study aims to test the feasibility, acceptability and usability of SLOPE CORE within an enhanced health visiting (EHV) service in the UK, as one context in which this tool could be utilised.MethodsA mixed methods approach was used to assess feasibility of implementing SLOPE CORE. Health Visitors (HVs) were trained to use the tool, and in the processes for recruiting parents into the study. HVs were recruited using purposive sampling and parents by convenience sampling. HVs and parents were invited to take part in interviews or focus groups to explore their experiences of the tool. HVs were asked to complete a system usability scale (SUS) questionnaire.ResultsFive HVs and seven parents took part in the study. HVs found SLOPE CORE easy to use with a mean SUS of 84.4, (n = 4, range 70-97.5) indicating excellent usability. Five HVs and three parents took part in qualitative work. The tool was acceptable and useful for both parents and HVs. Parents expressed a desire to know their child's risk of future obesity, provided this was accompanied by additional information, or support to modify risk. HVs appreciated the health promotion opportunity that the tool presented and felt that it facilitated difficult conversations around weight, by providing 'clinical evidence' for risk, and placing the focus of the conversation onto the tool result, rather than their professional judgement. The main potential barriers to use of the tool included the need for internet access, and concerns around time needed to have a sensitive discussion around a conceptually difficult topic (risk).ConclusionsSLOPE CORE could potentially be useful in clinical practice. It may support targeting limited resources towards families most at risk of childhood obesity. Further research is needed to explore how the tool might be efficiently incorporated into practice, and to evaluate the impact of the tool, and any subsequent interventions, on preventing childhood obesity.

Dataset Information

Development and usability testing of an audit and feedback tool for anesthesiologists.

Publications

Development and usability testing of an audit and feedback tool for anesthesiologists.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets