Dataset Information

Development of a handoff evaluation tool for shift-to-shift physician handoffs: the Handoff CEX.

ABSTRACT: Increasing frequency of shift-to-shift handoffs coupled with regulatory requirements to evaluate handoff quality make a handoff evaluation tool necessary.To develop a handoff evaluation tool.Tool development.Two academic medical centers.Nurse practitioners, medicine housestaff, and hospitalist attendings.Concurrent peer and external evaluations of shift-to-shift handoffs.The Handoff CEX (clinical evaluation exercise) consists of 6 subdomains and 1 overall assessment, each scored from 1 to 9, where 1 to 3 is unsatisfactory and 7 to 9 is superior. We assessed range of scores, performance among subgroups, internal consistency, and agreement among types of raters.We conducted 675 evaluations of 97 unique individuals during 149 handoff sessions. Scores ranged from unsatisfactory to superior in each domain. The highest rated domain for handoff providers was professionalism (median: 8; interquartile range [IQR]: 7-9); the lowest was content (median: 7; IQR: 6-8). Scores at the 2 institutions were similar, and scores did not differ significantly by training level. Spearman correlation coefficients among the CEX subdomains for provider scores ranged from 0.71 to 0.86, except for setting (0.39-0.40). Third-party external evaluators consistently gave lower marks for the same handoff than peer evaluators did. Weighted kappa scores for provider evaluations comparing external evaluators to peers ranged from 0.28 (95% confidence interval [CI]: 0.01, 0.56) for setting to 0.59 (95% CI: 0.38, 0.80) for organization.This handoff evaluation tool was easily used by trainees and attendings, had high internal consistency, and performed similarly across institutions. Because peers consistently provided higher scores than external evaluators, this tool may be most appropriate for external evaluation.

SUBMITTER: Horwitz LI

PROVIDER: S-EPMC3621018 | biostudies-literature | 2013 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of a handoff evaluation tool for shift-to-shift physician handoffs: the Handoff CEX.

Horwitz Leora I LI Rand David D Staisiunas Paul P Van Ness Peter H PH Araujo Katy L B KL Banerjee Stacy S SS Farnan Jeanne M JM Arora Vineet M VM

Journal of hospital medicine 20130401 4

<h4>Background</h4>Increasing frequency of shift-to-shift handoffs coupled with regulatory requirements to evaluate handoff quality make a handoff evaluation tool necessary.<h4>Objective</h4>To develop a handoff evaluation tool.<h4>Design</h4>Tool development.<h4>Setting</h4>Two academic medical centers.<h4>Subjects</h4>Nurse practitioners, medicine housestaff, and hospitalist attendings.<h4>Intervention</h4>Concurrent peer and external evaluations of shift-to-shift handoffs.<h4>Measurements</h4 ...[more]

PMID: 23559502

Similar Datasets

Project description:INTRODUCTION: Few studies investigate the benefits of familiarity or continuity during physician-to-physician handoff of inpatients. Factors such as how recently physicians (MDs) have worked and successive days caring for patients increase continuity, and thus could lead to enhanced handoff efficiency. Evaluating the efficacy of MD scheduling to enhance continuity is currently subjective. METHODS: An MD group consisting of 9 attending physicians and 7 fellows redesigned its pediatric intensive care unit (PICU) coverage schedule with the goal of enhancing continuity of care. The attending PICU MDs were formally surveyed to rate the impact of the schedule change on continuity and efficiency (5 point Likert scale: 1 = worse, 3 = no change, 5 = better). A Handoff Continuity Score (HCS) was developed and used to analyze the 30-bed PICU MD schedule for continuity and handoff efficiency. MD service and call schedules were evaluated for 6-month periods before and after the schedule redesign. The HCS for each schedule was calculated by considering every shift change, or handoff, in the scheduling horizon, and assigning scores to oncoming physicians based on previous days worked. Specifically, for each handoff, each oncoming MD receives a score between 0 and 1, calculated as the summation of a series of 'familiarity factors', one for each recent day worked. The scores for all oncoming MDs are averaged to determine the score for that specific handoff, and the HCS is the average of all handoff scores. The HCS was incorporated into an integer programming (IP) model for scheduling MDs to maximize continuity. A z-test was used to assess the significance of improvement in the HCS. RESULTS: The HCS before and after redesign was 0.57 and 0.68, respectively (19% increase, p < 0.01). Mean MD rating was 4.22 ± 0.56 for continuity, and 4.00 ± 0.65 for efficiency. With the goal of further improving the HCS and (partly) automating and streamlining the scheduling process, the IP was developed to populate physician service and night-call schedules while conforming to scheduling constraints; IP-generated schedules improved the HCS to 0.79 (39% increase). CONCLUSIONS: The increased HCS was associated with the MD qualitative assessment of enhanced continuity and efficiency after implanting a schedule change. The IP identified the potential for additional scheduling improvements.

Project description:BackgroundIndividuals on the autism spectrum face significant disparities in health and physicians often report difficulties in providing care to autistic patients. In order to improve the quality of care autistic individuals receive, it is important to identify the barriers that physicians experience in providing care so that these may be addressed. This paper reports the initial development and preliminary evaluation of a physician-report 'Barriers to Providing Healthcare' measurement tool.MethodAn established taxonomy of healthcare barriers for autistic individuals informed the initial draft of a 22-item measurement tool. This measurement tool was distributed to physicians working in various healthcare specialties and settings. Exploratory factor analysis (EFA) was conducted to determine the construct validity of the tool; discriminant validity between, and internal consistency of, the resultant factors were assessed. Multiple regressions were used to explore variables potentially associated with barriers endorsed by physicians.ResultsA total of 203 physicians were included in the analyses. The EFA resulted in a 17-item tool with three distinct factors which explained 37.6% of the variance: 1) Patient-related barriers (Cronbach's α = 0.83; e.g., the patient's reactivity to the healthcare environment); 2) Healthcare provider (HCP)/family-related barriers (Cronbach's α = 0.81; e.g., a lack of providers willing to work with autistic patients); and 3) System-related barriers (Cronbach's α = 0.84; e.g., there is a lack of support for patients and families). Discriminant validity between the factors was adequate (r < .8). The barriers that were most frequently endorsed as occurring 'often' or 'very often' included a lack of support for patients and families (endorsed by 79.9% of physicians); communication difficulties (73.4%); and a lack of coordination between services (69.9%). The regression analyses identified no significant associated variables.ConclusionA preliminary version of a novel physician-report tool to assess barriers to providing care to autistic patients has been developed although further validation work is required. The use of this tool will help physicians to identify issues specific to different medical specialities and healthcare settings. This information may help identify the supports physicians require to recognise and implement the required accommodations. Future research which elucidates barriers to healthcare provision for autistic patients is required to support systemic change in healthcare so as to improve care experiences and health outcomes for people on the autism spectrum.

Project description:BackgroundThe mini-CEX is a valid and reliable method to assess the clinical competencies of trainees. Its data could be useful for educators to redesign curriculum as a process of quality improvement. The aim of this study was to evaluate a mini-CEX assessment program in our internal medicine residency training. We investigated the impact of mini-CEX workshops as a faculty development program on the acquisition of cognitive knowledge and the difference of practice behaviors among faculty members used the mini-CEX to assess residents' performance at work.MethodsWe designed an observational, two-phase study. In the faculty development program, we started a mini-CEX workshop for trainers in 2010, and the short-term outcome of the program was evaluated by comparing the pretest and posttest results to demonstrate the improvement in cognitive knowledge on mini-CEX. From September 2010 to August 2011, we implemented a monthly mini-CEX assessment program in our internal medicine residency training. The data of these mini-CEX assessment forms were collected and analyzed.ResultsIn the group of 49 mini-CEX workshop attendees, there was a statistically significant improvement in cognitive knowledge by comparing the pretest and posttest results (67.35?±?15.25 versus 81.22?±?10.34, p?<?0.001). Among the 863 clinical encounters of mini-CEX, which involved 97 residents and 139 evaluators, 229 (26.5%), 326 (37.8%), and 308 (35.7%) evaluations were completed by the first-year, second-year, and third- year residents separately. We found a statistically significant interaction between level of training and score in dimensions of mini-CEX. The scores in all dimensions measured were better for senior residents. Participation in mini-CEX workshops as a faculty development program strengthened the adherence of trainers to the principles of mini-CEX as a formative assessment in regard to provision of feedback. However, a deficiency in engaging residents' reflection was found.ConclusionsFaculty development is a prerequisite to train evaluators in order to implement a successful mini-CEX assessment program. We demonstrated the effectiveness of our mini-CEX workshops in terms of knowledge acquisition and enhancement of giving feedback when the faculty members used the tool. Further programs on providing effective feedback should be conducted to increase the impact of the mini-CEX as a formative assessment.

Dataset Information

Development of a handoff evaluation tool for shift-to-shift physician handoffs: the Handoff CEX.

Publications

Development of a handoff evaluation tool for shift-to-shift physician handoffs: the Handoff CEX.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets